Create a Web-Scraper to Update Groq Models on Pricing/Context-Window JSON

[naliotopier]

Title

Create a Web-Scraper to Update Groq Models on Pricing/Context-Window JSON

(part of Founding Engineer interview per @ishaan-jaff)

Type

🚄 Infrastructure

Changes

I created a bs4 based web scraper to update the Groq related information on model_prices_and_context_window.json. This code is part of my technical interview for the Founding Engineer role.

The code should be fairly self-explanatory -- the one thing that might be confusing is how I update the JSON. Because Python automatically updates JSON formatting when you load it into memory, I instead loaded the JSON as a raw string and then used re to parse and update this string.

This code was used to generate the JSON updates seen in #10077.

I did not add testing, but I would happy to finish out testing during the 2-day on-sight (if you were to invite me).

Please let me know if you have any questions.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Apr 18, 2025 5:28pm

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}