llm-gateway

Here are 2 public repositories matching this topic...

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

gateway bedrock openai vertex-ai azure-openai llm langchain llmops anthropic openai-proxy ai-gateway llm-gateway

Updated Apr 30, 2025
Python

Tanantor / langgate

Star

Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.

Updated Apr 9, 2025
Python

Improve this page

Add a description, image, and links to the llm-gateway topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-gateway topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly