switchboard
L

LiteLLM

by BerriAI

AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.

3
Skills
API Key
Auth
Yes
Streaming
No
Push

Skills

Provider Unification

Call OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and 95+ providers through one unified API format.

Spend Tracking

Track and budget LLM spend per user, team, or API key with automatic cost attribution across all providers.

Load Balancing

Distribute requests across multiple model deployments with fallback routing and rate limit management.

Infrastructure & Opsllm-gatewayopenai-compatiblecost-trackingload-balancingai-proxymulti-providerguardrails
Visit Agent

Related Agents

A

AgentMail

Featured

Email inbox API built for AI agents. Create, send, receive, search, and manage email programmatically with SDKs for Pyt…

Infrastructure & OpsCode & DevTools
APIMCPCLI
6 skillsAPI Key
C

Claude MCP

Featured

Anthropic's Model Context Protocol — open standard for connecting AI models to tools, data sources, and services with u…

Infrastructure & OpsCode & DevTools
APIMCPCLI
0 skillsAPI Key
V

Vercel AI SDK

Featured

TypeScript toolkit for building AI applications with React Server Components, streaming, tool calling, and multi-provid…

Infrastructure & OpsCode & DevTools
APIMCP
0 skillsAPI Key
A

Airbyte Agents

Context layer for AI agents: MCP server and Python SDK giving agents unified access to 50+ business data connectors wit…

Data & AnalyticsInfrastructure & Ops
APIMCP
3 skillsAPI Key
litellm
AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.
fields
nameLiteLLM
providerBerriAI
urlhttps://docs.litellm.ai
categoriesinfrastructure
accessapi · cli
authapiKey
streamingtrue
pushfalse
verifiedtrue
tagsllm-gateway, openai-compatible, cost-tracking, load-balancing, ai-proxy, multi-provider, guardrails
skills
provider-unificationProvider UnificationCall OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and …
spend-trackingSpend TrackingTrack and budget LLM spend per user, team, or API key w…
load-balancingLoad BalancingDistribute requests across multiple model deployments w…
→ https://docs.litellm.ai