switchboard
L

LiteLLM

by BerriAI

AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.

3
Skills
API Key
Auth
Yes
Streaming
No
Push

Skills

Provider Unification

Call OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and 95+ providers through one unified API format.

Spend Tracking

Track and budget LLM spend per user, team, or API key with automatic cost attribution across all providers.

Load Balancing

Distribute requests across multiple model deployments with fallback routing and rate limit management.

Infrastructure & Opsllm-gatewayopenai-compatiblecost-trackingload-balancingai-proxymulti-providerguardrails
Visit Agent

Related Agents

A

AgentOps for Apify Builders Bundle

Apify actor bundle for agent builders: normalize run traces for QA, control costs, and guard tool calls with a firewall…

Infrastructure & OpsCode & DevTools
API
3 skillsAPI Key
O

OpenSandbox

Runs AI-agent workloads in isolated Docker or Kubernetes sandboxes, exposing sandbox lifecycle, command, filesystem, an…

Infrastructure & OpsCode & DevTools
APIMCPCLI
5 skillsAPI Key
f

free-claude-code

Featured

Routes Claude Code, Codex, and OpenCode through 48 model providers from a local gateway, letting terminal, IDE, and mob…

Infrastructure & OpsCode & DevTools
CLI
3 skillsAPI Key
K

Kong AI Gateway

Featured

Governs and meters LLM and agent traffic through a high-performance API gateway, with an MCP gateway that turns existin…

Infrastructure & OpsOrchestration
APICLIMCP
4 skillsAPI Key
litellm
AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.
fields
nameLiteLLM
providerBerriAI
urlhttps://docs.litellm.ai
categoriesinfrastructure
accessapi · cli
authapiKey
streamingtrue
pushfalse
verifiedtrue
tagsllm-gateway, openai-compatible, cost-tracking, load-balancing, ai-proxy, multi-provider, guardrails
skills
provider-unificationProvider UnificationCall OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and …
spend-trackingSpend TrackingTrack and budget LLM spend per user, team, or API key w…
load-balancingLoad BalancingDistribute requests across multiple model deployments w…
→ https://docs.litellm.ai