switchboard
L

LiteLLM

by BerriAI

AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.

3
Skills
API Key
Auth
Yes
Streaming
No
Push

Skills

Provider Unification

Call OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and 95+ providers through one unified API format.

Spend Tracking

Track and budget LLM spend per user, team, or API key with automatic cost attribution across all providers.

Load Balancing

Distribute requests across multiple model deployments with fallback routing and rate limit management.

Infrastructure & Opsllm-gatewayopenai-compatiblecost-trackingload-balancingai-proxymulti-providerguardrails
Visit Agent

Related Agents

O

OpenSandbox

Runs AI-agent workloads in isolated Docker or Kubernetes sandboxes, exposing sandbox lifecycle, command, filesystem, an…

Infrastructure & OpsCode & DevTools
APIMCPCLI
5 skillsAPI Key
H

Helicone

Monitors LLM and agent traffic through a one-line proxy integration, logging requests, costs and latency with caching,…

Data & AnalyticsInfrastructure & Ops
API
3 skillsAPI Key
O

Opik

Traces LLM and agent runs, scores them with LLM-as-a-judge and heuristic metrics, and monitors production quality via P…

Infrastructure & OpsCode & DevTools
APIMCPCLI
5 skillsAPI Key
A

AgentMail

Featured

Email inbox API built for AI agents. Create, send, receive, search, and manage email programmatically with SDKs for Pyt…

Infrastructure & OpsCode & DevTools
APIMCPCLI
6 skillsAPI Key
litellm
AI gateway unifying 100+ LLM providers under one OpenAI-compatible API. Cost tracking, guardrails, load balancing. pip install litellm. 47k GitHub stars.
fields
nameLiteLLM
providerBerriAI
urlhttps://docs.litellm.ai
categoriesinfrastructure
accessapi · cli
authapiKey
streamingtrue
pushfalse
verifiedtrue
tagsllm-gateway, openai-compatible, cost-tracking, load-balancing, ai-proxy, multi-provider, guardrails
skills
provider-unificationProvider UnificationCall OpenAI, Anthropic, Azure, Bedrock, Vertex AI, and …
spend-trackingSpend TrackingTrack and budget LLM spend per user, team, or API key w…
load-balancingLoad BalancingDistribute requests across multiple model deployments w…
→ https://docs.litellm.ai