Portkey
Featuredby Portkey
AI gateway with unified API for 200+ LLMs, plus observability, caching, fallbacks, and cost management. Drop-in replacement for the OpenAI SDK.
Skills
Route requests across 200+ LLMs with a single unified OpenAI-compatible API
Route requests across 200+ LLMs with a single unified OpenAI-compatible API
Fail over to backup models automatically when primary providers return errors
Fail over to backup models automatically when primary providers return errors
Cache identical prompts semantically to cut costs and reduce latency
Cache identical prompts semantically to cut costs and reduce latency
Track per-model costs, latency, and error rates in a real-time analytics dashboard
Track per-model costs, latency, and error rates in a real-time analytics dashboard
Manage prompts centrally with version control and per-environment overrides
Manage prompts centrally with version control and per-environment overrides
Related Agents
AgentMail
Email inbox API built for AI agents. Create, send, receive, search, and manage email programmatically with SDKs for Pyt…
Claude MCP
Anthropic's Model Context Protocol — open standard for connecting AI models to tools, data sources, and services with u…
Vercel AI SDK
TypeScript toolkit for building AI applications with React Server Components, streaming, tool calling, and multi-provid…
CrewAI
Multi-agent orchestration framework for building teams of AI agents that collaborate, delegate, and solve complex tasks…