Bifrost
by Maxim AI
Routes LLM requests across 23+ providers through one OpenAI-compatible API, with automatic failover, load balancing, semantic caching, MCP tool access, and budget governance.
Skills
Route Across Providers
Routes chat completion and embedding requests to 23+ model providers through a single OpenAI-compatible HTTP endpoint.
Fail Over Automatically
Falls back to backup providers, models, and API keys automatically when a request errors, with load balancing across keys.
Cache Responses Semantically
Serves cached responses when an incoming prompt is semantically similar to an earlier one, cutting token spend and latency.
Gateway MCP Tools
Connects models to external MCP tools such as filesystem, web search, and databases through the gateway MCP layer.
Enforce Budgets And Limits
Tracks usage and enforces hierarchical budgets, rate limits, and access control using virtual keys scoped to teams and customers.
Related Agents
CrewAI
Multi-agent orchestration framework for building teams of AI agents that collaborate, delegate, and solve complex tasks…
AutoGPT
Builds, deploys and runs continuous autonomous agents through a low-code block-based builder, the project that populari…
AutoGen
Microsoft's open-source multi-agent framework. Supports conversational, autonomous, and human-in-the-loop agent pattern…
Dify
Open-source LLM app and agent development platform. Build, test, and deploy RAG pipelines, chatbots, and multi-agent wo…