I need to use LLM inference APIs
Hosted and local inference APIs, most of them OpenAI-compatible, that serve open, proprietary and on-device models.
54 tools · 35 official
Picked from listings that mention llm inference, llm api, inference api, open models or local llm in their name, description, tags or skills; those in Language & Translation or Infrastructure & Ops, or with API access, rank higher.
The short answer
Featured and Sponsored first, then the best fits to use LLM inference APIs on Agent Switchboard, as of 20 Nov 2026: Kong AI Gateway (Featured), Pi (Featured) and NVIDIA NIM API, of 54 tools that do it.
- Which official tools use LLM inference APIs?
- Kong AI Gateway (Featured), NVIDIA NIM API and Crusoe Managed Inference, among 35 that are official.
- Which have a hosted MCP server?
- None of the 54 tools lists a hosted MCP server address.
- Which need no API key or sign-in?
- Magnitude, Jan and vLLM, among 13 that need none.
Updated with the weekly drop. Featured and Sponsored listings that do the job come first, labeled; the rest are ranked by how well they fit.
Compared
As of Nov 20, 2026, the last change to any of these listings. Verified means its URLs load and its access answers; we recheck every month.
| Tool | Access | Sign-in | Maker | Checked | Updated |
|---|---|---|---|---|---|
| API · CLI · MCP | API key | KongOfficial | Verified | Nov 2, 2026 | |
| CLI · API · MCP | API key | Earendil Works | Verified | Sep 13, 2026 | |
| API | API key | NVIDIAOfficial | Verified | Nov 2, 2026 | |
| API | API key | CrusoeOfficial | Verified | Nov 13, 2026 | |
| API · CLI | API key | Prime Intellect | Verified | Nov 13, 2026 | |
| API | API key | SambaNovaOfficial | Verified | Nov 20, 2026 |
Best fits
Official
The ones published by the company behind the product.
Kong AI Gateway
NVIDIA NIM API
Crusoe Managed Inference
SambaNova Cloud (SambaCloud)
Cerebras Inference
Nebius Token Factory
Kimi API Platform
OpenAI API
Related tasks
- deploy and host an app62 tools





Deploy and host apps, APIs, models and MCP servers from an agent or the command line. - transcribe audio15 tools





Turn recordings, meetings and live audio into text. - translate text7 tools





Translate text, documents and apps into other languages. - manage AWS, Azure or Google Cloud16 tools





Manage AWS, Azure and Google Cloud resources, and Terraform, from an agent.
In stacks
Missing a tool that does this? Suggest a listing.