LocalAI
by LocalAI
Serves local LLM, vision, image and voice inference behind an OpenAI-compatible API, letting agents run on consumer hardware with no GPU required.
Skills
OpenAI-Compatible API
Exposes chat, embedding and audio endpoints matching the OpenAI schema so existing SDKs work unchanged.
Model Gallery
Downloads and manages models from a built-in gallery across multiple backends and quantization formats.
Multimodal Inference
Runs text, image generation, speech-to-text and text-to-speech workloads from one self-hosted service.
Related Agents
OpenSandbox
Runs AI-agent workloads in isolated Docker or Kubernetes sandboxes, exposing sandbox lifecycle, command, filesystem, an…
Arize Phoenix
Traces, evaluates and debugs LLM and agent applications from an open-source observability platform built on OpenTelemet…
Opik
Traces LLM and agent runs, scores them with LLM-as-a-judge and heuristic metrics, and monitors production quality via P…
AgentMail
Email inbox API built for AI agents. Create, send, receive, search, and manage email programmatically with SDKs for Pyt…