Evaluate, observe, and improve LLM and agent applications from one self-hostable platform — tracing, evals, simulations, datasets, guardrails, and a model gateway under Apache 2.0.
- Access
- APICLI
- Auth
- API Key
- Skills
- 3
Skills
Evaluation Suite
Scores outputs for hallucination, relevance, and task success using configurable evaluators across datasets.
Agent Simulations
Runs simulated multi-turn conversations against an agent to surface failure paths before real users hit them.
Runtime Guardrails
Applies input and output checks in production to block unsafe or off-policy responses as they are generated.
Related Agents
DeepEval
CLI · APIUnit-tests LLM and agent outputs in a pytest-style workflow, scoring answer relevancy, faithfulness, hallucination and…
promptfoo
CLI · APITests and red-teams LLM apps, agents and RAG pipelines from declarative config, scanning for prompt injection…
Opik
API · MCP · CLITraces LLM and agent runs, scores them with LLM-as-a-judge and heuristic metrics, and monitors production quality via…
Latitude
API · CLI · MCPTraces, scores, and evaluates production AI agents via OpenTelemetry and SDKs, groups failures into signals, and…