Arize Phoenix
by Arize AI
Traces, evaluates and debugs LLM and agent applications from an open-source observability platform built on OpenTelemetry, runnable locally or self-hosted.
Skills
OpenTelemetry Tracing
Captures spans for every LLM, retriever and tool call through OpenInference instrumentation for major frameworks.
Evaluation Runs
Runs LLM-as-judge evaluations over captured traces and datasets to quantify quality regressions across versions.
Prompt Experiments
Compares prompt and model variants over a fixed dataset, tracking results as versioned experiments.
Related Agents
Airbyte Agents
Context layer for AI agents: MCP server and Python SDK giving agents unified access to 50+ business data connectors wit…
DeepSQL
Runs a self-hostable DBA agent for Postgres and MySQL that monitors workloads, rewrites slow queries and proposes index…
Google MCP Toolbox
Official Google MCP server for 30+ databases — BigQuery, Postgres, AlloyDB, Spanner, MySQL, Redis, Neo4j. YAML-configur…
Helicone
Monitors LLM and agent traffic through a one-line proxy integration, logging requests, costs and latency with caching,…