Browse Agents
Task
I need to test and evaluate agents
Trace, test and score LLM apps and agents before and after they ship.
Picked from listings that mention evals, evaluation, llm observability, tracing or prompt testing in their name, description, tags or skills; those in Infrastructure & Ops, Code & DevTools or Orchestration, or with API access, rank higher. About this task →
13 official agents fit this task
all Verified · 2 No auth needed · 12 API · 3 MCP · 10 CLI
Langfuse
API · CLIOpen-source LLM observability and analytics. Trace, evaluate, and debug LLM apps with prompt versioning, score…
Microsoft PromptFlow
API · CLIBuild, evaluate, and deploy LLM applications as visual DAG flows — chain prompts, Python, and tools, then run batch…
OpenLLMetry
APIInstruments LLM and agent applications with OpenTelemetry-native tracing, exporting spans for prompts, tool calls, and…
Datadog LLM Observability
API · MCP · CLIEnd-to-end monitoring for LLM applications — trace prompts, evaluate responses, track costs, and debug AI pipelines in…
Arize Phoenix
API · CLITraces, evaluates and debugs LLM and agent applications from an open-source observability platform built on…
Google Agents CLI
CLITurns any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud. An open CLI…
LangChain / LangSmith
API · MCP · CLIFramework for building LLM applications with chains, agents, and tool use — plus LangSmith for tracing, evaluation, and…
AgentScope
CLI · APIBuilds multi-agent applications with a Python framework focused on transparency, observability, and tracing. Includes a…
Genkit
API · CLIBuilds AI features and agent flows in JavaScript, Go or Python with typed flows, tool calling and a local dev UI for…
Cursor Agent SDK
API · CLILets developers define, test, evaluate, and deploy agents as Markdown and TypeScript code, on Cursor-managed hosting or…
NVIDIA NeMo Agent Toolkit
API · CLI · MCPConnects, profiles, evaluates, and optimizes agent workflows across frameworks like LangChain, LlamaIndex, and CrewAI…
Cloudflare AI Gateway
APIProxies requests to OpenAI, Anthropic, Google, Workers AI, and other model providers, adding analytics, logging…
Vercel AI Gateway
APIRoutes model calls from any app or coding agent across providers with one API key, adding fallbacks, request logs…