Agent Switchboard

Browse Agents

Task

I need to test and evaluate agents

Remove task

Trace, test and score LLM apps and agents before and after they ship.

Picked from listings that mention evals, evaluation, llm observability, tracing or prompt testing in their name, description, tags or skills; those in Infrastructure & Ops, Code & DevTools or Orchestration, or with API access, rank higher. About this task →

13 official agents fit this task

all Verified · 2 No auth needed · 12 API · 3 MCP · 10 CLI

Langfuse

API · CLI

Open-source LLM observability and analytics. Trace, evaluate, and debug LLM apps with prompt versioning, score…

VerifiedOfficialby Langfuse · Infrastructure & Ops · 5 skills · API Key

Microsoft PromptFlow

API · CLI

Build, evaluate, and deploy LLM applications as visual DAG flows — chain prompts, Python, and tools, then run batch…

VerifiedOfficialby Microsoft · Orchestration, Code & DevTools · 3 skills · API Key

OpenLLMetry

API

Instruments LLM and agent applications with OpenTelemetry-native tracing, exporting spans for prompts, tool calls, and…

VerifiedOfficialby Traceloop · Infrastructure & Ops, Research & Knowledge · 3 skills · API Key

Datadog LLM Observability

API · MCP · CLI

End-to-end monitoring for LLM applications — trace prompts, evaluate responses, track costs, and debug AI pipelines in…

VerifiedOfficialby Datadog · Infrastructure & Ops · API Key

Arize Phoenix

API · CLI

Traces, evaluates and debugs LLM and agent applications from an open-source observability platform built on…

VerifiedOfficialby Arize AI · Data & Analytics, Infrastructure & Ops · 3 skills · No auth

Google Agents CLI

CLI

Turns any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud. An open CLI…

VerifiedOfficialby Google · Code & DevTools · 3 skills · OAuth 2.0

LangChain / LangSmith

API · MCP · CLI

Framework for building LLM applications with chains, agents, and tool use — plus LangSmith for tracing, evaluation, and…

VerifiedOfficialby LangChain · Infrastructure & Ops, Code & DevTools · API Key

AgentScope

CLI · API

Builds multi-agent applications with a Python framework focused on transparency, observability, and tracing. Includes a…

VerifiedOfficialby Alibaba · Orchestration · 3 skills · API Key

Genkit

API · CLI

Builds AI features and agent flows in JavaScript, Go or Python with typed flows, tool calling and a local dev UI for…

VerifiedOfficialby Google · Orchestration, Code & DevTools · 3 skills · API Key

Cursor Agent SDK

API · CLI

Lets developers define, test, evaluate, and deploy agents as Markdown and TypeScript code, on Cursor-managed hosting or…

VerifiedOfficialby Anysphere · Orchestration, Code & DevTools · 5 skills · API Key

NVIDIA NeMo Agent Toolkit

API · CLI · MCP

Connects, profiles, evaluates, and optimizes agent workflows across frameworks like LangChain, LlamaIndex, and CrewAI…

VerifiedOfficialby NVIDIA · Orchestration · 4 skills · No auth

Cloudflare AI Gateway

API

Proxies requests to OpenAI, Anthropic, Google, Workers AI, and other model providers, adding analytics, logging…

VerifiedOfficialby Cloudflare · Infrastructure & Ops · 5 skills · Bearer Token

Vercel AI Gateway

API

Routes model calls from any app or coding agent across providers with one API key, adding fallbacks, request logs…

VerifiedOfficialby Vercel · Infrastructure & Ops, Language & Translation · 5 skills · API Key
/browse
13 agents fit the task · task: evaluate-agents · official
verified: 13 · no-auth: 2 · api: 12 · mcp: 3 · cli: 10
I need to test and evaluate agents: Trace, test and score LLM apps and agents before and after they ship. Picked from listings that mention evals, evaluation, llm observability, tracing or prompt testing in their name, description, tags or skills; those in Infrastructure & Ops, Code & DevTools or Orchestration, or with API access, rank higher. Best fits with why: /tasks/evaluate-agents · without the task: /browse?official=1
results
langfuseinfrastructureapi+clipromptfloworchestrationapi+cliopenllmetryinfrastructureapidatadog-llm-observabilityinfrastructureapi+mcp+cliarize-phoenixdata-analyticsapi+cligoogle-agents-clicode-devtoolsclilangchain-langsmithinfrastructureapi+mcp+cliagentscopeorchestrationcli+apigenkitorchestrationapi+clicursor-agent-sdkorchestrationapi+clinvidia-nemo-agent-toolkitorchestrationapi+cli+mcpcloudflare-ai-gatewayinfrastructureapivercel-ai-gatewayinfrastructureapi