Agent Switchboard
p

promptfoo

by promptfoo

Verified

Tests and red-teams LLM apps, agents and RAG pipelines from declarative config, scanning for prompt injection, jailbreaks and other vulnerabilities in CI.

Access
CLIAPI
Auth
None
Skills
3

Skills

  • Declarative Eval Suites

    Runs prompt and agent test cases from a config file, scoring outputs with assertions and model graders.

  • Automated Red Teaming

    Generates adversarial attacks against an application to find prompt injection, jailbreaks and data leakage.

  • Model Comparison

    Compares providers and prompt variants side by side on the same dataset to justify a model choice with data.

SecurityCode & DevToolsllm-evaluationred-teamingprompt-injectionregression-testingci-integrationjailbreak-scanning
Visit Agent

Related Agents

NeMo Guardrails

API

Adds programmable guardrails to LLM apps — input/output moderation, jailbreak and prompt-injection detection, topic…

VerifiedOfficialby NVIDIA · Security · 3 skills · No auth

NVIDIA SkillSpector

CLI

Scan agent skills, plugins, and MCP servers before installing them — detects prompt injection, data exfiltration…

VerifiedOfficialFeaturedby NVIDIA · Security, Code & DevTools · 4 skills · No auth

HexStrike AI

MCP · CLI

Drive 150+ offensive security tools from an AI agent through one MCP server — reconnaissance, vulnerability scanning…

Verifiedby HexStrike · Security · 3 skills · No auth

Arcjet

API · MCP · CLI

Secures AI agents and apps at runtime: detects prompt injection, enforces tool-call policies, redacts sensitive data…

Verifiedby Arcjet · Security, Infrastructure & Ops · 5 skills · API Key
promptfoo
Tests and red-teams LLM apps, agents and RAG pipelines from declarative config, scanning for prompt injection, jailbreaks and other vulnerabilities in CI.
fields
namepromptfoo
providerpromptfoo
urlhttps://github.com/promptfoo/promptfoo
categoriessecurity · code-devtools
accesscli · api
authnone
streamingfalse
pushfalse
verifiedtrue
officialfalse
tagsllm-evaluation, red-teaming, prompt-injection, regression-testing, ci-integration, jailbreak-scanning
skills
eval-suitesDeclarative Eval SuitesRuns prompt and agent test cases from a config file, sc…
red-teamingAutomated Red TeamingGenerates adversarial attacks against an application to…
model-comparisonModel ComparisonCompares providers and prompt variants side by side on …
→ https://github.com/promptfoo/promptfoo