---
title: "Promptfoo"
pageType: "tool-profile"
schemaVersion: "1.0"
snapshotId: "tv-20260915-f4c107995a2e"
generatedAt: "2026-09-15T07:02:20.000Z"
canonicalUrl: "https://toolvitals.com/tools/promptfoo/"
jsonUrl: "https://toolvitals.com/api/agent/tools/promptfoo"
indexable: true
---

# Promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.  Used by OpenAI and Anthropic.

## Decision context

- Status: active
- ToolVitals score: 97/100
- Health score: 97/100
- Shipping score: 97/100
- Score mode: verdict
- Data confidence: 90/100
- Source coverage: 100/100
- Last evidence check: 2026-09-14

## Classification

- Use case: Testing Frameworks (testing-frameworks)
- Category: Developer Tools (developer-tools)
- Tool mode: Source-visible project
- Openness: OSI-approved OSS
- License: MIT
- Tags: open-source, ci, ci-cd, cicd, evaluation, evaluation-framework, llm, llm-eval, llm-evaluation, llm-evaluation-framework, llmops, pentesting, prompt-engineering, prompt-testing, prompts, rag

## Public repository signals

- Repository: [promptfoo/promptfoo](https://github.com/promptfoo/promptfoo)
- Stars: 25069 (adoption context only)
- Forks: 2298
- Open issues: 651
- Last commit date: 2026-09-14
- Releases in 90 days: 11

## Source receipts

- [Official website](https://promptfoo.dev/) — checked 2026-09-14
- [Source repository](https://github.com/promptfoo/promptfoo) — checked 2026-09-14

## Discovery status

- Search indexable: yes
- Reason: sufficient tool evidence

## Interpretation limits

- ToolVitals scores summarize bounded public maintenance, shipping, openness, and evidence signals. They are not user-review ratings.
- GitHub stars and related popularity metrics are adoption context, not quality evidence.
- Missing values mean not collected or not confidently established; they do not mean zero.
- Public signals do not prove security, uptime, support quality, customer satisfaction, or production suitability.
- Verify material decisions against the linked first-party sources and your own requirements.