Promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Data confidence100/100
Source coverage100/100
Publish confidence100/100
Evidence checkedJul 31, 2026
Score Breakdown

Public signal read

?

How to read this

These bars are a reader-facing view of the ToolVitals evidence model. They summarize maintenance, shipping, confidence, and decay signals.

Activity
Recent commits, releases, changelog, package, and product-motion signals.
Reliability
Maintenance posture from recency, release evidence, availability, and repo signals.
Adoption
Public footprint from GitHub stars, forks, and watchers when available.
Sustainability
Longer-term posture combining health, activity, adoption, confidence, and decay risk.
ToolVitals100/100Health100/100Shipping100/100Zombie Risk0/100
Overall Score100Active
Activity100
Reliability100
Adoption88
Sustainability98

Score History

Scores collected daily. More data points appear as the tracker runs.

About this tool

What ToolVitals knows about Promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

This tool has an OSI-approved open-source license signal.

Maintenance and shipping signals are strong.

Source-visible projectTesting FrameworksOSI-approved OSSScored Intelligence
Repository

GitHub Activity

TS
promptfoo/promptfoo
Stars23,769
Forks2,136
Watchers23,769
Open Issues475
Primary Language
TypeScript
Last Commit
Today
Releases 90d
13
Default Branch
main
License
MIT
Repository Status
Active repository
Evidence

Signal Quality

Data Confidence100/100Strong
Source Coverage100/100Strong
Publish Confidence100/100Strong

ConfidenceHigh-confidence score from multiple public signals.

Zombie RiskNo meaningful zombie signal right now.

How ToolVitals scores work
Openness

License Evidence

Class
OSI-approved OSS
License
MIT

This tool has an OSI-approved open-source license signal.

Sources

Tracked Sources

Profile

Classification

Category
Developer Tools
Use Case
Testing Frameworks
Openness
OSI-approved OSS
License
MIT
Tool Mode
Source-visible project
Score Model
Open Source Maintenance
Score Visibility
Scored Intelligence
Status
Active
Maintainers

README Badge

Show this ToolVitals status in project docs.

Open badge SVG
Latest

Recent Updates

Tags
open-sourcecici-cdcicdevaluationevaluation-frameworkllmllm-evalllm-evaluationllm-evaluation-frameworkllmopspentestingprompt-engineeringprompt-testingpromptsragred-teamingtestingvulnerability-scannersai-testingrag-evaluationagent-testingvulnerability-scanningdeveloper-tools

Recommended Alternatives

Top-ranked tools in the same use case by public ToolVitals evidence.

kotest

Active · OSI-approved OSS

87

Spearmint

Critical · OSI-approved OSS

40

Lost Pixel

Critical · OSI-approved OSS

38

Some links are affiliate links. ToolVitals may earn a commission from qualifying purchases.