Promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

ToolVitals 100/100 Overall public signal score
Health 100/100 Maintenance posture
Shipping 100/100 Release momentum
Zombie Risk 0/100 Low risk

Score History

Scores collected daily. More data points appear as the tracker runs.

About this tool

What ToolVitals knows about Promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Maintenance and shipping signals are strong.

Open Source Project Developer Infrastructure Scored Intelligence
Repository

GitHub Activity

TS
promptfoo/promptfoo
Stars 20,626
Forks 1,788
Watchers 20,626
Open Issues 262
Primary Language
TypeScript
Last Commit
Today
Releases 90d
20
Default Branch
main
License
MIT
Repository Status
Active repository
Evidence

Signal Quality

Data Confidence 81/100 Good
Source Coverage 90/100 Strong
Publish Confidence 85/100 Strong

ConfidenceHigh-confidence score from multiple public signals.

Zombie RiskNo meaningful zombie signal right now.

How ToolVitals scores work
Sources

Tracked Sources

Profile

Classification

Category
Developer Tools
Use Case
Developer Infrastructure
Tool Mode
Open Source Project
Score Model
Open Source Maintenance
Score Visibility
Scored Intelligence
Status
Active
Pricing

Pricing Evidence

Free Tier
Not detected
Currency
USD
Tracked Plans
0
Latest

Recent Updates

Tags
open-sourcecici-cdcicdevaluationevaluation-frameworkllmllm-evalllm-evaluationllm-evaluation-frameworkllmopspentestingprompt-engineeringprompt-testingpromptsragred-teamingtestingvulnerability-scanners

Recommended Alternatives

Top-ranked tools in the same use case by public ToolVitals evidence.

Some links are affiliate links. ToolVitals may earn a commission from qualifying purchases.