# promptfoo

> Open-source LLM evals and red teaming.

promptfoo has a SharkScore of 67.7/100, ranked #42 of 665 in Frameworks & SDKs (updated 2026-11-19).

- Website: https://www.promptfoo.dev (promptfoo.dev)
- Kind: Tool · Pricing: Open source
- Maker: Promptfoo
- Repository: https://github.com/promptfoo/promptfoo
- Categories: Frameworks & SDKs
- Verified by the maker: no

## Why it scores 67.7

| Part | Score (0–100) | Weight |
|---|---|---|
| Adoption | 46 | 30% |
| User reviews | no data | 25% |
| Maintenance | 100 | 20% |
| Trust & transparency | 80 | 15% |
| Momentum | no data | 10% |

Evidence covers 87% of the score's weight. Compared with other listings in Frameworks & SDKs.

## Evidence

| Signal | Value |
|---|---|
| Traffic rank (Tranco) | #83.5K |
| GitHub stars | 27.4K |
| Stars, last 90 days | — |
| Downloads, 30 days | 4.8M |
| Reviews | none yet |
| Last update | 0 days ago |
| Uptime, 30 days | 100.0% |
| Public pricing / Free tier / API / MCP | yes / yes / yes / yes |

## RankShark review

Automated evaluation by RankShark · 2026-11-18 · method review-1.0 · https://rankshark.pro/how-we-review
We were not paid for this review.

As of 2026-11-18, promptfoo is an open-source LLM evaluation and security-testing tool; its free Community plan includes up to 10k red-team probes per month. [E2, E3]

Promptfoo is a tool for testing prompts, models, RAG pipelines, and agents, with red-teaming and vulnerability-scanning features. It can run locally, and the vendor also offers custom-priced Enterprise and On-Premise plans. [E1, E2, E3]

### Pros

- The free Community plan includes evaluation features, vulnerability scanning, and up to 10k red-team probes per month.
- The docs cover prompt, model, RAG, and agent evaluation examples.
- The vendor lists local or self-hosted use for Community and an On-Premise option with complete data isolation.

### Cons

- Enterprise and On-Premise prices are custom rather than published as fixed amounts.
- Community red teaming is limited to 10k probes per month.
- The privacy notice says CLI telemetry records command or assertion events unless settings are changed.
- Whether customer data is used for model training is not stated on the pages we checked.

### Pricing

| Plan | Price | Limits |
|---|---|---|
| Community | Free Forever | All LLM evaluation features; all model providers and integrations; red teaming (10k probes/month); custom integration with your own app; run locally or self-host on your own infrastructure; vulnerability scanning; community support. |
| Enterprise | Custom | All Community features; custom red teaming limits; team sharing & collaboration; continuous monitoring; centralized security/compliance dashboard; customizable attack profiles and target settings; SSO and granular permission profiles; Promptfoo API access; managed cloud deployment; professional services support; priority support & SLA guarantees. |
| On-Premise | Custom | All Enterprise features; deployment on your own infrastructure; complete data isolation; dedicated runner; assigned deployment engineer. |

Checked 2026-11-18 · https://www.promptfoo.dev/pricing/

### Sources

- https://www.promptfoo.dev/ (fetched 2026-11-18)
- https://www.promptfoo.dev/pricing/ (fetched 2026-11-18)
- https://www.promptfoo.dev/docs/getting-started/ (fetched 2026-11-18)
- https://www.promptfoo.dev/docs/releases/ (fetched 2026-11-18)
- https://www.promptfoo.dev/privacy/ (fetched 2026-11-18)
- https://www.promptfoo.dev/terms-of-service/ (fetched 2026-11-18)
- https://www.promptfoo.dev/model-security/ (fetched 2026-11-18)

## Top alternatives

1. [Model Context Protocol](https://rankshark.pro/tools/model-context-protocol) — SharkScore 81.7. Open protocol and SDKs that connect AI apps to tools and data.
2. [AI SDK](https://rankshark.pro/tools/ai-sdk) — SharkScore 77.7. TypeScript toolkit for building AI apps and agents.
3. [LangChain](https://rankshark.pro/tools/langchain) — SharkScore 77.7. Build agents and LLM apps in Python and TypeScript.
4. [LangSmith](https://rankshark.pro/tools/langsmith) — SharkScore 76.9. Tracing, evaluation and monitoring for LLM apps.
5. [Transformers](https://rankshark.pro/tools/transformers) — SharkScore 76.9. Hugging Face's library of pretrained models for text, vision and audio.

---
Source: https://rankshark.pro/tools/promptfoo · Method v2026-11-18.2: https://rankshark.pro/how-ranking-works · Payment never changes a rank.
