# Ragas

> Evaluation toolkit for RAG and LLM applications.

Ragas has a SharkScore of 66.1/100, ranked #51 of 665 in Frameworks & SDKs (updated 2026-11-19).

- Website: https://github.com/vibrantlabsai/ragas (github.com)
- Kind: Tool · Pricing: Open source
- Maker: Ragas
- Repository: https://github.com/vibrantlabsai/ragas
- Categories: Frameworks & SDKs
- Verified by the maker: no

## Why it scores 66.1

| Part | Score (0–100) | Weight |
|---|---|---|
| Adoption | 42 | 30% |
| User reviews | no data | 25% |
| Maintenance | 100 | 20% |
| Trust & transparency | 80 | 15% |
| Momentum | no data | 10% |

Evidence covers 87% of the score's weight. Compared with other listings in Frameworks & SDKs.

## Evidence

| Signal | Value |
|---|---|
| Traffic rank (Tranco) | — |
| GitHub stars | 16.4K |
| Stars, last 90 days | — |
| Downloads, 30 days | 1.3M |
| Reviews | none yet |
| Last update | 4 days ago |
| Uptime, 30 days | 100.0% |
| Public pricing / Free tier / API / MCP | yes / yes / yes / no |

## RankShark review

Automated evaluation by RankShark · 2026-11-18 · method review-1.0 · https://rankshark.pro/how-we-review
We were not paid for this review.

As of 2026-11-18, Ragas is an open-source Python toolkit for evaluating LLM applications; its latest measured release is v0.4.4, dated 2026-11-14. [E1, E4, MEASURED]

Ragas is a Python toolkit for evaluating and improving LLM applications. The vendor describes metrics for evaluation, test-data generation, and feedback loops using production data. [E1]

### Pros

- The repository identifies an Apache-2.0 license. [E1]
- The vendor describes both evaluation metrics and test-data generation, covering evaluation workflows with and without an existing dataset. [E1]

### Cons

- The latest release lists a known issue: with version 2.x of the Anthropic package, setting temperature or top_p on an Anthropic model raises an SDK error. [E4]
- The vendor says it collects minimal, anonymized usage data; opting out requires setting RAGAS_DO_NOT_TRACK to true. [E1]
- No public prices found on the pages we checked.
- No free plan or free trial stated on the pages we checked.
- Whether customer data is used for model training is not stated on the pages we checked.

### Pricing

No public prices found on the pages we checked (2026-11-18).

### Sources

- https://github.com/vibrantlabsai/ragas (fetched 2026-11-18)
- https://github.com/pricing (fetched 2026-11-18)
- https://docs.github.com/en (fetched 2026-11-18)
- https://github.com/vibrantlabsai/ragas/releases (fetched 2026-11-18)
- https://docs.github.com/en/site-policy/privacy-policies/github-general-privacy-statement (fetched 2026-11-18)
- https://docs.github.com/en/site-policy/github-terms/github-terms-of-service (fetched 2026-11-18)
- https://github.com/security/advanced-security/code-security (fetched 2026-11-18)

## Top alternatives

1. [Model Context Protocol](https://rankshark.pro/tools/model-context-protocol) — SharkScore 81.7. Open protocol and SDKs that connect AI apps to tools and data.
2. [AI SDK](https://rankshark.pro/tools/ai-sdk) — SharkScore 77.7. TypeScript toolkit for building AI apps and agents.
3. [LangChain](https://rankshark.pro/tools/langchain) — SharkScore 77.7. Build agents and LLM apps in Python and TypeScript.
4. [LangSmith](https://rankshark.pro/tools/langsmith) — SharkScore 76.9. Tracing, evaluation and monitoring for LLM apps.
5. [Transformers](https://rankshark.pro/tools/transformers) — SharkScore 76.9. Hugging Face's library of pretrained models for text, vision and audio.

---
Source: https://rankshark.pro/tools/ragas · Method v2026-11-18.2: https://rankshark.pro/how-ranking-works · Payment never changes a rank.
