# LiteLLM

> Proxy and SDK to call 100+ LLM APIs in the OpenAI format.

LiteLLM has a SharkScore of 76.1/100, ranked #3 of 262 in Model APIs & inference (updated 2026-11-19).

- Website: https://www.litellm.ai (litellm.ai)
- Kind: Tool · Pricing: Open source
- Maker: BerriAI
- Repository: https://github.com/BerriAI/litellm
- Categories: Model APIs & inference, Frameworks & SDKs
- Verified by the maker: no

## Why it scores 76.1

| Part | Score (0–100) | Weight |
|---|---|---|
| Adoption | 67 | 30% |
| User reviews | no data | 25% |
| Maintenance | 100 | 20% |
| Trust & transparency | 80 | 15% |
| Momentum | no data | 10% |

Evidence covers 87% of the score's weight. Compared with other listings in Model APIs & inference.

## Evidence

| Signal | Value |
|---|---|
| Traffic rank (Tranco) | #66K |
| GitHub stars | 63.5K |
| Stars, last 90 days | — |
| Downloads, 30 days | 99.8M |
| Reviews | none yet |
| Last update | 0 days ago |
| Uptime, 30 days | 100.0% |
| Public pricing / Free tier / API / MCP | yes / yes / yes / yes |

## RankShark review

Automated evaluation by RankShark · 2026-11-18 · method review-1.0 · https://rankshark.pro/how-we-review
We were not paid for this review.

As of 2026-11-18, LiteLLM is an open-source, self-hosted gateway and Python SDK for routing requests across LLM providers; RankShark measured release v1.110.0 that day. [E1; MEASURED: latest release v1.110.0 on 2026-11-18]

LiteLLM provides an AI gateway and Python SDK for routing model requests through a common interface. Its pages describe spend tracking, access controls, guardrails, and self-hosted deployment. [E1]

### Pros

- The gateway offers a common interface for multiple providers, and the docs say OpenAI SDKs can call it by pointing the SDK at the gateway.
- The vendor lists controls for budgets, rate limits, model access, guardrails, and request logging.
- The vendor documents self-hosting and deployment options including Docker, Helm, and Terraform.

### Cons

- The docs say virtual keys and budget enforcement require a database; without one, budget limits are not enforced.
- No public prices found on the pages we checked.
- No free plan or free trial stated on the pages we checked.
- Whether customer data is used for model training is not stated on the pages we checked.

### Pricing

No public prices found on the pages we checked (2026-11-18).

### Sources

- https://www.litellm.ai/ (fetched 2026-11-18)
- https://models.litellm.ai/ (fetched 2026-11-18)
- https://docs.litellm.ai/docs/proxy/docker_quick_start (fetched 2026-11-18)
- https://docs.litellm.ai/release_notes (fetched 2026-11-18)
- https://www.litellm.ai/security (fetched 2026-11-18)

## Top alternatives

1. [Hugging Face](https://rankshark.pro/tools/hugging-face) — SharkScore 79.3. The home of open models, datasets and Spaces.
2. [Claude Platform](https://rankshark.pro/tools/anthropic-api) — SharkScore 77.5. API for building with Claude models.
3. [Vertex AI](https://rankshark.pro/tools/vertex-ai) — SharkScore 75.7. Google Cloud's platform to build with Gemini and other models.
4. [OpenAI API](https://rankshark.pro/tools/openai-api) — SharkScore 75.3. API for GPT, image, audio and embedding models.
5. [Modal](https://rankshark.pro/tools/modal) — SharkScore 74.1. Serverless GPUs for running AI code and models.

---
Source: https://rankshark.pro/tools/litellm · Method v2026-11-18.2: https://rankshark.pro/how-ranking-works · Payment never changes a rank.
