Skip to content
RankShark

Phoenix

Open-source LLM tracing and evaluation.

ToolOpen sourceby Arize AIsince 2023
65.3

SharkScore

#60 in Frameworks & SDKs

Why it scores 65.3

Phoenix has a SharkScore of 65.3/100, ranked #60 of 665 in Frameworks & SDKs (updated 2026-11-19).

Each part compares Phoenix with other listings in Frameworks & SDKs. Evidence covers 87% of the score's weight.

Adoption
40 · 30%
User reviews
no data · 25%
Maintenance
100 · 20%
Trust & transparency
80 · 15%
Momentum
no data · 10%

Paying never changes this score. How ranking works · method v2026-11-18.2

RankShark review of Phoenix

Automated evaluation by RankShark · 18 Nov 2026 · method v1.0 · How we review

We were not paid for this review.

As of 2026-11-18, Phoenix is an open-source tool for tracing and evaluating AI applications that can run locally or be self-hosted. [E1][E3]

Phoenix helps developers inspect AI application traces, evaluate outputs, iterate on prompts, and compare application changes using datasets and experiments. It is open source and can run locally or be self-hosted. [E1][E3]

Best for

  • Developers who need to inspect traces across model calls, retrieval, and tool use. · docs
  • Teams that want to evaluate AI outputs and compare changes using datasets and experiments. · docs
  • Teams that want a local or self-hosted deployment. · home page

Not for

  • Teams seeking a managed Phoenix service; the pages describe Phoenix as open source and local-first, and describe Arize AX as the managed platform. · home page, pricing page

Key features

  • Tracing. The vendor says Phoenix traces model calls, retrieval, tool use, and custom logic, and accepts traces over OpenTelemetry (OTLP). · docs
  • Evaluation. The vendor says users can score traces and spans with LLM-based evaluators, code-based checks, or human labels. · docs
  • Prompt iteration. The vendor says users can version prompts, test variants across datasets, and replay calls to compare outputs. · docs
  • Datasets and experiments. The vendor says users can group traces into datasets, rerun them through different application versions, and compare evaluation results. · docs
  • Deployment. The vendor says Phoenix can run locally and can be deployed with Docker or Kubernetes. · home page
  • OpenTelemetry and OpenInference. The vendor says Phoenix is built on OpenTelemetry and powered by OpenInference instrumentation. · docs

Pros

  • Supports tracing, evaluations, prompt iteration, and experiments in one workflow. · docs
  • Offers local and self-hosted deployment options. · home page
  • The vendor describes Phoenix as built on OpenTelemetry and as working with any model, framework, or language. · home page, docs

Cons

  • The pages reviewed do not state a Phoenix-specific price or describe a managed Phoenix service. · home page, pricing page
  • No public prices found on the pages we checked. · pricing page
  • No free plan or free trial stated on the pages we checked.

Pricing

No public prices found on the pages we checked.

Checked 18 Nov 2026 · source

Free plan
Not stated (checked 18 Nov 2026)
Free trial
Not stated (checked 18 Nov 2026)
Trains on customer data
For AI-powered features, Arize says it does not use inputs to train its models unless the user separately consents. The policy does not specify how this applies to Phoenix self-hosted deployments. · privacy page
Data retention
Not stated (checked 18 Nov 2026)
Data regions
Not stated (checked 18 Nov 2026)
Data processing agreement
Not stated (checked 18 Nov 2026)
AI models used
Not stated (checked 18 Nov 2026)
API
The vendor says Phoenix accepts traces over OTLP and provides an SDK & API reference. · docs
SDKs
The vendor says Phoenix provides auto-instrumentation for LlamaIndex, LangChain, DSPy, Mastra, and Vercel AI SDK, and supports Python, TypeScript, and Java. · docs
Webhooks
Not stated (checked 18 Nov 2026)
Platforms
The vendor describes local, Docker, and Kubernetes deployment options. · home page
Security claims
Vendor states SOC 2 Type II. · security pageVendor states PCI DSS compliance. · security pageVendor states ISO/IEC 27001 certification. · security pageVendor states GDPR compliance. · security pageVendor states HIPAA compliance. · security page

What we measured

GitHub stars · now
12,335
Latest release · now
arize-phoenix-v21.2.0 on 2026-11-18
Package downloads · 30 days
616,502
How we tested · sources
  • Hourly uptime and response-time checks of the product's URL.
  • Repository, release and download data from GitHub, npm, PyPI and Hugging Face where they exist.
  • We did not sign up, pay, or use the product as a customer.

Something wrong? Report an error with a public link that shows it; corrections re-run the review.

Top alternatives to Phoenix

See all
  • 81.7

    Open protocol and SDKs that connect AI apps to tools and data.

    ToolOpen source
  • 77.7

    TypeScript toolkit for building AI apps and agents.

    ToolOpen source
  • 77.7

    Build agents and LLM apps in Python and TypeScript.

    ToolOpen source
  • 76.9

    Tracing, evaluation and monitoring for LLM apps.

    ToolFreemium · from $39/mo