Open protocol and SDKs that connect AI apps to tools and data.
Phoenix
Open-source LLM tracing and evaluation.
SharkScore
#60 in Frameworks & SDKs
Why it scores 65.3
Phoenix has a SharkScore of 65.3/100, ranked #60 of 665 in Frameworks & SDKs (updated 2026-11-19).
Each part compares Phoenix with other listings in Frameworks & SDKs. Evidence covers 87% of the score's weight.
- Adoption
- 40 · 30%
- User reviews
- no data · 25%
- Maintenance
- 100 · 20%
- Trust & transparency
- 80 · 15%
- Momentum
- no data · 10%
Paying never changes this score. How ranking works · method v2026-11-18.2
RankShark review of Phoenix
Automated evaluation by RankShark · 18 Nov 2026 · method v1.0 · How we review
We were not paid for this review.
As of 2026-11-18, Phoenix is an open-source tool for tracing and evaluating AI applications that can run locally or be self-hosted. [E1][E3]
Phoenix helps developers inspect AI application traces, evaluate outputs, iterate on prompts, and compare application changes using datasets and experiments. It is open source and can run locally or be self-hosted. [E1][E3]
Best for
Not for
- Teams seeking a managed Phoenix service; the pages describe Phoenix as open source and local-first, and describe Arize AX as the managed platform. · home page, pricing page
Key features
- Tracing. The vendor says Phoenix traces model calls, retrieval, tool use, and custom logic, and accepts traces over OpenTelemetry (OTLP). · docs
- Evaluation. The vendor says users can score traces and spans with LLM-based evaluators, code-based checks, or human labels. · docs
- Prompt iteration. The vendor says users can version prompts, test variants across datasets, and replay calls to compare outputs. · docs
- Datasets and experiments. The vendor says users can group traces into datasets, rerun them through different application versions, and compare evaluation results. · docs
- Deployment. The vendor says Phoenix can run locally and can be deployed with Docker or Kubernetes. · home page
- OpenTelemetry and OpenInference. The vendor says Phoenix is built on OpenTelemetry and powered by OpenInference instrumentation. · docs
Pros
Cons
- The pages reviewed do not state a Phoenix-specific price or describe a managed Phoenix service. · home page, pricing page
- No public prices found on the pages we checked. · pricing page
- No free plan or free trial stated on the pages we checked.
- Free plan
- Not stated (checked 18 Nov 2026)
- Free trial
- Not stated (checked 18 Nov 2026)
- Trains on customer data
- For AI-powered features, Arize says it does not use inputs to train its models unless the user separately consents. The policy does not specify how this applies to Phoenix self-hosted deployments. · privacy page
- Data retention
- Not stated (checked 18 Nov 2026)
- Data regions
- Not stated (checked 18 Nov 2026)
- Data processing agreement
- Not stated (checked 18 Nov 2026)
- AI models used
- Not stated (checked 18 Nov 2026)
- API
- The vendor says Phoenix accepts traces over OTLP and provides an SDK & API reference. · docs
- SDKs
- The vendor says Phoenix provides auto-instrumentation for LlamaIndex, LangChain, DSPy, Mastra, and Vercel AI SDK, and supports Python, TypeScript, and Java. · docs
- Webhooks
- Not stated (checked 18 Nov 2026)
- Platforms
- The vendor describes local, Docker, and Kubernetes deployment options. · home page
- Security claims
- Vendor states SOC 2 Type II. · security pageVendor states PCI DSS compliance. · security pageVendor states ISO/IEC 27001 certification. · security pageVendor states GDPR compliance. · security pageVendor states HIPAA compliance. · security page
What we measured
- GitHub stars · now
- 12,335
- Latest release · now
- arize-phoenix-v21.2.0 on 2026-11-18
- Package downloads · 30 days
- 616,502
How we tested · sources
- Hourly uptime and response-time checks of the product's URL.
- Repository, release and download data from GitHub, npm, PyPI and Hugging Face where they exist.
- We did not sign up, pay, or use the product as a customer.
- home page: https://arize.com/phoenix/ · fetched 18 Nov 2026
- pricing page: https://arize.com/pricing/ · fetched 18 Nov 2026
- docs: https://arize.com/docs/phoenix · fetched 18 Nov 2026
- privacy page: https://arize.com/privacy-policy/ · fetched 18 Nov 2026
- security page: https://arize.com/trust-center/ · fetched 18 Nov 2026
Something wrong? Report an error with a public link that shows it; corrections re-run the review.
Top alternatives to Phoenix
See all- 81.7ToolOpen source
- 77.7
TypeScript toolkit for building AI apps and agents.
ToolOpen source - 77.7
Build agents and LLM apps in Python and TypeScript.
ToolOpen source - 76.9
Tracing, evaluation and monitoring for LLM apps.
ToolFreemium · from $39/mo