Arize Phoenix
used in
0
stacks
Open-source LLM tracing and evaluation platform from Arize AI, built on OpenTelemetry.
Provides OpenTelemetry-based tracing, LLM-as-judge evaluations, versioned datasets and experiments, and a prompt playground. Vendor and language agnostic, with instrumentation for frameworks such as LangChain, LlamaIndex, and CrewAI. Runs locally, in Docker or Kubernetes, or via the hosted Phoenix Cloud at app.phoenix.arize.com.
Strengths
- OpenTelemetry-based instrumentation works across frameworks and providers
- Built-in evals, datasets, and experiments alongside tracing
- Self-hostable via pip, Docker, or Helm in addition to hosted cloud
- Prompt playground for replaying and comparing traced LLM calls
Tradeoffs
- Elastic License 2.0 (ELv2) restricts offering Phoenix itself as a managed service
- Self-hosting means operating and scaling the collector and storage yourself
- Advanced enterprise monitoring features live in the separate commercial Arize platform