Observability / Tracing
Run traces, prompt logging, cost tracking.
Helicone
LLM observability and cost tracking via proxy or async logging.
used in
13
hybrid
freemium
Langfuse
Open-source LLM observability, eval, prompt mgmt.
used in
4
open source
freemium
AgentOps
Python SDK and hosted platform for monitoring, debugging, and cost-tracking AI agents.
used in
0
hybrid
freemium
Arize Phoenix
Open-source LLM tracing and evaluation platform from Arize AI, built on OpenTelemetry.
used in
0
hybrid
freemium
Galileo
LLM and agent evaluation and observability platform for testing, monitoring, and guardrailing GenAI apps.
used in
0
commercial
freemium
Langtrace
Open-source, OpenTelemetry-based end-to-end observability tool for LLM applications.
used in
0
open source
freemium
LangWatch
Open-source LLM observability, evaluation, and AI agent testing platform.
used in
0
hybrid
freemium
Traceloop
OpenLLMetry — OpenTelemetry-based LLM tracing.
used in
0
open source
freemium
Weights & Biases Weave
LLM tracing and evaluation toolkit from Weights & Biases for developing generative AI applications.
used in
0
hybrid
freemium