Eval
Test harness, golden sets, regression detection.
Braintrust
Eval and observability platform purpose-built for LLM applications.
used in
9
commercial
freemium
promptfoo
Open-source CLI for prompt and LLM eval, including red-teaming.
used in
3
open source
free
LangSmith
Eval, tracing, and prompt management from the LangChain team.
used in
2
commercial
freemium
DeepEval
Open-source LLM evaluation framework with pytest-style testing and 50+ research-backed metrics, maintained by Confident AI.
used in
0
hybrid
freemium
Maxim AI
End-to-end platform for simulation, evaluation, and observability of AI agents and applications.
used in
0
commercial
subscription
Patronus AI
Automated LLM evaluation and guardrails platform with proprietary evaluation models.
used in
0
commercial
usage
Ragas
Open-source Python framework for evaluating RAG pipelines with model-based, largely reference-free metrics.
used in
0
open source
free