Observability and evaluation tools for agents

Trace agent runs, evaluate outcomes, and diagnose failures in production.

Compare providers

44 agent-ready tools mapped to this capability.

AgentHaus logo

AgentHaus

Deployment · Observability

Visual agent builder that exports production-ready TypeScript

Private launchtypescript
AgentOps logo

AgentOpsMCP

Observability · Monitoring

Session replay, monitoring, and evaluation for AI agents

Freetypescript, python
Agentuity logo

AgentuityMCPCLI

Deployment · Hosting · Sandbox · Observability

Full-stack cloud platform built for AI agents

Freetypescript
Arga Labs logo

Arga LabsMCPCLI

Sandbox · Code Execution · Observability

Stateful service twins for testing and training AI agents

Free
Arize Phoenix logo

Arize PhoenixMCPCLI

Observability · Monitoring

Open-source tracing and evaluation for LLM applications

Freetypescript, python
Axiom logo

AxiomCLI

Observability · Monitoring · Data

Cloud-native logs, traces, and event data for agent systems

Freetypescript, python, go
Baserun logo

Baserun

Observability · Monitoring

Observability, testing, and evaluations for LLM applications

Freetypescript, python
BentoLabs AI logo

BentoLabs AI

Monitoring · Observability

Monitoring and learning for long-running AI agents

Freetypescript, python
Braintrust logo

BraintrustMCPCLI

Observability · Monitoring · Data

Evaluation, tracing, and prompt management for AI products

Freetypescript, python
Confident AI logo

Confident AIMCPCLI

Observability · Monitoring · Data

Evaluation and observability platform for reliable AI agents

Freepython
ContextForge logo

ContextForgeMCPCLI

Deployment · Observability · Auth

Open-source MCP, A2A, and API gateway for AI agents

Freepython
Coval logo

CovalMCPCLI

Observability · Monitoring · Audio

Simulation, evaluation, and monitoring for voice and chat agents

$100/month
Credal.ai logo

Credal.aiMCPCLI

Auth · Identity · Monitoring

Security and governance control plane for enterprise agents

Contact salestypescript, python
DAGWorks logo

DAGWorksCLI

Code Execution · Data · Observability

Open-source frameworks for reliable dataflows and agents

Freepython
dari.dev logo

dari.devCLI

Deployment · Observability · Code Execution

Stateful model routing for applications and coding agents

Freetypescript
Galileo logo

Galileo

Observability · Monitoring · Data

AI observability and evaluations for reliable production agents

Freetypescript, python
Golf logo

GolfMCPCLI

Auth · Identity · Monitoring

Security and governance infrastructure for MCP tools

Freetypescript, python
Guardrails AI logo

Guardrails AICLI

Auth · Monitoring · Data

Open-source validation framework for safer, structured LLM applications

Freepython
Hatchet logo

HatchetCLI

Deployment · Code Execution · Observability

Durable task orchestration for agents and background jobs

Freetypescript, python, go, ruby
Helicone logo

HeliconeMCP

Observability · Monitoring

Open-source AI gateway and observability platform

Freetypescript, python
HUD logo

HUDMCPCLI

Sandbox · Code Execution · Observability

RL environments and scalable evaluations for AI agents

Freepython
HumanLayer logo

HumanLayerCLI

Code Execution · Deployment · Observability

Multiplayer IDE and cloud control plane for coding agents

Free
Inngest logo

InngestMCPCLI

Deployment · Code Execution · Observability

Durable workflows and background jobs for AI agents

Freetypescript, python, go
Kestrel AI logo

Kestrel AIMCPCLI

Deployment · Monitoring · Code Execution

Deterministic platform-engineering workflows built and operated by AI agents

$0.10/actionpython
Laminar logo

LaminarMCPCLI

Observability · Monitoring

Tracing, evaluations, and debugging for AI agents

Freetypescript, python
Langfuse logo

LangfuseMCPCLI

Monitoring · Observability

Open-source LLM engineering platform: traces, evals, and prompts

Freetypescript, python
LangSmith logo

LangSmith

Observability · Monitoring

Framework-agnostic tracing, evaluation, and monitoring for agents

Freepython, typescript, go, java
Lemma logo

LemmaMCP

Observability · Monitoring

Production tracing and debugging for AI agents

Freetypescript, python
LiteLLM logo

LiteLLMMCPCLI

Deployment · Monitoring

Open-source gateway for calling 100+ LLM APIs

Freepython
Mastra logo

MastraMCPCLI

Code Execution · Deployment · Observability

TypeScript framework for building and operating AI agents

Freetypescript
Omnara logo

OmnaraCLI

Observability · Communication · Code Execution

Control plane for supervising coding agents from anywhere

Freepython
Openlayer logo

OpenlayerCLI

Observability · Monitoring

Evaluation, observability, and governance for production AI

Freetypescript, python
OpenPipe logo

OpenPipe

Data · Observability · Deployment

Fine-tuning and model optimization for production agents

Freetypescript, python
Parea logo

Parea

Observability · Monitoring

Evaluation and observability for LLM applications and agents

Freetypescript, python
Portkey logo

PortkeyMCPCLI

Observability · Monitoring

AI Gateway for 1600+ LLMs — observability, guardrails, and governance in one platform

Freetypescript, python
PostHog logo

PostHogMCPCLI

Observability · Monitoring · Data

Product analytics and observability for agent experiences

Freetypescript, python, go, java
Promptfoo logo

PromptfooCLI

Observability · Monitoring · Auth

Open-source evaluations and red teaming for LLM applications and agents

Freetypescript
Respan logo

Respan

Observability · Monitoring · Deployment

AI gateway, evaluations, and observability for agents

Freetypescript, python
Runloop logo

Runloop

Sandbox · Code Execution · Observability

Persistent development sandboxes and benchmarks for coding agents

Freetypescript, python
Sentry logo

SentryMCPCLI

Monitoring · Observability

Full-stack error, performance, and AI agent monitoring

Freejavascript, python, go, java, ruby
Superagent logo

Superagent

Auth · Monitoring · Observability

Security scans, guardrails, and red teaming for AI-native software

Free
TensorZero logo

TensorZeroCLI

Observability · Monitoring · Data

Open-source gateway, observability, and optimization stack for LLM applications

Freepython
Traceloop logo

Traceloop

Observability · Monitoring

OpenTelemetry observability for LLM and agent applications

Freetypescript, python
Trigger.dev logo

Trigger.devMCPCLI

Deployment · Code Execution · Observability

Durable background jobs and workflows for production AI agents

Freetypescript