Monitoring Tools for AI Agents

Track application performance, uptime, and health. Agents can self-diagnose and respond to incidents.

19 tools in this category

AgentOps logo

AgentOpsMCP

Observability · Monitoring

Session replay, monitoring, and evaluation for AI agents

Freetypescript, python
Arize Phoenix logo

Arize PhoenixMCPCLI

Observability · Monitoring

Open-source tracing and evaluation for LLM applications

Freetypescript, python
Baserun logo

Baserun

Observability · Monitoring

Observability, testing, and evaluations for LLM applications

Freetypescript, python
BentoLabs AI logo

BentoLabs AI

Monitoring · Observability

Monitoring and learning for long-running AI agents

Freetypescript, python
Braintrust logo

BraintrustMCPCLI

Observability · Monitoring · Data

Evaluation, tracing, and prompt management for AI products

Freetypescript, python
Confident AI logo

Confident AIMCPCLI

Observability · Monitoring · Data

Evaluation and observability platform for reliable AI agents

Freepython
Credal.ai logo

Credal.aiMCPCLI

Auth · Identity · Monitoring

Security and governance control plane for enterprise agents

Contact salestypescript, python
Golf logo

GolfMCPCLI

Auth · Identity · Monitoring

Security and governance infrastructure for MCP tools

Freetypescript, python
Helicone logo

HeliconeMCP

Observability · Monitoring

Open-source AI gateway and observability platform

Freetypescript, python
Laminar logo

LaminarMCPCLI

Observability · Monitoring

Tracing, evaluations, and debugging for AI agents

Freetypescript, python
Langfuse logo

LangfuseMCPCLI

Monitoring · Observability

Open-source LLM engineering platform: traces, evals, and prompts

Freetypescript, python
Lemma logo

LemmaMCP

Observability · Monitoring

Production tracing and debugging for AI agents

Freetypescript, python
LiteLLM logo

LiteLLMMCPCLI

Deployment · Monitoring

Open-source gateway for calling 100+ LLM APIs

Freepython
Openlayer logo

OpenlayerCLI

Observability · Monitoring

Evaluation, observability, and governance for production AI

Freetypescript, python
Parea logo

Parea

Observability · Monitoring

Evaluation and observability for LLM applications and agents

Freetypescript, python
Portkey logo

PortkeyMCPCLI

Observability · Monitoring

AI Gateway for 1600+ LLMs — observability, guardrails, and governance in one platform

Freetypescript, python
PostHog logo

PostHogMCPCLI

Observability · Monitoring · Data

Product analytics and observability for agent experiences

Freetypescript, python, go, java
Respan logo

Respan

Observability · Monitoring · Deployment

AI gateway, evaluations, and observability for agents

Freetypescript, python
Traceloop logo

Traceloop

Observability · Monitoring

OpenTelemetry observability for LLM and agent applications

Freetypescript, python