Category · Developer & infrastructure

Observability and incident tools for AI agents

Errors, metrics, logs, traces, monitors and on-call data for agents that debug and run production systems.

Best observability and incident tools for AI agents, the shortlist59 head-to-head comparisons

Capability keys observability.errors · observability.metrics · observability.logs · observability.traces · observability.incidents · work.oncall · All tools

letme.dev/observability.errors picks the top-graded tool in this list and says how to call it direct (how letme works).

12listings graded
2agent-ready (BB+)
22desk reviews by the panel
0accept x402
18 Nov 21:29last updated (UTC)
Filters
Grade
Agent rating
Where it runs
Auth
Pricing
Status
12 tools
Compare#ToolCategoryGradeScoreAgent ratingPrice / x402Details
128 Grafana MCP ServerGrafana Labs · MCP server Observability BB 74.8 3.0 (4) Free · OSS
238 Axiom MCP ServerAxiom, Inc. · MCP server Observability BB 72 none $25 / mo
321 incident.io APIPineapple Technology Ltd. (incident.io) · HTTP API Observability B 69.6 3.5 (4) $19 / seat-mo
364 Sentry MCPSentry · MCP server Observability B 68.7 3.5 (2) Your plan
644 New Relic MCP ServerNew Relic, Inc. · MCP server Observability B 62.9 none $0.40 / GB
660 Honeycomb MCPHoneycomb · MCP server Observability B 62.6 none Your plan
709 Cronitor MCP serverCronitor · MCP server Observability C 61.6 none Freemium
903 Better StackBetter Stack, Inc. · MCP server Observability C 56.7 none $34 / seat-mo
973 Rootly MCP ServerRootly Inc. · MCP server Observability C 55.1 2.5 (4) $20 / seat-mo
1077 Datadog MCP ServerDatadog · MCP server Observability D 52.1 2.5 (2) Your plan
1274 PagerDuty MCP ServerPagerDuty · MCP server Observability E 44.6 1.5 (2) Your plan
1369 Causely MCP serverCausely, Inc. · MCP server Observability E 39.4 2.8 (4) $2000 / mo

p95 latency and context cost come from our probes, which haven't run yet, so those columns start hidden. Grades run from AA to F, and agent-ready means BB or better. Filters, sorting and export run in your browser; the table is complete without JavaScript.

Indexed, not reviewed (42)

Listings sorted into this category from public catalogues (the official MCP registry, APIs.guru, the x402 Bazaar and OpenRouter), with facts and our own checks but no score, grade or rank. How the index works.

ListingKindWhat it doesWhy it's here
Aditum
aditumdata.com
MCP serverRead industrial data sources, pipelines, data-health incidents and datasets in Aditum.vendor's own
Agent Domains
clize.ai
MCP serverDomains your AI agent can buy, point and monitor, with four-layer health checks and alerts.vendor's own
arc-security
arcself.com
MCP serverScan AI agent skills for 25 attack classes + runtime monitoring. 1,316+ findings.vendor's own
bellwether-mcp
bellwethermetrics.com
MCP serverLive prediction market data from Polymarket and Kalshi with VWAP pricing and reportability.vendor's own
Betterlytics
betterlytics.io
MCP serverQuery your Betterlytics web analytics from AI agents: traffic, funnels, journeys, errors, uptime.vendor's own
DebugBundle
debugbundle.com
MCP serverDebugBundle MCP: runtime error reporting, incident response, health checks, and product analytics.vendor's own, widely used
Exit1 Uptime Monitoring
exit1.dev
MCP serverSet up uptime monitoring from your editor: create checks, alerts, and query uptime. Can sign you up.vendor's own
Fettle
fettle.sh
MCP serverUptime monitoring — monitors, incidents, heartbeats, maintenance windows, status page incidentsvendor's own, widely used
ffmpeg-micro.com MCP server
ffmpeg-micro.com
MCP serverMCP server for the FFmpeg Micro video transcoding API — create, monitor, download transcodes.vendor's own
Frase SEO
frase.io
MCP serverSEO, GEO & AI Visibility — research, write, optimize, publish & monitor content. 121 tools.vendor's own
GitHits
githits.com
MCP serverSearch public open-source code, documentation, metadata, vulnerabilities, changelogs, and examples.vendor's own, widely used
koru-shield
korushield.com
MCP serverManage Koru Shield DNS filtering: profiles, rules, categories, schedules, and logs.vendor's own
Kyma API
kymaapi.com
MCP serverLive model catalog with prices and measured uptime, rankings, credits and spend, spend-capped chat.vendor's own
leafwright
leafwright.co
MCP serverRender HTML, URLs, and templates to PDF. AI drafts templates and fixes them from logs.vendor's own
LopeBase
lopebase.com
MCP serverSEO, Search Console, analytics, revenue, and uptime for every site you run, from LopeBase.vendor's own
Lumber
infinitetoken.com
MCP serverSearch your Lumber logs and wait for new errors, decrypted on your own computer. Read-only.vendor's own
Minecraft
mairwunnx.com
MCP serverAsk an AI about your Minecraft server and let it run it: players, worlds, configs, logs.vendor's own
NameSniper
namesniper.pro
MCP serverMonitor taken usernames and get alerted when they drop, plus handle, domain, and trademark checks.vendor's own
Nooticr
nooticr.com
MCP serverSocial intelligence for 10 networks: read posts and trends, monitor brand mentions, then create.vendor's own
nyxory
nyxory.com
MCP serverAgent-to-agent cloud service: deploys and runs your apps and services — domains, logs, real status.vendor's own
OneUptime
oneuptime.com
MCP serverManage incidents, alerts, monitors, status pages, on-call and telemetry in OneUptime.vendor's own, widely used
openstatus
openstatus.dev
MCP serverManage monitors, status pages, incidents and maintenances in your openstatus workspace.vendor's own, widely used
Preventionlabs
preventionlabs.com.au
MCP serverSee what's wrong with a live website from the outside, with proof: uptime, DNS, HTTPS, leaked files.vendor's own
probecast.io MCP server
probecast.io
MCP serverYour coding agent adds Probecast uptime monitors and reads incidents for projects you ship.vendor's own
Prometiam Risk Intelligence
prometiam.com
MCP serverCompany data and KYB API for 36 countries: monitoring, financial statements, insolvency, sanctionsvendor's own
RightSide
rightside.host
MCP serverDeploy apps to a live HTTPS URL from Claude Code or Codex: create, deploy, logs, env, rollback.vendor's own
Routebase
routebase.dev
MCP serverDesign, mock, test, document and monitor your APIs from one living OpenAPI spec.vendor's own
seo-mcp
metricspot.com
MCP serverSix tools for SEO and AI-readability audits. 91 checks, 11 score modules.vendor's own
servicegraph
mcp.servicegraph.co
MCP serverDatasets for founders: directories, newsletters, and agencies, with metrics attached.vendor's own
Servonaut
servonaut.dev
MCP serverManage AWS, Hetzner, OVH and SSH servers: status, logs, CloudWatch, IP bans, safe command exec.vendor's own
Superlog
superlog.sh
MCP serverOpen-source agent that observes and fixes your application. Query logs, traces, metrics, incidents.vendor's own, widely used
Synapse RMCP
dinglebear.ai
MCP serverHost, Docker, Compose, SSH, logs, ZFS, and file operations over MCP and CLI.vendor's own
Tengence GEO Agent
tengence.com
MCP serverGEO/SEO content pipeline MCP: plan, write, gate-check, publish, submit, monitor AI visibility.vendor's own
Tengence GEO Agent
tengence.com
MCP serverGEO/SEO content engine: planning, writing, gate checks, WordPress publishing, GEO monitoring.vendor's own
Uptimepage
uptimepage.dev
MCP serverMonitor uptime and incidents, run checks, and publish status updates from your Uptimepage org.vendor's own
Verify SCITT receipts from Forestrie transparency logs, offline
forestrie.dev
MCP serverVerify a SCITT receipt under a trust root you hold — offline, no backend, no key, no networkvendor's own
Verlon AI MCP
verlon.ai
MCP serverInspect and manage Verlon AI gates, logs and models from any MCP client.vendor's own
Visual Sentinel
visualsentinel.com
MCP serverWebsite monitoring for AI assistants: catches pages that look broken even when the site is up.vendor's own
Voris
mcp.voris.ai
MCP serverVoris privacy-native web analytics for AI agents: query metrics & citations, scaffold tracking.vendor's own
windsock
windsock.ai
MCP serverAircraft valuations, registry lookup, cost of ownership, market metrics, reports and logbooks.vendor's own
World Monitor
worldmonitor.app
MCP serverReal-time global intelligence on conflict, markets, energy, trade, shipping and cyber. 100 tools.vendor's own, widely used
x402-list-mcp
x402-list.com
MCP serverFind and vet x402 payment APIs before your agent pays one: uptime, price, on-chain volume.vendor's own

How the ranking works

Every tool is scored 0 to 100 across 9 weighted categories, minus deductions for negative events, and given a grade from AA to F. Reliability, latency and context cost are measured by probes and by traffic through letme. Schema quality, security and payments are assessed against a published checklist. Task success comes from a fixed task suite. Payments, including x402, are one category of the nine. Read the methodology.

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.