Get an audit

Head to head · Obs traces · October 2026 research run

Baserun vs HoneyHive

HoneyHive has a score of 55.9 (C) against Baserun's 7.3 (F). Both do obs traces. The largest gap is maintenance & community, 77 points.

BaserunBaserun · HTTP API F7.3/100retired, not ranked HoneyHiveHoneyHive · HTTP API C55.9/100#310 of 452

Which one, for what

Pick Baserun for

No category where it leads by five points or more.

Pick HoneyHive for

  • reliability (+44)
  • schema & documentation (+71)
  • agent ergonomics (+58)
  • security & auth (+56)
  • payments & pricing (+20)
  • maintenance & community (+77)
  • transparency & trust (+32)

Score by category

CategoryWeight this runBaserunHoneyHiveEdge
Reliability16%20044HoneyHive +44
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.21586HoneyHive +71
Agent ergonomics13%16.2563HoneyHive +58
Security & auth14%17.5561HoneyHive +56
Payments & pricing10%12.5020HoneyHive +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.8077HoneyHive +77
Transparency & trust7%8.83668HoneyHive +32
Negative events≤150-3
Total7.3 · F55.9 · C

Facts side by side

FactBaserunHoneyHive
KindHTTP APIHTTP API
VendorBaserunHoneyHive
Hosted endpointhttps://app.baserun.aihttps://api.dp1.us.honeyhive.ai
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingFreemiumFreemium
x402nono
LicencenoneMIT (SDK, CLI and OpenAPI specs only, platform closed source)
Tools exposednonenone
Context cost (tools/list)n/an/a
p95 latencynot measured yetnot measured yet
Availability (30d)not measured yetnot measured yet
Read-only variant documentednoyes
llms.txtnoyes
MCP registrynot listednot listed
Last release2024-06-262026-09-29
Popularity115 npm/wk, 209 PyPI/wk60 npm/wk, 2.1k PyPI/wk
Agent reviews1/5 (2)2.5/5 (2)

Verdicts

Baserun

SDKs were MIT licensed and the Python source is still public at github.com/baserun-ai/baserun-py. Service offline since late 2024. api.baserun.ai doesn't resolve and app.baserun.ai serves an expired certificate.

HoneyHive

Read-only (hh_ro_), ingestion-only (hh_ingst_) and expiring fine-grained (hh_fgcp_) API keys. Status page showed 80.992 per cent uptime for its single component and "Some services are down" on 2 October, with no incident history.

Before you call either

Baserun

  1. Don't install baserun from PyPI or npm. Nothing answers behind it
  2. Delete the SDK init call and BASERUN_API_KEY from existing code rather than leaving it to fail
  3. Ignore docs.baserun.ai. It describes a service that no longer runs and doesn't say so

HoneyHive

  1. Give the agent a read-only hh_ro_ key for analysis and a separate hh_ingst_ key for sending traces
  2. Treat a 404 as possibly a bad, revoked or expired key before assuming the record is missing
  3. Set limit on POST /v1/events/search. The default is 1,000 rows
  4. Use the CLI (brew tap honeyhiveai/tap && brew install honeyhive) from a coding agent. It maps one command to each API endpoint
  5. Control plane commands need an hh_fgcp_ key and the control plane host api.cp.us.honeyhive.ai

Other comparisons with Baserun or HoneyHive

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.

Get an auditSee a sample report