{
  "data": null,
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/niches/agent-observability.self-host-retain/",
    "json": "https://www.anchorterminal.com/niches/agent-observability.self-host-retain/index.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/niches/agent-observability.self-host-retain/index.md",
    "mcp": "https://www.anchorterminal.com/mcp",
    "slim": "https://www.anchorterminal.com/niches/agent-observability.self-host-retain/index.min.md"
  },
  "markdown": "No company's docs show a full fit yet. The listings below do the job with a limit, or not at all.\n\n| Companies, full fit | With a limit | Carry the tag | Share of the category's work | First-hand accounts |\n| --- | --- | --- | --- | --- |\n| 0 | 8 | 22 | 10 | 11 |\n\n## What counts as done\n\nThe stack runs from the documented compose or Helm files, with disk growth and retention controls documented.\n\nMeasured, for our own tests: it ingests at the team's volume, and after 30 days the UI still loads a trace list in under 5 seconds.\n\nHow agents ask for it: self-host it with docker compose; keep traces in our region; disk is full after three months; upgrade broke the UI\n\n## Does the job, with a limit\n\nIt does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.\n\n- **Arize Phoenix (Arize AI, Inc.)**: Docker, Compose and Helm with SQLite or Postgres; PHOENIX_DEFAULT_RETENTION_POLICY_DAYS and per-project retention policies since 9.0, infinite by default. Before that a user hit 44 GB and an unusable UI (issue 8420).\n- **Helicone AI Gateway + MCP (Helicone, Inc.)**: An all-in-one Docker image and Kubernetes guide exist, with S3, Better Auth and the ClickHouse and Postgres stack from the listing. No retention or disk-growth setting appears on the Docker page.\n- **Laminar API + MCP (LMNR AI, Inc.)**: Compose runs frontend, app server, Postgres, ClickHouse and Quickwit; Helm adds RabbitMQ, Redis and a consumer. Signals and alerts need a licence key, no retention setting is documented, and ClickHouse system logs grew without bound on a small instance (issue 2176).\n- **Langfuse API + MCP (Langfuse GmbH (a ClickHouse, Inc. company))**: Compose and Helm with Postgres, ClickHouse, Redis and S3; retention is per project with nightly deletes and data is kept indefinitely by default. One user grew a terabyte ClickHouse on a laptop and another lost the UI after an image upgrade (issue 12172).\n- **LangWatch (Reasoning Engine B.V. (doing business as LangWatch))**: Apache 2.0 self-hosting with Docker or Helm is claimed and retention is configurable per organisation, team or project on paid and self-hosted plans, with 49 days on Free. The component list and disk guidance were not in the pages read.\n- **MLflow Tracing (MLflow Project, a Series of LF Projects, LLC)**: SQLite by default, a Compose bundle with Postgres and RustFS, and a Helm chart; trace archival moves old span payloads to artifact storage under a retention policy. Authentication is off unless basic-auth is enabled. An HN user calls it well established.\n- **Opik API + MCP (Comet ML, Inc.)**: Local Compose or Kubernetes with ClickHouse, Zookeeper, MySQL, Redis and MinIO; a tiered-storage TTL moves trace data to cold S3 after a set number of weeks. The open-source build has no authentication.\n- **Overmind (Overmind Technology Ltd (England and Wales, company 16585996))**: Compose with six Celery worker profiles under AGPL, but startup validation requires Modal, OpenRouter, AWS checkpoint and sandbox credentials even to run; no retention or disk guidance.\n\n- not this job: Agent Tree (No legal entity found. The LICENSE, plugin.json and marketplace.json name \"Mike Pollow, Digitalroots\"): Nothing to host.\n- not this job: agents-tree (No legal entity found. The LICENSE and pyproject.toml name Karel Blavka): Nothing to host.\n- not this job: BotGauge (BotGauge AI Inc. (Delaware, United States)): Hosted only; no self-hosting pages.\n- not this job: Braintrust API + MCP (Braintrust Data, Inc.): Only SaaS or BYOC, and BYOC needs the Enterprise plan with Braintrust operating the data plane; there is no documented Compose or Helm stack to run yourself.\n- not this job: DeepEval (Confident AI, Inc.): Nothing to host; runs are written to local JSON or SQLite stores.\n- not this job: Galileo API + MCP (Galileo Technologies, Inc.): On-prem and VPC deployment are Enterprise only per the pricing notes; no Compose or Helm files are documented.\n- not this job: Gauge CLI (Gauge): Local mode runs in Docker with results in .gauge/gauge.sqlite; there is no trace store to host.\n- not this job: HoneyHive (HoneyHive Inc.): Self-hosting is BYOC or BYOVPC on AWS, deployed by HoneyHive with Terraform and Helm for Enterprise; there is no stack to run from documented files.\n- not this job: LangSmith API + MCP (LangChain, Inc.): Self-hosted LangSmith is an Enterprise add-on with a licence key; the ClickHouse or SmithDB, Postgres, Redis and blob stack is documented but not available to run otherwise. One builder made a local tool because LangSmith needs a cloud account.\n- not this job: Navige (Navige Ltd): Hosted only.\n- not this job: Prefactor (Prefactor Pty Ltd): Hosted only.\n- not this job: Pydantic Logfire (Pydantic Services Inc.): Self-hosted Logfire is an Enterprise deployment; the Personal, Team and Growth plans are cloud only.\n- not this job: Respan API + MCP (Keywords AI Inc. (d/b/a Respan)): The trace platform is hosted only; the open-source gateway is a proxy with a request log, not a trace store.\n- not this job: W\u0026B Weave (Weights and Biases, LLC): Multi-tenant or Dedicated Cloud only on the plans read; the trace server left the public repository in October 2026.\n\n## What stops agents finishing\n\n- self-hosting is Enterprise only\n- ClickHouse or S3 growth with no retention setting\n- upgrade path breaks the trace tables\n- auth off by default on the self-hosted build\n- cloud account required to see one's own traces\n\n## Around it\n\nBefore: agent-observability.instrument-app. After: agent-observability.debug-failed-run.\n\n## Where this comes from\n\nWeight 10 of 100 in Agent observability \u0026 evals: 11 of 86 accounts: Langfuse self-hosters (ClickHouse stack, terabyte disk, upgrade breakage), Phoenix at 44 GB, Laminar ClickHouse logs, MLflow as the established self-hosted option, the Ask HN comparison thread, LangSmith lock-in and cloud-account complaints that led to a local-first alternative\n\nAs data: https://www.anchorterminal.com/api/v1/use-cases/agent-observability.self-host-retain.json, or the MCP tool get_use_case with id agent-observability.self-host-retain. Draft, read 2026-11-12 from public docs and first-hand accounts, not yet reviewed by a person.\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "attributionRequired": true,
    "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-11-16",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "0.8",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run",
    "terms": "https://www.anchorterminal.com/terms/#data"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "For agents",
        "url": "https://www.anchorterminal.com/agents/"
      },
      {
        "name": "Niches",
        "url": "https://www.anchorterminal.com/niches/"
      },
      {
        "name": "Run the trace store yourself and keep it healthy",
        "url": ""
      }
    ],
    "description": "Run the trace store yourself and keep it healthy: 0 companies fully do it, 8 with a limit, 22 carry the tag. Every listing in Agent observability \u0026 evals with the reason and a source.",
    "facts": null,
    "h1": "Run the trace store yourself and keep it healthy",
    "image": "https://www.anchorterminal.com/assets/og/default.png",
    "path": "/niches/agent-observability.self-host-retain/",
    "published": "",
    "section": "agents",
    "title": "Run the trace store yourself and keep it healthy | Anchor Terminal",
    "toc": null,
    "updated": "2026-11-15",
    "url": "https://www.anchorterminal.com/niches/agent-observability.self-host-retain/"
  },
  "tokens": {
    "markdown": 1750,
    "slim": 330
  },
  "version": 1
}
