{
  "data": null,
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/niches/agent-observability.cost-per-run/",
    "json": "https://www.anchorterminal.com/niches/agent-observability.cost-per-run/index.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/niches/agent-observability.cost-per-run/index.md",
    "mcp": "https://www.anchorterminal.com/mcp",
    "slim": "https://www.anchorterminal.com/niches/agent-observability.cost-per-run/index.min.md"
  },
  "markdown": "No company's docs show a full fit yet. The listings below do the job with a limit, or not at all.\n\n| Companies, full fit | With a limit | Carry the tag | Share of the category's work | First-hand accounts |\n| --- | --- | --- | --- | --- |\n| 0 | 18 | 25 | 9 | 10 |\n\n## What counts as done\n\nA cost per trace and per span, including cached tokens and models released in the last 30 days, and a per-step ranking for one run without reading the tree by hand.\n\nMeasured, for our own tests: the cost matches the provider's bill within 5 per cent.\n\nHow agents ask for it: how much did this run cost; which step burned the tokens; why is the cost double what the provider billed; cost per conversation turn\n\n## Does the job, with a limit\n\nIt does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.\n\n- **Agent Tree (No legal entity found. The LICENSE, plugin.json and marketplace.json name \"Mike Pollow, Digitalroots\")**: The pane shows the main session's model, effort, context and cost and each sub-agent's context and usage live, but nothing is ranked by step or kept afterwards.\n- **agents-tree (No legal entity found. The LICENSE and pyproject.toml name Karel Blavka)**: The detail view and --json give request and token counts per agent and context tokens, with no cost figure and no persistence.\n- **Arize Phoenix (Arize AI, Inc.)**: Cost is derived from OpenInference token counts, including cache_read and cache_write, and rolled up to trace and project. Provider or gateway cost attributes are dropped (issue 15240) and per-step cost is per span, not ranked (HN 49093357).\n- **BotGauge (BotGauge AI Inc. (Delaware, United States))**: Logs show cost per session and trace and troubleshooting covers zero-cost traces, but cached tokens and gateway cost are not mentioned.\n- **Braintrust API + MCP (Braintrust Data, Inc.)**: Cost comes from token counts and model pricing, cache_read and cache_creation tokens are mapped, and a span's own metrics.estimated_cost overrides it. Preset charts add up duplicated token metrics, so a copied call shows twice; per-step ranking needs sql_query.\n- **Helicone AI Gateway + MCP (Helicone, Inc.)**: Gateway requests are priced from the Model Registry, direct integrations from a best-effort table; sessions roll cost up per interaction and HQL exposes provider_total_cost. Context-tier pricing was not applied for OpenAI, Azure or OpenRouter (issue 5690).\n- **HoneyHive (HoneyHive Inc.)**: Sessions sum metadata.cost and tokens from child events, but the aggregation page says cost is a value you set on child events; cached tokens are not mentioned.\n- **Laminar API + MCP (LMNR AI, Inc.)**: Every LLM span carries input, output, cache read, cache write and reasoning costs with long-context and service-tier rates, rolled up to trace columns you can rank in SQL; custom model costs exist. A user had to ask for OpenRouter usage to be read (issue 706).\n- **Langfuse API + MCP (Langfuse GmbH (a ClickHouse, Inc. company))**: usage_details buckets cache reads and writes separately and OpenRouter or LiteLLM cost is captured, but a gateway that appends a cost field breaks the mapping, cache tokens were double counted (issue 12306) and root rows showed $0.00 (issue 16077).\n- **LangSmith API + MCP (LangChain, Inc.)**: Automatic cost from tokens for OpenAI, Anthropic and LangChain calls with cache-read subtypes, custom costs for other runs, totals per trace and per parent run in the tree; the gateway records its own cost. Thread totals need metadata on every child run.\n- **LangWatch (Reasoning Engine B.V. (doing business as LangWatch))**: Cost tracking per model call down to the token is advertised and OTel ingestion applies cost enrichment, but the cost tutorial itself was not read, so cache tokens and per-step ranking are unverified.\n- **MLflow Tracing (MLflow Project, a Series of LF Projects, LLC)**: Token usage and cost are logged per span and aggregated in the experiment dashboard, as the Claude Code page shows. The cost tracking page itself answered 403, so cache-token handling and gateway-reported cost could not be read.\n- **Navige (Navige Ltd)**: Each call is priced from the provider's usage with cached input counted separately, OpenRouter's reported cost is used as is, unknown prices show unknown not zero, and transactions give cost per task with a percentile estimate. No per-step ranking inside a run and no prompt content.\n- **Opik API + MCP (Comet ML, Inc.)**: Span and trace cost in USD, aggregated from spans and readable as total_estimated_cost, with provider and model settable by hand. Unsupported models return None, and cache tokens are not mentioned on the page.\n- **Overmind (Overmind Technology Ltd (England and Wales, company 16585996))**: Usage is normalised from GenAI attributes and cost budgets are stock evaluation checks, but no trace-level cost field, cache-token handling or price table appears in the pages read.\n- **Pydantic Logfire (Pydantic Services Inc.)**: Tokens and cost by model, provider and agent in the LLMs view and per-trace in the panel; SQL can rank spans by cost. Cache-token handling and gateway-reported cost were not in the pages read.\n- **Respan API + MCP (Keywords AI Inc. (d/b/a Respan))**: Every gateway call writes a log with tokens and cost retrievable by X-Respan-Log-Id, the Claude Code plugin records cache tokens, and SQL ranks cost per model. Cache pricing for SDK traces and per-step ranking within one trace were not shown.\n- **W\u0026B Weave (Weights and Biases, LLC)**: Automatic cost for supported integrations from token usage and built-in pricing, custom costs for others, available in the trace tree and via include_costs. TypeScript has no cost tracking and cached tokens are not mentioned.\n\n## Couldn't check\n\nThe docs were closed to us, or silent. These carry no mark either way.\n\n- **Galileo API + MCP (Galileo Technologies, Inc.)**: Model pricing settings and integration costs pages are listed in the docs index but were not opened.\n\n- not this job: DeepEval (Confident AI, Inc.): No cost or token accounting for traced runs.\n- not this job: Gauge CLI (Gauge): Runs are billed in Gauge credits; no token or model cost per session is reported.\n- not this job: Prefactor (Prefactor Pty Ltd): No token or model cost fields in the documentation; cost does not appear outside billing.\n\n## What stops agents finishing\n\n- new model missing from the price table\n- cost only derived from tokens so gateway prices are ignored\n- cached tokens double counted\n- per-step cost only as a dashboard aggregate\n\n## Around it\n\nBefore: agent-observability.instrument-app, inference.cached-long-session. After: agent-observability.offline-eval-regression.\n\n## Where this comes from\n\nWeight 9 of 100 in Agent observability \u0026 evals: 10 of 86 accounts: the sub-agent cost CLI thread, Langfuse issues on cache double counting and $0 root rows, Phoenix issues on gateway-reported cost, Helicone tier pricing, Laminar OpenRouter usage, Opik judge token usage\n\nAs data: https://www.anchorterminal.com/api/v1/use-cases/agent-observability.cost-per-run.json, or the MCP tool get_use_case with id agent-observability.cost-per-run. Draft, read 2026-11-12 from public docs and first-hand accounts, not yet reviewed by a person.\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "attributionRequired": true,
    "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-11-16",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "0.8",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run",
    "terms": "https://www.anchorterminal.com/terms/#data"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "For agents",
        "url": "https://www.anchorterminal.com/agents/"
      },
      {
        "name": "Niches",
        "url": "https://www.anchorterminal.com/niches/"
      },
      {
        "name": "Know what a run, step or feature cost",
        "url": ""
      }
    ],
    "description": "Know what a run, step or feature cost: 0 companies fully do it, 18 with a limit, 25 carry the tag. Every listing in Agent observability \u0026 evals with the reason and a source.",
    "facts": null,
    "h1": "Know what a run, step or feature cost",
    "image": "https://www.anchorterminal.com/assets/og/default.png",
    "path": "/niches/agent-observability.cost-per-run/",
    "published": "",
    "section": "agents",
    "title": "Know what a run, step or feature cost: who does it | Anchor Terminal",
    "toc": null,
    "updated": "2026-11-15",
    "url": "https://www.anchorterminal.com/niches/agent-observability.cost-per-run/"
  },
  "tokens": {
    "markdown": 2000,
    "slim": 480
  },
  "version": 1
}
