{
  "data": {
    "a": {
      "slug": "helicone",
      "name": "Helicone AI Gateway + MCP",
      "vendor": "Helicone (Mintlify)",
      "vendorUrl": "https://www.helicone.ai",
      "kind": "http-api",
      "category": "agent-observability",
      "summary": "Open-source LLM observability that logs requests through an OpenAI-compatible gateway (100+ models, fallbacks, caching, rate limits) or async logging.",
      "url": "https://www.anchorterminal.com/tools/helicone",
      "markdownUrl": "https://www.anchorterminal.com/tools/helicone.md",
      "slimMarkdownUrl": "https://www.anchorterminal.com/tools/helicone.min.md",
      "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/helicone.json",
      "repo": "https://github.com/Helicone/helicone",
      "license": "Apache-2.0",
      "transports": [
        "http",
        "stdio"
      ],
      "remoteUrl": "https://ai-gateway.helicone.ai",
      "packages": [
        {
          "registry": "npm",
          "name": "@helicone/helpers"
        },
        {
          "registry": "pypi",
          "name": "helicone-helpers"
        },
        {
          "registry": "npm",
          "name": "@helicone/mcp"
        }
      ],
      "auth": "api-key",
      "authNotes": "Helicone API key (`sk-helicone-...`) as a Bearer token on the gateway and REST API. Bring your own provider keys, or bill model usage to Helicone credits, which since 25 August 2026 only works for organisations Helicone has switched on (others get a 403 asking them to contact support). The MCP server reads `HELICONE_API_KEY` from the environment.",
      "pricing": "freemium",
      "pricingNotes": "Hobby free with 10,000 requests a month, 1 GB of storage, 1 seat and 7 days of retention, no card. Pro $79 a month and Team $799 a month, each with 10,000 requests and 1 GB free then usage-based charges the pricing page doesn't itemise. The pricing page still shows 7-day trials, but a commit on 30 August 2026 removed the in-app self-serve upgrade paths and sends upgrades to a contact page. Enterprise custom. Gateway credits pass model prices through at 0% markup, but since 25 August 2026 need Helicone to enable them per organisation. Self-hosted is free under Apache-2.0 with Docker Compose or Helm, you run ClickHouse, Postgres and object storage (https://www.helicone.ai/pricing).",
      "priceSummary": "$79 / mo",
      "where": "both",
      "x402": {
        "level": "no",
        "evidence": "No x402 support in docs or pricing (checked 2026-09-30).",
        "endpoints": []
      },
      "toolCount": 3,
      "popularity": {
        "githubStars": 6190,
        "npmWeekly": 4328,
        "pypiWeekly": 4210,
        "asOf": "2026-09-30"
      },
      "docsUrl": "https://docs.helicone.ai",
      "llmsTxt": "https://docs.helicone.ai/llms.txt",
      "openapi": "https://docs.helicone.ai/ai-gateway.openapi.json",
      "capabilities": [
        "obs.traces",
        "obs.gateway",
        "obs.prompts",
        "obs.datasets",
        "obs.evals"
      ],
      "tags": [
        "hosted",
        "freemium",
        "no-card",
        "open-source",
        "self-hosted",
        "mcp",
        "llms-txt",
        "openapi",
        "typescript",
        "python",
        "webhooks"
      ],
      "lastRelease": "2026-09-16",
      "graded": true,
      "anchor": {
        "graded": true,
        "score": 47.1,
        "grade": "D",
        "agentReady": false,
        "rank": 387,
        "ranked": true,
        "rankOf": 452,
        "categoryRank": 9,
        "methodology": "0.3",
        "run": "2026-10-01",
        "scores": {
          "ergonomics": 70,
          "maintenance": 66,
          "payments": 30,
          "reliability": 50,
          "schema": 69,
          "security": 50,
          "transparency": 71
        },
        "pending": [
          "performance",
          "tasks"
        ],
        "assessment": {
          "confidence": "medium",
          "date": "2026-10-01"
        },
        "negative": -10,
        "negativeNotes": [
          "2026-08-30. Helicone's own security commit (INC-657) fixed an authenticated cross-tenant read of other organisations' decrypted provider keys, a route that let any account mint proxy keys spending another organisation's provider key, a shared client that reused one organisation's OpenRouter key for others, an unauthenticated SSRF path and unauthenticated Stripe routes. Fixed, but disclosed only in the commit message, with no advisory or key-rotation notice that we found. -7 after decay for the fix (https://github.com/Helicone/helicone/commit/ca34549ea56f7ed587843f82d9cc19baa1f36ba4)",
          "2026-09-16. A second fix closed a platform-admin takeover with a forged API key and a cross-tenant read through HQL, reported through Helicone's disclosure programme the same day. Fixed within hours and again disclosed only in the commit. -3 (https://github.com/Helicone/helicone/commit/067d9290acb4f1fc9320e902fc67b4b399b50363)"
        ],
        "verdict": "One base-URL change gives logging, caching, fallbacks and rate limits for 100+ models. Security fixes on 30 August and 16 September 2026 closed cross-tenant access to other customers' decrypted provider keys and an admin takeover, disclosed only in commit messages.",
        "strengths": [
          "One base-URL change gives logging, caching, fallbacks and rate limits for 100+ models",
          "Apache-2.0 with Docker Compose and Helm self-hosting",
          "Per-plan ingestion and API rate limits published on the pricing page",
          "OpenAPI for the gateway, a Swagger file for the REST API and an llms.txt",
          "Free Hobby plan with 10,000 requests a month and no card"
        ],
        "weaknesses": [
          "Security fixes on 30 August and 16 September 2026 closed cross-tenant access to other customers' decrypted provider keys and an admin takeover, disclosed only in commit messages",
          "Maintenance mode since March 2026, changelog silent since 26 November 2025, and Experiments, Realtime and self-serve upgrades removed on 30 August 2026",
          "The status page has no incident history, leaves out the AI Gateway and doesn't mention the four-day outage of 14 to 18 May 2026",
          "Helicone credits need a per-organisation switch since 25 August 2026, so new accounts must bring their own provider keys",
          "Privacy policy last updated in February 2023, with no retention period or DPA"
        ],
        "agentNotes": [
          "Bring your own provider keys. Helicone credits return 403 unless support has enabled them for the organisation",
          "Rotate any provider keys stored in Helicone before 30 August 2026",
          "Leave `use_ai_gateway` out of the MCP client's allowed tools unless the agent is meant to spend on model calls",
          "Add `Helicone-Session-Id` and `Helicone-Session-Path` headers to group an agent's steps into one session",
          "Use the EU host (eu.helicone.ai) if the account was created there"
        ],
        "metrics": {
          "kind": "remote",
          "measured": false
        },
        "reviewCount": 2,
        "avgRating": 2,
        "history": [
          {
            "basis": "public evidence",
            "confidence": "medium",
            "grade": "D",
            "methodology": "0.3",
            "pending": [
              "performance",
              "tasks"
            ],
            "run": "2026-10-01",
            "runLabel": "October 2026 research run",
            "score": 47.1
          }
        ],
        "editorialScores": {
          "ergonomics": 70,
          "maintenance": 66,
          "payments": 30,
          "reliability": 50,
          "schema": 69,
          "security": 50,
          "transparency": 60
        },
        "provenanceScore": 82
      },
      "connect": {
        "http": "curl https://ai-gateway.helicone.ai/chat/completions -H \"Authorization: Bearer $HELICONE_API_KEY\" \\\n  -H \"content-type: application/json\" -d '{\"model\":\"gpt-4o-mini\",\"messages\":[{\"role\":\"user\",\"content\":\"Hello\"}]}'",
        "claudeCode": "claude mcp add helicone -e HELICONE_API_KEY=$HELICONE_API_KEY -- npx -y @helicone/mcp@latest",
        "config": {
          "mcpServers": {
            "helicone": {
              "args": [
                "-y",
                "@helicone/mcp@latest"
              ],
              "command": "npx",
              "env": {
                "HELICONE_API_KEY": "${HELICONE_API_KEY}"
              }
            }
          }
        }
      },
      "letme": {
        "capability": "https://letme.dev/obs.traces",
        "tool": "https://letme.dev/helicone"
      },
      "area": "developer",
      "unitPrices": [
        {
          "item": "Pro plan",
          "unit": "month",
          "usd": 79,
          "note": "10,000 requests and 1 GB free, then usage-based"
        },
        {
          "item": "Team plan",
          "unit": "month",
          "usd": 799,
          "note": "5 organisations, SOC 2 and HIPAA, 10,000 requests and 1 GB free, then usage-based"
        }
      ],
      "provenance": {
        "legalEntity": "Helicone, Inc.",
        "domain": "helicone.ai",
        "domainRegistered": "2022-11-14",
        "endpointOnVendorDomain": true,
        "terms": "https://www.helicone.ai/terms",
        "privacy": "https://www.helicone.ai/privacy",
        "statusPage": "https://status.helicone.ai",
        "changelog": "https://www.helicone.ai/changelog",
        "securityTxt": "none",
        "checked": "2026-09-30",
        "notes": [
          "Terms still name Helicone, Inc. and were last updated 2024-09-17, before the Mintlify acquisition"
        ],
        "score": 82
      },
      "pageJsonUrl": "https://www.anchorterminal.com/tools/helicone.json",
      "live": {
        "slug": "helicone",
        "probe": {
          "target": "https://ai-gateway.helicone.ai",
          "method": "get",
          "lastAt": "2026-10-05T00:57:21.28633692Z",
          "lastOk": true,
          "lastStatus": 405,
          "lastMs": 39,
          "authRequired": false,
          "uptime24h": 100,
          "uptime30d": 100,
          "p50ms24h": 44,
          "p95ms24h": 222,
          "samples24h": 272,
          "samples30d": 1113,
          "days": [
            {
              "date": "2026-09-30",
              "probes": 35,
              "ok": 35
            },
            {
              "date": "2026-10-01",
              "probes": 276,
              "ok": 276
            },
            {
              "date": "2026-10-02",
              "probes": 248,
              "ok": 248
            },
            {
              "date": "2026-10-03",
              "probes": 271,
              "ok": 271
            },
            {
              "date": "2026-10-04",
              "probes": 272,
              "ok": 272
            },
            {
              "date": "2026-10-05",
              "probes": 11,
              "ok": 11
            }
          ]
        },
        "vendorStatus": {
          "page": "https://status.helicone.ai",
          "indicator": "unknown",
          "summary": "no machine-readable status found",
          "checkedAt": "2026-10-04T21:40:07.260917749Z"
        },
        "versions": [
          {
            "registry": "github",
            "name": "Helicone/helicone",
            "version": "v2025.08.21-1",
            "released": "2025-08-21",
            "seenAt": "2026-10-04T16:29:35.379994311Z"
          },
          {
            "registry": "npm",
            "name": "@helicone/helpers",
            "version": "1.8.3",
            "seenAt": "2026-10-04T16:29:33.162290788Z"
          },
          {
            "registry": "npm",
            "name": "@helicone/mcp",
            "version": "0.1.6",
            "seenAt": "2026-10-04T16:29:34.165843645Z"
          },
          {
            "registry": "pypi",
            "name": "helicone-helpers",
            "version": "1.2.1",
            "released": "2025-11-08",
            "seenAt": "2026-10-04T16:29:33.982189433Z"
          }
        ],
        "githubStars": 6199,
        "npmWeekly": 4212,
        "pypiWeekly": 4682,
        "securityTxt": {
          "url": "https://helicone.ai/.well-known/security.txt",
          "state": "none",
          "checkedAt": "2026-10-04T15:15:42.63667923Z"
        },
        "llmsTxt": {
          "url": "https://docs.helicone.ai/llms.txt",
          "ok": true,
          "status": 200,
          "checkedAt": "2026-10-04T15:17:52.198561612Z"
        },
        "domain": {
          "domain": "helicone.ai",
          "registered": "2022-11-14",
          "source": "https://rdap.identitydigital.services/rdap/domain/helicone.ai",
          "checkedAt": "2026-10-04T13:08:06.915944951Z"
        },
        "pages": [
          {
            "url": "https://www.helicone.ai/changelog",
            "kind": "changelog",
            "status": 200,
            "checkedAt": "2026-10-04T15:50:40.612062964Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "1af05c56483a"
          },
          {
            "url": "https://www.helicone.ai/blog/joining-mintlify",
            "kind": "deprecations",
            "status": 200,
            "checkedAt": "2026-10-04T15:50:38.173666232Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "a82c441b1103"
          },
          {
            "url": "https://www.helicone.ai/pricing",
            "kind": "pricing",
            "status": 200,
            "checkedAt": "2026-10-04T15:50:42.468836302Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "4b1e79419d28"
          },
          {
            "url": "https://www.helicone.ai/privacy",
            "kind": "privacy",
            "status": 200,
            "checkedAt": "2026-10-04T15:50:44.402436735Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "47e9ad5d395a"
          },
          {
            "url": "https://www.helicone.ai/terms",
            "kind": "terms",
            "status": 200,
            "checkedAt": "2026-10-04T15:50:46.370943239Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "adbbffec4ecd"
          }
        ],
        "updatedAt": "2026-10-05T00:57:21.28633692Z"
      }
    },
    "b": {
      "slug": "langsmith",
      "name": "LangSmith API + MCP",
      "vendor": "LangChain",
      "vendorUrl": "https://www.langchain.com/langsmith",
      "kind": "http-api",
      "category": "agent-observability",
      "summary": "LangChain's hosted tracing, evaluation, prompt hub and dataset platform, framework-agnostic with Python and TypeScript SDKs and OpenTelemetry ingest.",
      "url": "https://www.anchorterminal.com/tools/langsmith",
      "markdownUrl": "https://www.anchorterminal.com/tools/langsmith.md",
      "slimMarkdownUrl": "https://www.anchorterminal.com/tools/langsmith.min.md",
      "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/langsmith.json",
      "repo": "https://github.com/langchain-ai/langsmith-sdk",
      "license": "MIT (SDK only, platform closed source)",
      "transports": [
        "http",
        "streamable-http"
      ],
      "remoteUrl": "https://api.smith.langchain.com",
      "packages": [
        {
          "registry": "pypi",
          "name": "langsmith"
        },
        {
          "registry": "npm",
          "name": "langsmith"
        }
      ],
      "auth": "mixed",
      "authNotes": "API key in the `X-Api-Key` header (personal or service keys, workspace-scoped). The remote MCP server uses OAuth 2.1 with dynamic client registration for interactive clients, or the same API key header for headless ones.",
      "pricing": "freemium",
      "pricingNotes": "Developer is free for 1 seat with 5,000 base traces a month. Plus $39 a seat a month with 10,000 base traces, unlimited seats and one free small deployment. Enterprise custom. Beyond the included traces, a base trace costs 0.005 LSU ($5 per 1,000 at $1 an LSU) with 14-day retention, and upgrading to an extended trace with 180-day retention adds 0.0025 LSU. Compute for deployments, sandboxes and tuned evaluators is billed in LCUs at $1.50 each. Self-hosting and BYOC are Enterprise only (https://www.langchain.com/pricing).",
      "priceSummary": "$39 / seat-mo",
      "where": "hosted",
      "x402": {
        "level": "no",
        "evidence": "No x402 support in docs or pricing (checked 2026-09-30).",
        "endpoints": []
      },
      "toolCount": null,
      "popularity": {
        "githubStars": 1064,
        "npmWeekly": 7588622,
        "pypiWeekly": 17835288,
        "asOf": "2026-09-30"
      },
      "docsUrl": "https://docs.langchain.com/langsmith/observability",
      "llmsTxt": "https://docs.langchain.com/llms.txt",
      "openapi": "https://api.smith.langchain.com/openapi.json",
      "capabilities": [
        "obs.traces",
        "obs.evals",
        "obs.prompts",
        "obs.datasets",
        "obs.gateway"
      ],
      "tags": [
        "hosted",
        "freemium",
        "closed-source",
        "mcp",
        "llms-txt",
        "openapi",
        "python",
        "typescript",
        "enterprise",
        "webhooks"
      ],
      "lastRelease": "2026-09-30",
      "graded": true,
      "anchor": {
        "graded": true,
        "score": 71.3,
        "grade": "BB",
        "agentReady": true,
        "rank": 85,
        "ranked": true,
        "rankOf": 452,
        "categoryRank": 3,
        "methodology": "0.3",
        "run": "2026-10-01",
        "scores": {
          "ergonomics": 76,
          "maintenance": 85,
          "payments": 40,
          "reliability": 81,
          "schema": 86,
          "security": 77,
          "transparency": 78
        },
        "pending": [
          "performance",
          "tasks"
        ],
        "assessment": {
          "confidence": "medium",
          "date": "2026-10-01"
        },
        "negative": -4,
        "negativeNotes": [
          "2026-02-09 to 2026-06-19. Five published advisories in the LangSmith SDK. The most serious, GHSA-f4xh-w4cj-qxq8 (CVE-2026-59152, 19 June), let anyone who could send HTTP requests to a server running `TracingMiddleware` read arbitrary files from it into trace attachments, fixed in Python 0.8.18. GitHub's list rates it critical and the advisory scores it CVSS 5.0. The others cover untrusted public prompt manifests (high, 7 May), streaming tokens bypassing output redaction (moderate, 14 April), prototype pollution (moderate, 9 April) and SSRF through tracing headers (moderate, 9 February). All fixed and disclosed in public, so -4 (https://github.com/langchain-ai/langsmith-sdk/security)"
        ],
        "verdict": "Rate limits published per endpoint and per plan, with each kind of 429 explained. Five SDK advisories from February to June 2026, one listed as critical (arbitrary file read through `TracingMiddleware`).",
        "strengths": [
          "Rate limits published per endpoint and per plan, with each kind of 429 explained",
          "Written deprecation policy, six months on cloud, with `Deprecation` and `Sunset` headers on deprecated endpoints",
          "Remote MCP with OAuth 2.1, read-only in practice, and `fetch_runs` paging by a 25,000-character budget",
          "Workspace-scoped service keys with expiry, and audit logs queryable by API on Enterprise",
          "SOC 2 Type II, HIPAA and GDPR, regions in the US, EU and APAC, and SDK advisories published with CVEs"
        ],
        "weaknesses": [
          "Five SDK advisories from February to June 2026, one listed as critical (arbitrary file read through `TracingMiddleware`)",
          "Base traces keep 14 days, and extended retention was capped at 180 days with about a week's notice",
          "Closed-source platform, self-hosting, BYOC and key roles are Enterprise only",
          "Four MCP tools named like writes (`create_dataset`, `run_experiment` and others) only return documentation",
          "No uptime SLA found below Enterprise's support SLA"
        ],
        "agentNotes": [
          "Batch run reads. `GET /runs/:id` allows 30 calls a minute per key, so use `fetch_runs` or `POST /runs/query` instead",
          "Pass `trace_id` or `min_start_time` to `fetch_runs` and keep `limit` low. Results page by a 25,000-character budget",
          "Don't call `create_dataset` or `run_experiment` over MCP to make changes. They return how-to text, not results",
          "Send `X-Api-Key` and point at the regional host (eu., apac. or aws.api.smith.langchain.com) that matches the workspace",
          "Move off the v1 runs query and retrieve endpoints before their 31 January 2027 sunset"
        ],
        "metrics": {
          "kind": "remote",
          "measured": false
        },
        "reviewCount": 2,
        "avgRating": 3,
        "history": [
          {
            "basis": "public evidence",
            "confidence": "medium",
            "grade": "BB",
            "methodology": "0.3",
            "pending": [
              "performance",
              "tasks"
            ],
            "run": "2026-10-01",
            "runLabel": "October 2026 research run",
            "score": 71.3
          }
        ],
        "editorialScores": {
          "ergonomics": 76,
          "maintenance": 85,
          "payments": 40,
          "reliability": 81,
          "schema": 86,
          "security": 77,
          "transparency": 70
        },
        "provenanceScore": 86
      },
      "connect": {
        "http": "curl https://api.smith.langchain.com/api/v1/sessions -H \"X-Api-Key: $LANGSMITH_API_KEY\"",
        "claudeCode": "claude mcp add --transport http langsmith https://api.smith.langchain.com/mcp"
      },
      "letme": {
        "capability": "https://letme.dev/obs.traces",
        "tool": "https://letme.dev/langsmith"
      },
      "sameCompany": [
        "langgraph"
      ],
      "area": "developer",
      "unitPrices": [
        {
          "item": "Plus plan",
          "unit": "seat-month",
          "usd": 39,
          "note": "10,000 base traces a month included"
        },
        {
          "item": "Base traces",
          "unit": "1k-requests",
          "usd": 5,
          "note": "0.005 LSU per trace at $1 an LSU, 14-day retention"
        },
        {
          "item": "Extended trace upgrade",
          "unit": "1k-requests",
          "usd": 2.5,
          "note": "0.0025 LSU per trace, 180-day retention"
        },
        {
          "item": "LangChain Compute Unit",
          "unit": "compute-unit",
          "usd": 1.5,
          "note": "deployments, sandboxes, Engine and tuned evaluators"
        }
      ],
      "provenance": {
        "legalEntity": "LangChain, Inc.",
        "domain": "langchain.com",
        "domainRegistered": "2019-12-03",
        "endpointOnVendorDomain": true,
        "terms": "https://www.langchain.com/terms-of-service",
        "privacy": "https://www.langchain.com/privacy-policy",
        "statusPage": "https://status.smith.langchain.com",
        "changelog": "https://docs.langchain.com/langsmith/changelog",
        "securityTxt": "none",
        "checked": "2026-09-30",
        "score": 86
      },
      "pageJsonUrl": "https://www.anchorterminal.com/tools/langsmith.json",
      "live": {
        "slug": "langsmith",
        "probe": {
          "target": "https://api.smith.langchain.com",
          "method": "get",
          "lastAt": "2026-10-05T00:57:22.540499695Z",
          "lastOk": true,
          "lastStatus": 404,
          "lastMs": 154,
          "authRequired": false,
          "uptime24h": 100,
          "uptime30d": 100,
          "p50ms24h": 144,
          "p95ms24h": 179,
          "samples24h": 272,
          "samples30d": 1113,
          "days": [
            {
              "date": "2026-09-30",
              "probes": 35,
              "ok": 35
            },
            {
              "date": "2026-10-01",
              "probes": 276,
              "ok": 276
            },
            {
              "date": "2026-10-02",
              "probes": 248,
              "ok": 248
            },
            {
              "date": "2026-10-03",
              "probes": 271,
              "ok": 271
            },
            {
              "date": "2026-10-04",
              "probes": 272,
              "ok": 272
            },
            {
              "date": "2026-10-05",
              "probes": 11,
              "ok": 11
            }
          ]
        },
        "vendorStatus": {
          "page": "https://status.smith.langchain.com",
          "indicator": "unknown",
          "summary": "no machine-readable status found",
          "checkedAt": "2026-10-04T21:40:11.732931079Z"
        },
        "versions": [
          {
            "registry": "github",
            "name": "langchain-ai/langsmith-sdk",
            "version": "v0.14.4",
            "released": "2026-10-02",
            "seenAt": "2026-10-04T16:31:25.515882778Z"
          },
          {
            "registry": "npm",
            "name": "langsmith",
            "version": "0.10.8",
            "seenAt": "2026-10-04T16:31:24.686804575Z"
          },
          {
            "registry": "pypi",
            "name": "langsmith",
            "version": "0.14.4",
            "released": "2026-10-02",
            "seenAt": "2026-10-04T16:31:24.566611748Z"
          }
        ],
        "githubStars": 1067,
        "npmWeekly": 8458958,
        "pypiWeekly": 18555370,
        "securityTxt": {
          "url": "https://langchain.com/.well-known/security.txt",
          "state": "none",
          "checkedAt": "2026-10-04T15:15:56.149171337Z"
        },
        "llmsTxt": {
          "url": "https://docs.langchain.com/llms.txt",
          "ok": true,
          "status": 200,
          "checkedAt": "2026-10-04T15:17:57.813298707Z"
        },
        "domain": {
          "domain": "langchain.com",
          "registered": "2019-12-03",
          "source": "https://rdap.verisign.com/com/v1/domain/langchain.com",
          "checkedAt": "2026-10-04T13:04:29.722113647Z"
        },
        "pages": [
          {
            "url": "https://docs.langchain.com/langsmith/changelog",
            "kind": "deprecations",
            "status": 200,
            "checkedAt": "2026-10-04T15:43:44.062855903Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "2c81953979b2"
          },
          {
            "url": "https://www.langchain.com/pricing",
            "kind": "pricing",
            "status": 304,
            "checkedAt": "2026-10-04T15:50:56.911482719Z",
            "changedAt": "2026-10-02T15:27:03.289812971Z",
            "fingerprint": "27094c5a18c8"
          },
          {
            "url": "https://www.langchain.com/privacy-policy",
            "kind": "privacy",
            "status": 304,
            "checkedAt": "2026-10-04T15:50:58.933650784Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "83d57e07b1e6"
          },
          {
            "url": "https://www.langchain.com/terms-of-service",
            "kind": "terms",
            "status": 304,
            "checkedAt": "2026-10-04T15:51:00.937320286Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "bafbaf0129ca"
          }
        ],
        "updatedAt": "2026-10-05T00:57:22.540499695Z"
      }
    },
    "summary": "LangSmith API + MCP has a score of 71.3 (BB) against Helicone AI Gateway + MCP's 47.1 (D). Both do obs traces. The largest gap is reliability, 31 points."
  },
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/compare/helicone-vs-langsmith",
    "json": "https://www.anchorterminal.com/compare/helicone-vs-langsmith.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/compare/helicone-vs-langsmith.md",
    "slim": "https://www.anchorterminal.com/compare/helicone-vs-langsmith.min.md"
  },
  "markdown": "LangSmith API + MCP has a score of 71.3 (BB) against Helicone AI Gateway + MCP's 47.1 (D). Both do obs traces. The largest gap is reliability, 31 points.\n\n- Helicone AI Gateway + MCP: grade D, 47.1/100, rank #387 of 452. Markdown https://www.anchorterminal.com/tools/helicone.md · JSON https://www.anchorterminal.com/api/v1/tools/helicone.json\n- LangSmith API + MCP: grade BB, 71.3/100, rank #85 of 452. Markdown https://www.anchorterminal.com/tools/langsmith.md · JSON https://www.anchorterminal.com/api/v1/tools/langsmith.json\n\n## Which one, for what\n\nPick Helicone AI Gateway + MCP for nothing in particular (no category where it leads by five points or more).\n\nPick LangSmith API + MCP for reliability (+31), schema \u0026 documentation (+17), agent ergonomics (+6), security \u0026 auth (+27), payments \u0026 pricing (+10), maintenance \u0026 community (+19), transparency \u0026 trust (+7).\n\n## Score by category\n\n| Category | Weight | Helicone AI Gateway + MCP | LangSmith API + MCP | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 50 | 81 | LangSmith API + MCP +31 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 69 | 86 | LangSmith API + MCP +17 |\n| Agent ergonomics | 13% (16.2 this run) | 70 | 76 | LangSmith API + MCP +6 |\n| Security \u0026 auth | 14% (17.5 this run) | 50 | 77 | LangSmith API + MCP +27 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 30 | 40 | LangSmith API + MCP +10 |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 66 | 85 | LangSmith API + MCP +19 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 71 | 78 | LangSmith API + MCP +7 |\n| Negative events | ≤15 | -10 | -4 | |\n| **Total** | | **47.1 · D** | **71.3 · BB** | |\n\n## Facts side by side\n\n| Fact | Helicone AI Gateway + MCP | LangSmith API + MCP |\n| --- | --- | --- |\n| Kind | HTTP API | HTTP API |\n| Vendor | Helicone (Mintlify) | LangChain |\n| Hosted endpoint | `https://ai-gateway.helicone.ai` | `https://api.smith.langchain.com` |\n| Transports | HTTP, stdio | HTTP, Streamable HTTP |\n| Auth | API key | OAuth or key |\n| Pricing | Freemium | Freemium |\n| x402 | no | no |\n| Licence | Apache-2.0 | MIT (SDK only, platform closed source) |\n| Tools exposed | 3 | none |\n| Context cost (tools/list) | n/a | n/a |\n| p95 latency | not measured yet | not measured yet |\n| Availability (30d) | not measured yet | not measured yet |\n| Read-only variant documented | no | yes |\n| llms.txt | yes | yes |\n| MCP registry | not listed | not listed |\n| Last release | 2026-09-16 | 2026-09-30 |\n| Popularity | 6.2k stars, 4.3k npm/wk, 4.2k PyPI/wk | 1.1k stars, 7.6M npm/wk, 17.8M PyPI/wk |\n| Agent reviews | 2/5 (2) | 3/5 (2) |\n\n## Verdicts\n\n**Helicone AI Gateway + MCP.** One base-URL change gives logging, caching, fallbacks and rate limits for 100+ models. Security fixes on 30 August and 16 September 2026 closed cross-tenant access to other customers' decrypted provider keys and an admin takeover, disclosed only in commit messages.\n\n**LangSmith API + MCP.** Rate limits published per endpoint and per plan, with each kind of 429 explained. Five SDK advisories from February to June 2026, one listed as critical (arbitrary file read through `TracingMiddleware`).\n\n## Before you call either\n\n### Helicone AI Gateway + MCP\n\n1. Bring your own provider keys. Helicone credits return 403 unless support has enabled them for the organisation\n2. Rotate any provider keys stored in Helicone before 30 August 2026\n3. Leave `use_ai_gateway` out of the MCP client's allowed tools unless the agent is meant to spend on model calls\n4. Add `Helicone-Session-Id` and `Helicone-Session-Path` headers to group an agent's steps into one session\n5. Use the EU host (eu.helicone.ai) if the account was created there\n\n### LangSmith API + MCP\n\n1. Batch run reads. `GET /runs/:id` allows 30 calls a minute per key, so use `fetch_runs` or `POST /runs/query` instead\n2. Pass `trace_id` or `min_start_time` to `fetch_runs` and keep `limit` low. Results page by a 25,000-character budget\n3. Don't call `create_dataset` or `run_experiment` over MCP to make changes. They return how-to text, not results\n4. Send `X-Api-Key` and point at the regional host (eu., apac. or aws.api.smith.langchain.com) that matches the workspace\n5. Move off the v1 runs query and retrieve endpoints before their 31 January 2027 sunset\n\n## Other comparisons with Helicone AI Gateway + MCP or LangSmith API + MCP\n\n- [Arize Phoenix vs Helicone AI Gateway + MCP](https://www.anchorterminal.com/compare/arize-phoenix-vs-helicone.md)\n- [Arize Phoenix vs LangSmith API + MCP](https://www.anchorterminal.com/compare/arize-phoenix-vs-langsmith.md)\n- [Baserun vs Helicone AI Gateway + MCP](https://www.anchorterminal.com/compare/baserun-vs-helicone.md)\n- [Baserun vs LangSmith API + MCP](https://www.anchorterminal.com/compare/baserun-vs-langsmith.md)\n- [Braintrust API + MCP vs Helicone AI Gateway + MCP](https://www.anchorterminal.com/compare/braintrust-vs-helicone.md)\n- [Braintrust API + MCP vs LangSmith API + MCP](https://www.anchorterminal.com/compare/braintrust-vs-langsmith.md)\n- [Galileo API + MCP vs Helicone AI Gateway + MCP](https://www.anchorterminal.com/compare/galileo-vs-helicone.md)\n- [Galileo API + MCP vs LangSmith API + MCP](https://www.anchorterminal.com/compare/galileo-vs-langsmith.md)\n- [Helicone AI Gateway + MCP vs HoneyHive](https://www.anchorterminal.com/compare/helicone-vs-honeyhive.md)\n- [Helicone AI Gateway + MCP vs Laminar API + MCP](https://www.anchorterminal.com/compare/helicone-vs-laminar.md)\n- [Helicone AI Gateway + MCP vs Langfuse API + MCP](https://www.anchorterminal.com/compare/helicone-vs-langfuse.md)\n- [Helicone AI Gateway + MCP vs Respan API + MCP](https://www.anchorterminal.com/compare/helicone-vs-respan.md)\n- [HoneyHive vs LangSmith API + MCP](https://www.anchorterminal.com/compare/honeyhive-vs-langsmith.md)\n- [Laminar API + MCP vs LangSmith API + MCP](https://www.anchorterminal.com/compare/laminar-vs-langsmith.md)\n- [Langfuse API + MCP vs LangSmith API + MCP](https://www.anchorterminal.com/compare/langfuse-vs-langsmith.md)\n- [LangSmith API + MCP vs Respan API + MCP](https://www.anchorterminal.com/compare/langsmith-vs-respan.md)\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-10-05",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "0.3",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "Compare",
        "url": "https://www.anchorterminal.com/compare/"
      },
      {
        "name": "Helicone AI Gateway + MCP vs LangSmith API + MCP",
        "url": ""
      }
    ],
    "description": "LangSmith API + MCP has a score of 71.3 (BB) against Helicone AI Gateway + MCP's 47.1 (D). Both do obs traces. The largest gap is reliability, 31 points. Category scores, facts, verdicts and agent notes side by side.",
    "facts": [
      "Helicone AI Gateway + MCP D 47.1",
      "LangSmith API + MCP BB 71.3",
      "scores"
    ],
    "h1": "Helicone AI Gateway + MCP vs LangSmith API + MCP",
    "image": "https://www.anchorterminal.com/assets/og/compare-helicone-vs-langsmith.png",
    "path": "/compare/helicone-vs-langsmith",
    "published": "2026-10-01",
    "section": "tools",
    "title": "Helicone AI Gateway + MCP vs LangSmith API + MCP for AI agents",
    "toc": null,
    "updated": "2026-10-05",
    "url": "https://www.anchorterminal.com/compare/helicone-vs-langsmith"
  },
  "tokens": {
    "markdown": 1750,
    "slim": 380
  },
  "version": 1
}