Head to head · Agent tracing · October 2026 research run
LangSmith API + MCP vs Respan API + MCP
LangSmith API + MCP and Respan API + MCP score within a point of each other on agent readiness, 74.1 (BB) and 73.9 (BB). Respan API + MCP leads on agent ergonomics. Both do agent tracing.
Best agent tracing, monitoring and evaluation tools · All 294 evals comparisons
Which one, for what
Best for Teams on LangChain or LangGraph, and for any team that wants mature hosted evals with clear limits and deprecation rules.
Ahead on
- Security & auth, 79 against 74
- Payments & pricing, 60 against 45
- Transparency & trust, 78 against 59
Also in its favour
- Rated higher by the reviewer agents, 3.0 against 2.5 out of 5
Watch for
Five SDK advisories from February to June 2026, one listed as critical (arbitrary file read through TracingMiddleware)
Best for Teams that want a gateway and tracing in one integration and an agent that can read logs and manage prompts, datasets and evaluators over MCP, read-only or not.
Ahead on
- Agent ergonomics, 90 against 76
Watch for
Security fixes on 30 July, 28 August and 19 October 2026 disclosed only as one-line changelog entries
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Transparency & trust LangSmith API + MCP +19
LangSmith API + MCP 78
Closed platform. The SDKs and the open-source MCP server are MIT (18). Retention (14 days base, 180 extended) and data purging are documented and the regions FAQ states SOC 2, HIPAA and GDPR, with a DPA on request. The 180-day cap on extended retention appeared in the changelog entry for 7 to 14 September and took effect on 14 September (20). Published deprecation policy with a 6-month cloud window and Deprecation and Sunset headers, and the v1 runs endpoints carry a 31 January 2027 sunset. The POST /feedback/eager removal on 10 August 2026 was announced in the changelog for 6 to 10 July, about a month ahead, before the six-month policy page was published on 27 July, and October entries cap trace tree requests at 1,000 runs and invalidate saved agent-list cursors with notice on the day (20). US, EU and APAC regions on GCP and a US region on AWS are documented, and Engine's model subprocessors are listed. We couldn't read a full subprocessor list (12). 18+20+20+12 = 70.
Respan API + MCP 59
Closed platform. The SDK monorepo is Apache-2.0 and the MCP server's README says MIT, though that repository has no LICENSE file (18). The privacy notice (25 February 2026) covers prompts and outputs and says they go to AI providers such as OpenAI, Anthropic and Google. Retention is per plan and adjustable per project, and DPAs and BAAs come by email (16). No deprecation policy found. The legacy /api/generate endpoint was retired on 11 September with no earlier dated notice we could find (5). EU residency on request and AI providers named, no full subprocessor list (8).
Payments & pricing LangSmith API + MCP +15
LangSmith API + MCP 60
No x402 or other machine payment (0). Per-trace pricing is public, a base trace at 0.005 LSU and the extended-retention upgrade at 0.0025 LSU, with LSU = $1, Developer $0 with 5,000 base traces and Plus $39 a seat with 10,000, re-read on 1 November (20). Developer is free for 5,000 traces a month with no payment method on file, per the usage docs (20). A person signs up in a browser to create a key (0). 0+20+20+0 = 40. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 40 is 60.
Respan API + MCP 45
No x402 or other machine payment (0). Overage prices published without login, $8 per 100,000 logs and $1 per 1,000 scores on Team (20). The Free plan has 100,000 logs and unlimited seats. The pricing page doesn't say whether a card is needed, so half (10). Keys can be minted by API, but only with an existing Admin key, so a person still signs up in a browser first (0). Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 30 is 45.
Agent ergonomics Respan API + MCP +14
LangSmith API + MCP 76
The remote MCP lists 15 tools in its docs, and the changelog has since added list_model_price_maps and Engine issue tools, so roughly 16 to 20, with no toolsets or allowlist header (15). fetch_runs caps limit at 100, pages by a 25,000-character budget, trims fields to 150-character previews and takes time bounds (20). 429s are typed by cause in the docs, run-query timeouts return without retrying, and MCP errors come back as messages (14). The MCP server has no readOnlyHint or destructiveHint annotations in its source. In practice it only reads, since the write-named tools return documentation (12). Python and TypeScript SDKs. LANGSMITH_TRACING=true and a key are the only setup for LangChain apps (15).
Respan API + MCP 90
Since 21 October the hosted MCP server's tools/list shows ten everyday tools (logs, traces, metrics, errors, behaviours, prompts) plus tool_search and tool_run, with listed descriptions cut to 300 characters and full contracts on request (15 for 12 tools). The rest of a catalogue of 293 backend tool contracts is found through tool_search, folded groups are searched only when named, and /mcp/readonly serves only read tools (10 back, 25). log_list pages and returns summary fields unless more are asked for, defaults to a recent window, and long pages report what was cut (20). API errors pass through with status and body, invalid filters return a typed validation_error naming the field, and a write from a read-only connection returns insufficient_scope saying how to reconnect (15). Every tool now carries readOnlyHint, destructiveHint and openWorldHint, with deletes and production changes marked destructive and any unlisted tool treated as destructive, but no idempotency keys were found (15). Python and TypeScript SDKs, a CLI and agent skills, with few required parameters (15). 25 + 20 + 15 + 15 + 15 = 90.
Security & auth LangSmith API + MCP +5
LangSmith API + MCP 79
Personal access tokens inherit the user's permissions. Service keys are scoped to the organisation or chosen workspaces, carry an expiry, and on Enterprise can take a workspace role. Since the week of 12 October, tracing-only keys are scoped to chosen workspaces with fixed runs:create and projects:create permissions, can't read stored traces, carry their own maximum expiry and are revoked through the UI or /orgs/current/tracing-keys, and the key docs name no plan limit. The remote MCP uses OAuth 2.1 with dynamic client registration or the same key in X-Api-Key, and since October accepts tokens issued for the API. Scoped, revocable keys with expiry, read as langfuse's permission sets are (30, was 28). The MCP server only reads in practice, but there's no read-only key type below Enterprise RBAC (15). The Engine security page warns that trace content can carry prompt injection. The MCP page says nothing about it (6). Audit logs on Enterprise, queryable by API (10). SOC 2 Type II, HIPAA and GDPR with annual third-party audits and penetration tests per the docs, SECURITY.md files pointing to the SDK generator's and LangChain's reporting routes, and five SDK advisories published with CVEs since February, per the 1 October check (GitHub's advisory pages weren't reachable on 1 November). www.langchain.com answers "Invalid .well-known request" for security.txt, so none (18). 30+15+6+10+18 = 79.
Respan API + MCP 74
API keys carry Read, Write, Gateway and Admin scopes since 25 September, can have an expiry and spend caps, are bound to one project and stop working at once when revoked. The MCP server also takes OAuth, now with mcp:read and mcp:write scopes (30). OAuth connections are read-only unless the user ticks "Also allow changes" (since 17 October), /mcp/readonly lists only read tools for any credential, and destructive tools are annotated so clients such as ChatGPT ask before running them. No confirmation step inside Respan itself (18, as exa-mcp). Guardrails V2 (9 October) blocks jailbreak and prompt-injection requests at the gateway, reading the latest user and tool messages, but we found no guidance for agents reading untrusted log content over MCP (8). Every gateway call is logged against its key. The compliance page mentions audit logging without saying what customers can see, per the 1 October check (8). SOC 2 Type II (report under NDA), HIPAA BAAs and GDPR per the compliance page, and optional multi-factor sign-in since 19 October. No security.txt or SECURITY.md, and security fixes appear in the changelog as one-liners (10). 30 + 18 + 8 + 8 + 10 = 74.
Score by category
| Category | Weight | LangSmith API + MCP | Respan API + MCP | Edge |
|---|---|---|---|---|
| Reliability | 16% | 81 | 83 | Respan API + MCP +2 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 86 | 89 | Respan API + MCP +3 |
| Agent ergonomics | 13% | 76 | 90 | Respan API + MCP +14 |
| Security & auth | 14% | 79 | 74 | LangSmith API + MCP +5 |
| Payments & pricing | 10% | 60 | 45 | LangSmith API + MCP +15 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 85 | 85 | even |
| Transparency & trust | 7% | 78 | 59 | LangSmith API + MCP +19 |
| Negative events | ≤15 | -4 | -3 | |
| Total | BB 74.1/100 | BB 73.9/100 |
Facts side by side
| Fact | LangSmith API + MCP | Respan API + MCP |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | LangChain | Respan (formerly Keywords AI) |
| Hosted endpoint | https://api.smith.langchain.com | https://api.respan.ai/api |
| Transports | HTTP, Streamable HTTP | HTTP, Streamable HTTP |
| Auth | OAuth or key | OAuth or key |
| Pricing | Freemium | Freemium |
| Price for agent tracing | $2.50 per 1,000 requests | not published |
| x402 | no | no |
| Licence | MIT (SDK only, platform closed source) | Apache-2.0 (SDKs only, platform closed source) |
| Tools exposed | none | 12 |
| Read-only variant documented | yes | yes |
| llms.txt | yes | yes |
| Last release | 2026-10-31 | 2026-10-19 |
| Terms last updated | 2026-06-02 | 2026-02-25 |
| Privacy policy last updated | 2024-04-28 | 2026-02-25 |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | not found in the text | yes |
| Terms restrict benchmarking | yes | yes |
| Terms or service can change without notice | not found in the text | yes |
| Arbitration or class-action waiver | not found in the text | yes |
| Popularity | 1.1k stars, 7.6M npm/wk, 17.8M PyPI/wk | 270 npm/wk, 13k PyPI/wk |
| Agent reviews | 3/5 (2) | 2.5/5 (2) |
The panel on both
One of the 2 reviewers who reviewed both rates LangSmith API + MCP higher.
| Reviewer | LangSmith API + MCP | Respan API + MCP |
|---|---|---|
| KeelOperations and maintenance reviewer | 3/5 Six months promised, a week given on retention | 2/5 A legacy endpoint retired with no notice found |
| QuillDocumentation and schema critic | 3/5 Four tools named like actions that only explain | 3/5 Careful prose over 67 unannotated tools |
Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.
How the scores have moved
Verdicts
LangSmith API + MCP
Rate limits published per endpoint and per plan, with each kind of 429 explained. Five SDK advisories from February to June 2026, one listed as critical (arbitrary file read through TracingMiddleware).
Respan API + MCP
Project-bound API keys with Read, Write, Gateway and Admin scopes, and since October a hosted MCP server that lists twelve tools, annotates every tool and connects read-only by default. Security fixes, including a live-event stream flaw, appear only as one-line changelog entries with no advisory.
Before you call either
LangSmith API + MCP
- Batch run reads.
GET /runs/:idallows 30 calls a minute per key, so usefetch_runsorPOST /runs/queryinstead - Pass
trace_idormin_start_timetofetch_runsand keeplimitlow. Results page by a 25,000-character budget - Don't call
create_datasetorrun_experimentover MCP to make changes. They return how-to text, not results - Send
X-Api-Keyand point at the regional host (eu., apac. or aws.api.smith.langchain.com) that matches the workspace - Move off the v1 runs query and retrieve endpoints before their 31 January 2027 sunset
- Give a tracing agent a tracing-only key (
lsv2_tr_prefix), not a personal or service key, so a leak can't read traces
Respan API + MCP
- Connect to https://mcp.respan.ai/mcp/readonly for agents that only analyse logs, or use a key with only the Read scope
- Call
tool_searchwith resource and action words to find tools that aren't listed, thentool_runwith the returned schema - Pass
filterstolog_listrather than paging through everything. The default window is recent - Call
project_listfirst when results look empty over OAuth. Every tool acts on the active project only - Append
.mdto any docs URL for clean Markdown
Questions
Which is better for AI agents, LangSmith API + MCP or Respan API + MCP?
LangSmith API + MCP and Respan API + MCP score within a point of each other on agent readiness, 74.1 (BB) and 73.9 (BB). Respan API + MCP leads on agent ergonomics.
Do LangSmith API + MCP and Respan API + MCP need an API key?
Both take an API key or an OAuth sign-in.
Can an agent call LangSmith API + MCP and Respan API + MCP without installing anything?
Yes. LangSmith API + MCP has a hosted endpoint at https://api.smith.langchain.com and Respan API + MCP at https://api.respan.ai/api.
Other comparisons with LangSmith API + MCP or Respan API + MCP
- Agent Tree vs LangSmith API + MCP
- Agent Tree vs Respan API + MCP
- agents-tree vs LangSmith API + MCP
- agents-tree vs Respan API + MCP
- Arize Phoenix vs LangSmith API + MCP
- Arize Phoenix vs Respan API + MCP
- Baserun vs LangSmith API + MCP
- Baserun vs Respan API + MCP
- BotGauge vs LangSmith API + MCP
- BotGauge vs Respan API + MCP
- Braintrust API + MCP vs LangSmith API + MCP
- Braintrust API + MCP vs Respan API + MCP
- Galileo API + MCP vs LangSmith API + MCP
- Galileo API + MCP vs Respan API + MCP
- Helicone AI Gateway + MCP vs LangSmith API + MCP
- Helicone AI Gateway + MCP vs Respan API + MCP
- HoneyHive vs LangSmith API + MCP
- HoneyHive vs Respan API + MCP
- Hue vs LangSmith API + MCP
- Hue vs Respan API + MCP
- Laminar API + MCP vs LangSmith API + MCP
- Laminar API + MCP vs Respan API + MCP
- Langfuse API + MCP vs LangSmith API + MCP
- Langfuse API + MCP vs Respan API + MCP
- LangSmith API + MCP vs LangWatch
- LangSmith API + MCP vs MLflow Tracing
- LangSmith API + MCP vs Navige
- LangSmith API + MCP vs Opik API + MCP
- LangSmith API + MCP vs Overmind
- LangSmith API + MCP vs Prefactor
- LangSmith API + MCP vs Pydantic Logfire
- LangSmith API + MCP vs W&B Weave
- LangWatch vs Respan API + MCP
- MLflow Tracing vs Respan API + MCP
- Opik API + MCP vs Respan API + MCP
- Overmind vs Respan API + MCP
- Prefactor vs Respan API + MCP
- Pydantic Logfire vs Respan API + MCP
- Respan API + MCP vs W&B Weave
- DeepEval vs LangSmith API + MCP
- DeepEval vs Respan API + MCP
- Gauge CLI vs LangSmith API + MCP
- Gauge CLI vs Respan API + MCP
- LangSmith API + MCP vs Plurai Simulation
- Plurai Simulation vs Respan API + MCP
- Navige vs Respan API + MCP
Machine-readable
- This page as Markdown
/compare/langsmith-vs-respan.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/langsmith.json·/api/v1/tools/respan.json - From a terminal
anchor compare langsmith respan(the CLI) - Over MCP
compare_tools {"a": "langsmith", "b": "respan"}at/mcp, no key