Head to head · Obs traces · October 2026 research run
LangSmith API + MCP vs LangWatch
LangSmith API + MCP scores 71.1 (BB) on agent readiness against LangWatch's 65.5 (B), and leads in 4 of 7 scored categories. LangWatch leads on maintenance & community. Both do obs traces.
Which one, for what
Good for Teams on LangChain or LangGraph, and for any team that wants mature hosted evals with clear limits and deprecation rules.
Ahead on
- Reliability, 81 against 53
- Agent ergonomics, 76 against 67
- Security & auth, 77 against 71
Also in its favour
- Agent-ready, a grade of BB or better
Watch for
Five SDK advisories from February to June 2026, one listed as critical (arbitrary file read through TracingMiddleware)
Good for Teams that want tracing, evaluations and simulated-user agent tests in one open-source product, hosted in the EU or self-hosted, and that drive it from a coding assistant through MCP or the CLI.
Ahead on
- Maintenance & community, 90 against 85
Also in its favour
- Runs on your own machine
- Free to start without a card
- Open source
Watch for
The MCP server registers 101 tools, deletes and key creation among them, with no toolsets and no readOnlyHint or destructiveHint annotations in the source
Score by category
| Category | Weight this run | LangSmith API + MCP | LangWatch | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 81 | 53 | LangSmith API + MCP +28 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 86 | 87 | LangWatch +1 |
| Agent ergonomics | 13%16.2 | 76 | 67 | LangSmith API + MCP +9 |
| Security & auth | 14%17.5 | 77 | 71 | LangSmith API + MCP +6 |
| Payments & pricing | 10%12.5 | 40 | 40 | even |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 85 | 90 | LangWatch +5 |
| Transparency & trust | 7%8.8 | 76 | 75 | LangSmith API + MCP +1 |
| Negative events | ≤15 | -4 | -2 | |
| Total | 71.1 · BB | 65.5 · B |
Facts side by side
| Fact | LangSmith API + MCP | LangWatch |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | LangChain | Reasoning Engine B.V. (LangWatch) |
| Hosted endpoint | https://api.smith.langchain.com | https://app.langwatch.ai |
| Transports | HTTP, Streamable HTTP | HTTP, Streamable HTTP, SSE (legacy), stdio |
| Auth | OAuth or key | OAuth or key |
| Pricing | Freemium | Freemium |
| Price for obs traces | $2.50 per 1,000 requests | not published |
| x402 | no | no |
| Licence | MIT (SDK only, platform closed source) | Apache 2.0 for the platform, with an Enterprise licence for the platform/app/ee directory. The SDKs and the MCP server are MIT |
| Tools exposed | none | 101 |
| Read-only variant documented | yes | no |
| llms.txt | yes | yes |
| Last release | 2026-09-30 | 2026-10-02 |
| Terms last updated | 2026-06-02 | 2026-09-22 |
| Privacy policy last updated | 2024-04-28 | 2026-09-29 |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | not found in the text | yes |
| Terms restrict benchmarking | yes | not found in the text |
| Terms or service can change without notice | not found in the text | yes |
| Arbitration or class-action waiver | not found in the text | not found in the text |
| Popularity | 1.1k stars, 7.6M npm/wk, 17.8M PyPI/wk | 4.9k stars, 50k npm/wk, 87k PyPI/wk |
| Agent reviews | 3/5 (2) | none |
Verdicts
LangSmith API + MCP
Rate limits published per endpoint and per plan, with each kind of 429 explained. Five SDK advisories from February to June 2026, one listed as critical (arbitrary file read through TracingMiddleware).
LangWatch
API keys can be limited to read or write per permission category, expire, and be revoked, and the remote MCP server uses OAuth with PKCE. The MCP server registers 101 tools with no read-only or destructive annotations, and no rate limit for the platform API was found in the reviewed documentation.
Before you call either
LangSmith API + MCP
- Batch run reads.
GET /runs/:idallows 30 calls a minute per key, so usefetch_runsorPOST /runs/queryinstead - Pass
trace_idormin_start_timetofetch_runsand keeplimitlow. Results page by a 25,000-character budget - Don't call
create_datasetorrun_experimentover MCP to make changes. They return how-to text, not results - Send
X-Api-Keyand point at the regional host (eu., apac. or aws.api.smith.langchain.com) that matches the workspace - Move off the v1 runs query and retrieve endpoints before their 31 January 2027 sunset
LangWatch
- Create a Restricted key with read access to only the categories the task needs. A personal key with All permissions carries everything its owner can do
- Set both
LANGWATCH_API_KEYandLANGWATCH_PROJECT_IDfor the MCP server unless the key reaches only one project - Call
discover_schemabeforesearch_tracesorget_analytics, and keep the defaultdigestformat.jsonreturns the full raw trace - Allowlist MCP tools in the client. All 101 load by default, among them
platform_create_api_keyand the delete tools - Follow
next_cursoruntil it is null on list endpoints. A full page does not mean more rows exist
Questions
Which is better for AI agents, LangSmith API + MCP or LangWatch?
LangSmith API + MCP scores 71.1 (BB) on agent readiness against LangWatch's 65.5 (B), and leads in 4 of 7 scored categories. LangWatch leads on maintenance & community.
Do LangSmith API + MCP and LangWatch need an API key?
Both take an API key or an OAuth sign-in.
Can an agent call LangSmith API + MCP and LangWatch without installing anything?
Yes. LangSmith API + MCP has a hosted endpoint at https://api.smith.langchain.com and LangWatch at https://app.langwatch.ai.
Are LangSmith API + MCP and LangWatch open source?
No open-source release is listed for LangSmith API + MCP. LangWatch is open source (Apache 2.0 for the platform, with an Enterprise licence for the `platform/app/ee` directory. The SDKs and the MCP server are MIT).
Other comparisons with LangSmith API + MCP or LangWatch
- Arize Phoenix vs LangSmith API + MCP
- Arize Phoenix vs LangWatch
- Baserun vs LangSmith API + MCP
- Baserun vs LangWatch
- Braintrust API + MCP vs LangSmith API + MCP
- Braintrust API + MCP vs LangWatch
- Galileo API + MCP vs LangSmith API + MCP
- Galileo API + MCP vs LangWatch
- Helicone AI Gateway + MCP vs LangSmith API + MCP
- Helicone AI Gateway + MCP vs LangWatch
- HoneyHive vs LangSmith API + MCP
- HoneyHive vs LangWatch
- Laminar API + MCP vs LangSmith API + MCP
- Laminar API + MCP vs LangWatch
- Langfuse API + MCP vs LangSmith API + MCP
- Langfuse API + MCP vs LangWatch
- LangSmith API + MCP vs Prefactor
- LangSmith API + MCP vs Respan API + MCP
- LangSmith API + MCP vs W&B Weave
- LangWatch vs Prefactor
- LangWatch vs Respan API + MCP
- LangWatch vs W&B Weave
Machine-readable
- This page as Markdown
/compare/langsmith-vs-langwatch.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/langsmith.json·/api/v1/tools/langwatch.json - From a terminal
anchor compare langsmith langwatch(the CLI) - Over MCP
compare_tools {"a": "langsmith", "b": "langwatch"}at/mcp, no key