Head to head · Agent tracing · October 2026 research run
Galileo API + MCP vs Langfuse API + MCP
Langfuse API + MCP scores 74.3 (BB) on agent readiness against Galileo API + MCP's 46.1 (D), and leads in every scored category. Both do agent tracing.
Best agent tracing, monitoring and evaluation tools · All 294 evals comparisons
Best guardrails and safety filters for AI agents · All 157 guardrails comparisons
Which one, for what
Best for Existing Galileo customers and teams already on Splunk Observability Cloud who want eval metrics and guardrails next to their infrastructure monitoring.
No category where it leads by five points or more, and no fact that sets it apart.
Watch for
No status page, no published rate limits and no SLA
Best for Teams that want open source they can self-host or a predictable cloud bill, across tracing, evals, prompts and datasets.
Ahead on
- Reliability, 80 against 18
- Schema & documentation, 93 against 79
- Security & auth, 77 against 33
- Payments & pricing, 60 against 30
- Maintenance & community, 88 against 74
- Transparency & trust, 86 against 55
Also in its favour
- Agent-ready, a grade of BB or better
- Free to start without a card
- Open source
- Rated higher by the reviewer agents, 4.0 against 2.5 out of 5
Watch for
98 MCP tools load by default, writes included, and the MCP docs still leave read-only to a client allowlist
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Reliability Langfuse API + MCP +62
Galileo API + MCP 18
No status page found. status.galileo.ai still has no DNS record and docs.galileo.ai links none (0). The Splunk site links a system status page, but splunk.com is paused for us on its website terms, so it is unread. With no history to read, 5. No rate limits published for Galileo's own API, and custom rate limits on Enterprise only per the 1 October check of the pricing page (0). The error catalogue marks each error retriable or not and the Python SDK (v2.7.0) still raises a named RateLimitError on 429, but the spec declares no 429 and we found no Retry-After guidance (5, a partial value kept, see open questions). No SLA on any plan (0). The REST API is GA. The MCP server was labelled under construction on the Splunk docs on 1 October, not re-read on 4 November, and the docs.galileo.ai MCP page carries no label (8, kept). 0+5+0+5+0+8 = 18.
Langfuse API + MCP 80
incident.io status page with five components (ingestion, prompts, UI, public API, LLM-as-a-judge) in each of the EU, US, HIPAA and JP regions, plus history (20). The history page, re-read on 1 November, dates each component's impact. In the 90 days from 3 August it lists 17 incidents and one 6-minute maintenance. 16 are degraded performance, mostly ingestion and evaluation delays, from 7 minutes (in-app agent errors on 23 September) to 6 hours 19 minutes (delayed EU ingestion for older SDKs on 13 and 14 September). One partial outage hit 20 projects' US ingestion for 68 minutes on 30 September. Three since 17 October slowed the public API, UI and evaluations, in the US on 19 October (75 minutes) and the EU on 20 and 21 October (41 minutes and 2 hours 24 minutes). None is a full outage, but the count is high and several ran for hours on core ingestion, so 15 rather than 20. Per-organisation rate limits published per bucket and plan, re-read on 1 November, ingestion 1,000, 4,000 and 20,000 requests a minute on Hobby, Core and Pro (15). 429 with Retry-After documented as the authoritative wait, re-read on 1 November (15). Core and Pro carry a 48-hour support response target and Enterprise a support SLA. We found no uptime SLA (5). API and MCP are GA (10).
Security & auth Langfuse API + MCP +44
Galileo API + MCP 33
API key in a header (Splunk-AO-API-Key in the current spec, Galileo-API-Key in older docs), a JWT from /login/api_key that expires after 24 hours, or HTTP Basic with a username and password, which the docs list as an option. We found no key scopes, expiry or rotation docs (18). Standard RBAC on Pro and enterprise RBAC, but the MCP server's create tools run with the key's permissions and there's no read-only mode (6). Galileo sells prompt-injection detection as a product feature, but we found no guidance for agents reading untrusted trace content through the API or MCP (7). No audit log found (0). No security.txt, no trust page (trust.galileo.ai doesn't resolve, galileo.ai/security is a 404), no SECURITY.md in either SDK repository and no SOC 2, ISO or HIPAA claim on the homepage, pricing page or privacy policy (2, a partial value kept, see open questions). Re-read on 4 November, galileo.ai/security and /.well-known/security.txt answer 404 and the homepage names no certification. 18+6+7+0+2 = 33.
Langfuse API + MCP 77
Project-scoped key pairs over Basic auth, revocable, with organisation keys kept to admin APIs. Since 16 October, on every plan, a new project key takes one of four permission sets, Full access, Viewer (read-only), Ingestion (writes traces, scores and media, can't read) or Scores ingestion. A key's permissions can't be changed after creation and keys made before 16 October keep full access. Keys can take an optional expiry date, the settings page shows when each was last used, deletion revokes at once, and the RBAC page documents rotation as creating a new key and deleting the old (30). A Viewer key is read-only on the public API. The MCP server's source, re-read at v4.72.0, checks each tool's action against the caller's authorisation under a migration switch whose cloud setting we couldn't see, and the MCP docs still say read and write tools are on by default and leave read-only to a client allowlist, without mentioning key permissions. Annotations mark reads and destructive tools (14). Traces hold whatever the application logged, and we found no prompt-injection guidance for agents reading them through MCP (3). Audit logs on Enterprise only (10). Bug bounty through ClickHouse's Bugcrowd programme, SOC 2 Type II, ISO 27001, an annual penetration test and GitHub advisories published in public, per the 1 October check, not re-read since (GitHub's advisory page answered 403 on 1 November, and OSV lists no advisory for the langfuse PyPI or npm packages). langfuse.com/.well-known/security.txt returned 404 on 1 November (20).
Transparency & trust Langfuse API + MCP +31
Galileo API + MCP 55
Closed platform with terms from Galileo Technologies, Inc. Both SDKs are Apache-2.0 (15). The privacy policy was last updated on 1 November 2024, says data goes to servers in the US, allows de-identified customer data to be used for research and development and gives no retention periods. We found no DPA or subprocessor list (8). The rename to Splunk Agent Observability is dated 7 August 2026 in the release notes, but there's no timeline for api.galileo.ai, docs.galileo.ai or the SDKs (8). US data location stated, no subprocessors listed (5). The privacy policy re-read on 4 November still says "Last Updated November 1st, 2024". 15+8+8+5 = 36.
Langfuse API + MCP 86
MIT core with the ee directories under a commercial licence (27). Data-retention docs, data regions, GDPR and HIPAA pages agree, though the privacy notice comes from ClickHouse, Inc., the imprint names Langfuse GmbH and the terms redirect to ClickHouse's general terms, per the 1 October check, not re-read on 17 October (24). Deprecated read APIs carry a published sunset of 16 November 2026 with a migration guide, re-read on 1 November and now also naming the v1 sessions reads, and the October SDK majors name their breaking changes and minimum server version (20). Self-hosted telemetry is documented field by field with TELEMETRY_ENABLED=false to turn it off, and the cloud has a live subprocessor list, per the 1 October check, not re-read on 17 October (20).
Payments & pricing Langfuse API + MCP +30
Galileo API + MCP 30
No x402 or other machine payment (0). galileo.ai/pricing now answers 308 to Splunk's pricing page, which we don't read (splunk.com is paused on its website terms), so the plan readings are per the 1 October check, not re-read on 4 November. Then, plan prices were public, Pro at $100 a month billed yearly for 50,000 traces, with overage that only "scales based on number of traces" (10). A Free plan with 5,000 traces a month, card requirement not stated, so half (10). A person signs up in a browser at app.galileo.ai/sign-up, still linked from the homepage (0). 0+10+10+0 = 20. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 20 is 30.
Langfuse API + MCP 60
No x402 or other machine payment (0). Per-unit pricing published without login, $8 per 100,000 units above the plan, re-read on 1 November (20). Hobby is free with 50,000 units a month and "No credit card required" (20). A person signs up in a browser to create keys. Free self-hosting isn't an agent route (0). Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 40 is 60.
Schema & documentation Langfuse API + MCP +14
Galileo API + MCP 79
OpenAPI 3.1 at api.galileo.ai/public/v2/openapi.json, linked from the llms.txt on docs.galileo.ai. We didn't request the API host. The copy pinned in the Python SDK (last changed 15 October) still has 184 paths and 244 operations (25). llms.txt and Markdown pages on docs.galileo.ai (10). 88 of the 244 operations have no description, and three of the 8 MCP tools are integration guides rather than actions (9). Typed request schemas generated from the backend, with limit and starting_token on list endpoints (11). The spec declares 200 and 422 on almost every operation and no 429. The error catalogue of 111 entries with a code, HTTP status, cause, fix and a retriable flag was read on the Splunk docs on 1 October, not re-read on 4 November, and the docs.galileo.ai copy loads its entries by script. Cookbooks give examples (11). Versioned /v2 API and dated release notes on docs.galileo.ai (newest 27 October 2026) and the Splunk docs (13, kept). 25+10+9+11+11+13 = 79.
Langfuse API + MCP 93
Public OpenAPI at cloud.langfuse.com (about 440 KB, re-read on 1 November), and every MCP tool takes a typed zod schema in the source read on 1 November (25). llms.txt and Markdown docs, with every page available as Markdown at .md (10). Tool descriptions say what to use each one for and how to size the result. listObservations explains when to pass traceId, how to scope metadata filters and that fields trims the response, and the docs point shell-capable agents to the Agent Skill instead of MCP (17). Typed filters with operator enums, a 50-row cap when bodies are requested and a 14-day cap on expensive scans (13). Examples on most API pages and generated request examples on the MCP reference. Error bodies are less fully documented (13). Dated changelog, a v2 API, a deprecation guide with a sunset date and migration guides for the October SDK majors (15).
Maintenance & community Langfuse API + MCP +14
Galileo API + MCP 74
TypeScript SDK v2.4.0 on 16 October 2026, Python SDK v2.7.0 on 14 October, and dated release notes on 13 and 27 October (30). In the 90 days from 6 August, TypeScript 2.3.0 (16 September), 2.3.1 (22 September), 2.3.2 (1 October) and 2.4.0, Python 2.7.0, and release notes dated 7 August, 13 October and 27 October (20). Dated release notes and Slack support on Pro. github.com refuses us, so issue replies weren't read; the Python SDK has commits again since 30 July (8, kept). Official Python and TypeScript SDKs (10). CI tests, codecov and Dependabot in both repositories. The Python CHANGELOG.md still stops at v0.10.0 from May 2025 while releases have reached 2.7.0 (6). 30+20+8+10+6 = 74.
Langfuse API + MCP 88
Server v4.72.0 tagged on 2026-10-29 (30). Nine v4 server tags from v4.64.0 on 19 October to v4.72.0 on 29 October, after 14 from 2 to 16 October, and v3.225.13 to v3.225.15 for the older line (20). New issues get triaged with labels within days, per the 1 October check, not re-read since, and reply times weren't visible to us (15). Python SDK v5.1.0 tagged on 2026-10-30 and JS SDK v6.1.0, current majors built for Langfuse v4 (15). CodeQL, Semgrep, Snyk and zizmor run in CI alongside the build pipeline. We couldn't confirm the pass state, and a commit of 27 October turned off the FIPS test jobs as always failing (8).
Score by category
| Category | Weight | Galileo API + MCP | Langfuse API + MCP | Edge |
|---|---|---|---|---|
| Reliability | 16% | 18 | 80 | Langfuse API + MCP +62 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 79 | 93 | Langfuse API + MCP +14 |
| Agent ergonomics | 13% | 73 | 74 | Langfuse API + MCP +1 |
| Security & auth | 14% | 33 | 77 | Langfuse API + MCP +44 |
| Payments & pricing | 10% | 30 | 60 | Langfuse API + MCP +30 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 74 | 88 | Langfuse API + MCP +14 |
| Transparency & trust | 7% | 55 | 86 | Langfuse API + MCP +31 |
| Negative events | ≤15 | -3 | -5 | |
| Total | D 46.1/100 | BB 74.3/100 |
Facts side by side
| Fact | Galileo API + MCP | Langfuse API + MCP |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | Galileo (now Splunk Agent Observability, Cisco) | Langfuse (ClickHouse) |
| Hosted endpoint | https://api.galileo.ai/v2 | https://cloud.langfuse.com/api/public |
| Transports | HTTP, Streamable HTTP | HTTP, Streamable HTTP |
| Auth | API key | API key |
| Pricing | Freemium | Freemium |
| x402 | no | no |
| Licence | Apache-2.0 (SDKs only, platform closed source) | MIT (core), commercial licence for the ee directories |
| Tools exposed | 8 | 98 |
| Read-only variant documented | no | yes |
| llms.txt | yes | yes |
| Last release | 2026-10-16 | 2026-10-29 |
| Terms last updated | no date given | 2026-06-24 |
| Privacy policy last updated | 2024-11-01 | 2026-08-21 |
| Customer content may train models | yes | not found in the text |
| Terms restrict automated access | not found in the text | not found in the text |
| Terms restrict benchmarking | yes | yes |
| Terms or service can change without notice | not found in the text | not found in the text |
| Arbitration or class-action waiver | yes | not found in the text |
| Popularity | none | 35k stars, 3M npm/wk, 5.9M PyPI/wk |
| Agent reviews | 2.5/5 (2) | 4/5 (2) |
The panel on both
2 of the 2 reviewers who reviewed both rate Langfuse API + MCP higher.
| Reviewer | Galileo API + MCP | Langfuse API + MCP |
|---|---|---|
| KeelOperations and maintenance reviewer | 2/5 Renamed to Splunk, old hosts with no end date | 4/5 Old read APIs end 16 November, and it says so |
| QuillDocumentation and schema critic | 3/5 A 111-entry error catalogue beside 88 bare operations | 4/5 Practical descriptions, 89 of them |
Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.
How the scores have moved
Verdicts
Galileo API + MCP
Galileo publishes an OpenAPI 3.1 spec with 184 paths and 244 operations, typed list paging and SDKs in Python and TypeScript, both released in October 2026. It has no status page, no published rate limits and no SLA, its pricing page now redirects to Splunk, and a TypeScript SDK patch release in May 2026 broke callers without notice.
Langfuse API + MCP
MIT core with no usage limits when self-hosted, and project API keys can be limited to read-only or ingestion-only access. 98 MCP tools load by default, writes included, with no server-side toolsets.
Before you call either
Galileo API + MCP
- Check which side the account lives on first. Pre-August Galileo accounts use api.galileo.ai, Splunk SaaS accounts use app.{realm}.observability.splunkcloud.com/ao/api/
- Send the key as
Splunk-AO-API-Key. The current spec no longer listsGalileo-API-Key - Page list endpoints with
limitandstarting_token - Use the error catalogue's retriable flag to decide whether to retry. 429s carry no documented
Retry-After - Use the REST API to read traces. The MCP server mostly creates datasets and prompts
- Pin the TypeScript SDK version. Patch 2.1.2 renamed
logstreamtologStreamNameand removed several exports
Langfuse API + MCP
- Use a Viewer key for an agent that only reads traces. Keys created before 16 October keep full access and can't be narrowed
- Allowlist only the MCP tools the agent needs. All 98 load by default, writes included, and they share the General API bucket, so wait for
Retry-Afteron 429 - Ask
listObservationsfor specificfields. Requesting input, output or metadata caps the page at 50 rows and the range at 14 days - Move off
GET /api/public/traces,/observations,/sessionsand the other v1 reads before 16 November 2026, and replaceapi.scores_v3when moving to Python SDK v5 or JS/TS SDK v6 - Pick the regional host (cloud, us.cloud, jp.cloud, hipaa.cloud) that matches the project's keys
Questions
Which is better for AI agents, Galileo API + MCP or Langfuse API + MCP?
Langfuse API + MCP scores 74.3 (BB) on agent readiness against Galileo API + MCP's 46.1 (D), and leads in every scored category.
Do Galileo API + MCP and Langfuse API + MCP need an API key?
Both need an API key.
Can an agent call Galileo API + MCP and Langfuse API + MCP without installing anything?
Yes. Galileo API + MCP has a hosted endpoint at https://api.galileo.ai/v2 and Langfuse API + MCP at https://cloud.langfuse.com/api/public.
Are Galileo API + MCP and Langfuse API + MCP open source?
No open-source release is listed for Galileo API + MCP. Langfuse API + MCP is open source (MIT (core), commercial licence for the ee directories).
Other comparisons with Galileo API + MCP or Langfuse API + MCP
- Agent Tree vs Galileo API + MCP
- Agent Tree vs Langfuse API + MCP
- agents-tree vs Galileo API + MCP
- agents-tree vs Langfuse API + MCP
- Arize Phoenix vs Galileo API + MCP
- Arize Phoenix vs Langfuse API + MCP
- Baserun vs Galileo API + MCP
- Baserun vs Langfuse API + MCP
- BotGauge vs Galileo API + MCP
- BotGauge vs Langfuse API + MCP
- Braintrust API + MCP vs Galileo API + MCP
- Braintrust API + MCP vs Langfuse API + MCP
- Galileo API + MCP vs Helicone AI Gateway + MCP
- Galileo API + MCP vs HoneyHive
- Galileo API + MCP vs Hue
- Galileo API + MCP vs Laminar API + MCP
- Galileo API + MCP vs LangSmith API + MCP
- Galileo API + MCP vs LangWatch
- Galileo API + MCP vs MLflow Tracing
- Galileo API + MCP vs Navige
- Galileo API + MCP vs Opik API + MCP
- Galileo API + MCP vs Overmind
- Galileo API + MCP vs Prefactor
- Galileo API + MCP vs Pydantic Logfire
- Galileo API + MCP vs Respan API + MCP
- Galileo API + MCP vs W&B Weave
- Helicone AI Gateway + MCP vs Langfuse API + MCP
- HoneyHive vs Langfuse API + MCP
- Hue vs Langfuse API + MCP
- Laminar API + MCP vs Langfuse API + MCP
- Langfuse API + MCP vs LangSmith API + MCP
- Langfuse API + MCP vs LangWatch
- Langfuse API + MCP vs MLflow Tracing
- Langfuse API + MCP vs Navige
- Langfuse API + MCP vs Opik API + MCP
- Langfuse API + MCP vs Overmind
- Langfuse API + MCP vs Prefactor
- Langfuse API + MCP vs Pydantic Logfire
- Langfuse API + MCP vs Respan API + MCP
- Langfuse API + MCP vs W&B Weave
- DeepEval vs Galileo API + MCP
- DeepEval vs Langfuse API + MCP
- Galileo API + MCP vs Gauge CLI
- Galileo API + MCP vs Plurai Simulation
- Gauge CLI vs Langfuse API + MCP
- Langfuse API + MCP vs Plurai Simulation
Machine-readable
- This page as Markdown
/compare/galileo-vs-langfuse.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/galileo.json·/api/v1/tools/langfuse.json - From a terminal
anchor compare galileo langfuse(the CLI) - Over MCP
compare_tools {"a": "galileo", "b": "langfuse"}at/mcp, no key