{ "data": { "a": { "slug": "mlflow-tracing", "name": "MLflow Tracing", "vendor": "MLflow Project (LF Projects, LLC)", "vendorUrl": "https://mlflow.org", "kind": "http-api", "category": "agent-observability", "summary": "Open-source tracing, evaluation and prompt management for LLM applications and agents, part of MLflow, a Linux Foundation project. Owners run the server themselves, and agents read and annotate traces through an experimental MCP server or the `mlflow traces` CLI.", "url": "https://www.anchorterminal.com/tools/mlflow-tracing", "markdownUrl": "https://www.anchorterminal.com/tools/mlflow-tracing.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/mlflow-tracing.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/mlflow-tracing.json", "repo": "https://github.com/mlflow/mlflow", "license": "Apache-2.0", "transports": [ "stdio", "http" ], "packages": [ { "registry": "pypi", "name": "mlflow" }, { "registry": "pypi", "name": "mlflow-tracing" }, { "registry": "npm", "name": "@mlflow/core" } ], "auth": "mixed", "authNotes": "No authentication on a default server. Starting it with `mlflow server --app-name basic-auth` requires a username and password on every request, with role-based access control and no default admin password. The MCP server is a local stdio process that reads `MLFLOW_TRACKING_URI` and the MLflow credential environment variables, such as `MLFLOW_TRACKING_USERNAME` and `MLFLOW_TRACKING_PASSWORD`. Single sign-on needs a community plugin or a reverse proxy.", "pricing": "free", "pricingNotes": "Free to self-host under Apache-2.0, with no account or contract. The owner pays for compute, a database and artifact storage. The MLflow project sells nothing. Its README links managed MLflow from Databricks, Amazon SageMaker, Azure ML and Nebius, whose prices were not read (checked 2026-10-09).", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the repository docs or the MCP server source (checked 2026-10-09).", "endpoints": [] }, "toolCount": 26, "popularity": { "githubStars": 28320, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-09" }, "docsUrl": "https://mlflow.org/docs/latest/genai/", "llmsTxt": "https://mlflow.org/docs/latest/llms.txt", "capabilities": [ "obs.traces", "obs.evals", "obs.prompts", "obs.datasets", "obs.gateway" ], "tags": [ "open-source", "self-hosted", "local", "apache-2.0", "mcp", "cli", "opentelemetry", "llms-txt", "python", "typescript", "linux-foundation" ], "lastRelease": "2026-10-06", "graded": true, "anchor": { "graded": true, "score": 61.2, "grade": "C", "agentReady": false, "rank": 476, "ranked": true, "rankOf": 950, "categoryRank": 10, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 72, "maintenance": 88, "payments": 60, "reliability": 76, "schema": 78, "security": 40, "transparency": 62 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-09" }, "negative": -6, "negativeNotes": [ "2026-10-09: GHSA-26p8-2jq9-3vq9, critical, remote code execution on MLflow servers without authentication through third-party scorer deserialisation, affecting 3.12.0rc0 up to 3.17.0 and patched in 3.17.0 of 6 October. Four more advisories were published between 27 July and 4 August 2026, among them GHSA-7gwp-5pfp-969j, a high-severity unauthenticated SSRF in webhook delivery patched in 3.15.0. All are published with fixes, so the deduction is reduced (https://github.com/mlflow/mlflow/security/advisories)" ], "verdict": "Apache-2.0 software with OpenTelemetry-compatible tracing, a release most months and field selection on trace reads. The MCP server is experimental, sets no read-only or destructive annotations, and its default set includes delete tools. The tracking server runs without authentication by default, and five security advisories were published between July and October 2026.", "bestFor": "Teams that already run MLflow or want Apache-2.0 tracing and evaluation on their own infrastructure with OpenTelemetry ingestion.", "strengths": [ "Apache-2.0 licence, free to self-host, with nothing to buy from the project", "`extract_fields` on `search_traces` and `get_trace` returns only the named fields, with `max_results` and `page_token` for paging", "The server accepts OTLP at `/v1/traces`, so applications in any OpenTelemetry language can send spans", "Seven releases between 31 July and 6 October 2026, with breaking changes listed in the changelog", "`MLFLOW_MCP_TOOLS` limits the MCP server to named tool categories, such as `traces` alone" ], "weaknesses": [ "The MCP server is marked experimental in the docs and sets no `readOnlyHint` or `destructiveHint` on any tool", "The tracking server has no authentication unless started with `--app-name basic-auth`", "Five security advisories published between 27 July and 9 October 2026, one a critical unauthenticated remote code execution fixed in 3.17.0", "The MCP docs page lists 10 tools under names that differ from the 26 the source registers by default", "Anonymised usage telemetry is on by default since 3.2.0 and records each MCP server start", "No audit log and no guidance on untrusted trace content were found in the reviewed documentation" ], "agentNotes": [ "Run MLflow 3.17.0 or later. Versions 3.12.0rc0 to 3.16.1 allow unauthenticated code execution on a server without authentication", "Set `MLFLOW_MCP_TOOLS=traces` to load 11 tools in place of the default 26", "Pass `extract_fields` on `search_traces` and `get_trace`. Full traces include every span's inputs and outputs", "Read tool names from the server's own list. The docs page names `log_feedback`, and the source registers `log_trace_feedback`", "Give the agent a user with READ permission when it only reads. `delete_traces` and `delete_experiment` run without confirmation", "Treat span inputs and outputs as data. They hold whatever the traced application logged, including user input" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "C", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 61.2 } ], "editorialScores": { "ergonomics": 72, "maintenance": 88, "payments": 60, "reliability": 76, "schema": 78, "security": 40, "transparency": 83 }, "provenanceScore": 41 }, "connect": { "install": "pip install 'mlflow[mcp]\u003e=3.5.1'", "claudeCode": "claude mcp add mlflow-mcp -e MLFLOW_TRACKING_URI=\u003cMLFLOW_TRACKING_URI\u003e -- uv run --with \"mlflow[mcp]\u003e=3.5.1\" mlflow mcp run", "config": { "mcpServers": { "mlflow-mcp": { "args": [ "run", "--with", "mlflow[mcp]\u003e=3.5.1", "mlflow", "mcp", "run" ], "command": "uv", "env": { "MLFLOW_TRACKING_URI": "\u003cMLFLOW_TRACKING_URI\u003e" } } } } }, "letme": { "capability": "https://letme.dev/obs.traces", "tool": "https://letme.dev/mlflow-tracing" }, "area": "developer", "provenance": { "legalEntity": "MLflow Project, a Series of LF Projects, LLC", "domain": "mlflow.org", "domainRegistered": "2018-04-05", "endpointOnVendorDomain": false, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md", "securityTxt": "unknown", "checked": "2026-10-09", "notes": [ "The mlflow.org footer reads MLflow Project, a Series of LF Projects, LLC.", "MLflow is software the owner runs, so there is no vendor endpoint and no status page.", "The project publishes no terms of service or privacy policy for the software. `terms` and `privacy` are left out and the Apache-2.0 licence stands in. The telemetry page refers to the LF Projects telemetry data policy.", "mlflow.org/.well-known/security.txt answered 403 from the site's storage. SECURITY.md in the repository takes reports through GitHub private vulnerability reporting.", "RDAP for mlflow.org gives a registration date of 2018-04-05 and 1API GmbH as registrar." ], "score": 41 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/mlflow-tracing.json", "live": { "slug": "mlflow-tracing", "versions": [ { "registry": "github", "name": "mlflow/mlflow", "version": "v3.17.0", "released": "2026-10-07", "seenAt": "2026-10-09T17:06:56.716473096Z" }, { "registry": "npm", "name": "@mlflow/core", "version": "0.4.0", "seenAt": "2026-10-09T17:06:55.82052791Z" }, { "registry": "pypi", "name": "mlflow", "version": "3.17.0", "released": "2026-10-07", "seenAt": "2026-10-09T17:06:53.813494162Z" }, { "registry": "pypi", "name": "mlflow-tracing", "version": "3.17.0", "released": "2026-10-07", "seenAt": "2026-10-09T17:06:53.928988136Z" } ], "githubStars": 28331, "npmWeekly": 15392, "pypiWeekly": 4590348, "pages": [ { "url": "https://raw.githubusercontent.com/mlflow/mlflow/master/CHANGELOG.md", "kind": "changelog", "status": 200, "checkedAt": "2026-10-09T18:45:35.157905643Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "81678c02de88" } ], "updatedAt": "2026-10-09T18:45:35.157905643Z" } }, "answer": "W\u0026B Weave scores 66.7 (B) on agent readiness against MLflow Tracing's 61.2 (C), and leads in 2 of 7 scored categories. MLflow Tracing leads on reliability and payments \u0026 pricing.", "b": { "slug": "wandb-weave", "name": "W\u0026B Weave", "vendor": "Weights \u0026 Biases (CoreWeave)", "vendorUrl": "https://wandb.ai", "kind": "http-api", "category": "agent-observability", "summary": "W\u0026B Weave is CoreWeave Forge's tracing and evaluation service for LLM applications and agents. It takes traces from Python and TypeScript SDKs or an OTLP endpoint and exposes them through a REST Service API.", "url": "https://www.anchorterminal.com/tools/wandb-weave", "markdownUrl": "https://www.anchorterminal.com/tools/wandb-weave.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/wandb-weave.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/wandb-weave.json", "repo": "https://github.com/wandb/weave", "license": "Hosted service under the W\u0026B Master Service Agreement. The Weave SDKs and trace server source on GitHub are Apache-2.0, and the W\u0026B MCP server is MIT", "transports": [ "http", "streamable-http" ], "remoteUrl": "https://trace.wandb.ai", "packages": [ { "registry": "pypi", "name": "weave" }, { "registry": "npm", "name": "weave" } ], "auth": "api-key", "authNotes": "A Forge API key, created by a signed-in user at forge.coreweave.com/settings after signing up at id.coreweave.com/signup. The Service API takes it as `Authorization: Bearer`, the OTLP endpoints as a `wandb-api-key` header or HTTP Basic with user `api`. Personal keys reach every organisation the user belongs to. Service account keys are limited to one team or one organisation. Keys carry no per-permission scopes, the secret is shown once, and deleting a key revokes it at once.", "pricing": "freemium", "pricingNotes": "Free is $0 a month with 1 GB of Weave data ingestion. Pro starts at $60 a month with 1.5 GB, a 30 day trial and further ingestion at $0.10 per MB, billed in arrears. Enterprise is quoted, with further ingestion listed at $0.20 per MB and volume discounts on annual commitments. Ingested bytes are counted once when stored. The pricing page doesn't say whether Free needs a card (checked 2026-10-08).", "priceSummary": "$60 / mo", "where": "hosted", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the Weave docs, the OpenAPI document or the pricing page (checked 2026-10-08).", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": null, "npmWeekly": 623550, "pypiWeekly": 219442, "asOf": "2026-10-08" }, "docsUrl": "https://docs.coreweave.com/products/wandb/weave", "llmsTxt": "https://docs.coreweave.com/llms.txt", "openapi": "https://trace.wandb.ai/openapi.json", "capabilities": [ "obs.traces", "obs.evals", "obs.prompts", "obs.datasets" ], "tags": [ "hosted", "freemium", "open-source", "self-hosted", "mcp", "llms-txt", "openapi", "opentelemetry", "python", "typescript", "status-page", "soc2" ], "lastRelease": "2026-09-25", "graded": true, "anchor": { "graded": true, "score": 66.7, "grade": "B", "agentReady": false, "rank": 280, "ranked": true, "rankOf": 950, "categoryRank": 4, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 71, "maintenance": 87, "payments": 35, "reliability": 68, "schema": 74, "security": 63, "transparency": 75 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-08" }, "negative": 0, "verdict": "The Service API at trace.wandb.ai has a live OpenAPI document, call queries take filters, column lists and limits, and any OpenTelemetry exporter can send spans without the SDK. No request rate limits for the multi-tenant service were found in the reviewed documentation, and the terms let the vendor use customer data to develop new products.", "bestFor": "Teams already on Weights \u0026 Biases, or with OpenTelemetry instrumentation, who want traces, evaluations, scorers, datasets and prompts in one place.", "strengths": [ "A live OpenAPI 3.1 document at `https://trace.wandb.ai/openapi.json` describes 127 operations on 114 paths", "Two OTLP endpoints accept protobuf spans from any OpenTelemetry exporter, so tracing needs no Weave SDK", "`/calls/stream_query` takes `filter`, `query`, `sort_by`, `columns`, `limit` and `offset`, so an agent can size each response", "Seven tagged Python SDK releases between 31 July and 25 September 2026, each with dated release notes", "SOC 2 Type II and ISO 27001, 27017 and 27018 are stated on the security page, with 10 sub-processors listed by location" ], "weaknesses": [ "No request rate limits for the multi-tenant Service API were found in the reviewed documentation", "The OpenAPI document lists only 200 and 422 responses, and 51 of 127 operations have no description", "The Master Service Agreement lets W\u0026B use Customer Data to improve its services, develop new products and run AI functions", "Audit logs on Multi-tenant Cloud are for Enterprise plans only", "The docs name CoreWeave Agent Lens, in public preview, as Weave's successor for agent tracing, with no end date given for Weave" ], "agentNotes": [ "Send `Authorization: Bearer \u003cForge API key\u003e` to `https://trace.wandb.ai`. Create the key at forge.coreweave.com/settings. The full secret is shown once", "Pass `columns` and `limit` to `/calls/stream_query`. Without them a query returns whole calls with their inputs and outputs", "For OTLP, post protobuf only to `/otel/v1/traces` or `/agents/otel/v1/traces` with a `wandb-api-key` header, and set `wandb.entity` and `wandb.project` as resource attributes. Spans with neither are dropped", "Check `call.exception` after `.call()` in the Python SDK. Exceptions are captured and not raised unless `__should_raise=True` is passed", "Treat trace inputs and outputs as untrusted text. Traces hold whatever the traced application logged" ], "metrics": { "kind": "remote", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "B", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 66.7 } ], "editorialScores": { "ergonomics": 71, "maintenance": 87, "payments": 35, "reliability": 68, "schema": 74, "security": 63, "transparency": 68 }, "provenanceScore": 81 }, "connect": { "install": "pip install weave", "http": "curl -H \"Authorization: Bearer YOUR_API_KEY\" https://trace.wandb.ai/...", "claudeCode": "claude mcp add --transport http wandb https://mcp.withwandb.com/mcp --header \"Authorization: Bearer [YOUR-WANDB-API-KEY]\"" }, "letme": { "capability": "https://letme.dev/obs.traces", "tool": "https://letme.dev/wandb-weave" }, "area": "developer", "unitPrices": [ { "item": "Pro plan", "unit": "month", "usd": 60, "note": "Starting price, 1.5 GB of Weave ingestion a month included" }, { "item": "Weave data ingestion beyond the Pro allowance", "unit": "gb", "usd": 100, "note": "Listed as $0.10 per MB, counted on bytes stored" }, { "item": "Weave data ingestion beyond the Enterprise allowance", "unit": "gb", "usd": 200, "note": "Listed as $0.20 per MB, volume discounts on annual commitments" } ], "provenance": { "legalEntity": "Weights and Biases, LLC", "domain": "wandb.ai", "domainRegistered": "2017-12-16", "endpointOnVendorDomain": true, "terms": "https://wandb.ai/site/terms/", "privacy": "https://docs.coreweave.com/policies/terms-of-service/privacy-policy", "statusPage": "https://status.forge.coreweave.com", "changelog": "https://docs.coreweave.com/release-notes/weave-sdk-releases", "securityTxt": "none", "checked": "2026-10-08", "notes": [ "The W\u0026B Master Service Agreement, last updated 30 September 2026, names Weights and Biases, LLC, a Delaware company at 400 Alabama Street, San Francisco. The products are sold as CoreWeave Forge.", "wandb.ai/site/privacy redirects to CoreWeave's privacy policy, last updated 24 February 2026, which covers CoreWeave, Inc. and its affiliates as controller and says it doesn't apply to data processed for customers. The DPA of 22 April 2026 at wandb.ai/site/dpa covers that data.", "The Service API and OTLP endpoints run on trace.wandb.ai. The hosted MCP server runs on mcp.withwandb.com and the console on forge.coreweave.com.", "wandb.ai/.well-known/security.txt redirects to a Forge page that answers \"Invalid .well-known request\", and coreweave.com/.well-known/security.txt returns 404. The security page takes reports at security@coreweave.com.", "status.wandb.com, which the SLA cites, redirects to status.forge.coreweave.com.", "RDAP for wandb.ai gives a registration date of 2017-12-16." ], "score": 81 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/wandb-weave.json", "live": { "slug": "wandb-weave", "probe": { "target": "https://trace.wandb.ai", "method": "get", "lastAt": "2026-10-10T03:53:49.284569519Z", "lastOk": true, "lastStatus": 200, "lastMs": 150, "authRequired": false, "uptime24h": 100, "uptime30d": 100, "p50ms24h": 158, "p95ms24h": 256, "samples24h": 209, "samples30d": 209, "days": [ { "date": "2026-10-09", "probes": 169, "ok": 169 }, { "date": "2026-10-10", "probes": 40, "ok": 40 } ] }, "vendorStatus": { "page": "https://status.forge.coreweave.com", "indicator": "none", "summary": "All Systems Operational", "checkedAt": "2026-10-10T03:58:51.751691855Z" }, "versions": [ { "registry": "github", "name": "wandb/weave", "version": "v0.53.7", "released": "2026-08-27", "seenAt": "2026-10-09T17:27:53.258591534Z" }, { "registry": "npm", "name": "weave", "version": "0.16.9", "seenAt": "2026-10-09T17:27:52.837142312Z" }, { "registry": "pypi", "name": "weave", "version": "0.53.11", "released": "2026-09-25", "seenAt": "2026-10-09T17:27:52.727741744Z" } ], "githubStars": 1138, "npmWeekly": 428168, "pypiWeekly": 212213, "securityTxt": { "url": "https://wandb.ai/.well-known/security.txt", "state": "none", "checkedAt": "2026-10-09T15:39:31.530708699Z" }, "llmsTxt": { "url": "https://docs.coreweave.com/llms.txt", "ok": true, "status": 200, "checkedAt": "2026-10-09T14:03:01.59802993Z" }, "pages": [ { "url": "https://docs.coreweave.com/release-notes/weave-sdk-releases", "kind": "changelog", "status": 200, "checkedAt": "2026-10-09T18:37:10.023968425Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "03a899e50832" }, { "url": "https://wandb.ai/site/terms/", "kind": "terms", "status": 200, "checkedAt": "2026-10-09T18:47:17.126017694Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "40c195d30475" } ], "updatedAt": "2026-10-10T03:58:51.751691855Z" } }, "facts": [ { "a": "HTTP API", "b": "HTTP API", "name": "Kind" }, { "a": "MLflow Project (LF Projects, LLC)", "b": "Weights \u0026 Biases (CoreWeave)", "name": "Vendor" }, { "a": "no (local only)", "b": "https://trace.wandb.ai", "name": "Hosted endpoint" }, { "a": "stdio, HTTP", "b": "HTTP, Streamable HTTP", "name": "Transports" }, { "a": "OAuth or key", "b": "API key", "name": "Auth" }, { "a": "Free", "b": "Freemium", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "Apache-2.0", "b": "Hosted service under the W\u0026B Master Service Agreement. The Weave SDKs and trace server source on GitHub are Apache-2.0, and the W\u0026B MCP server is MIT", "name": "Licence" }, { "a": "26", "b": "none", "name": "Tools exposed" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "yes", "b": "yes", "name": "llms.txt" }, { "a": "2026-10-06", "b": "2026-09-25", "name": "Last release" }, { "a": "no document linked", "b": "2026-09-30", "name": "Terms last updated" }, { "a": "no document linked", "b": "2026-02-24", "name": "Privacy policy last updated" }, { "a": "", "b": "not found in the text", "name": "Customer content may train models" }, { "a": "", "b": "yes", "name": "Terms restrict automated access" }, { "a": "", "b": "yes", "name": "Terms restrict benchmarking" }, { "a": "", "b": "not found in the text", "name": "Terms or service can change without notice" }, { "a": "", "b": "yes", "name": "Arbitration or class-action waiver" }, { "a": "28k stars", "b": "624k npm/wk, 219k PyPI/wk", "name": "Popularity" } ], "faq": [ { "answer": "W\u0026B Weave scores 66.7 (B) on agent readiness against MLflow Tracing's 61.2 (C), and leads in 2 of 7 scored categories. MLflow Tracing leads on reliability and payments \u0026 pricing.", "question": "Which is better for AI agents, MLflow Tracing or W\u0026B Weave?" }, { "answer": "MLflow Tracing takes an API key or an OAuth sign-in. W\u0026B Weave needs an API key.", "question": "Do MLflow Tracing and W\u0026B Weave need an API key?" }, { "answer": "MLflow Tracing runs on your own machine, with no hosted endpoint listed. W\u0026B Weave has a hosted endpoint at https://trace.wandb.ai.", "question": "Can an agent call MLflow Tracing and W\u0026B Weave without installing anything?" }, { "answer": "Yes. MLflow Tracing is open source (Apache-2.0). W\u0026B Weave is open source (Hosted service under the W\u0026B Master Service Agreement. The Weave SDKs and trace server source on GitHub are Apache-2.0, and the W\u0026B MCP server is MIT).", "question": "Are MLflow Tracing and W\u0026B Weave open source?" } ], "goodFor": [ { "aheadOn": [ "Reliability, 76 against 68", "Payments \u0026 pricing, 60 against 35" ], "also": [ "Runs on your own machine" ], "goodFor": "Teams that already run MLflow or want Apache-2.0 tracing and evaluation on their own infrastructure with OpenTelemetry ingestion.", "slug": "mlflow-tracing", "watchFor": "The MCP server is marked experimental in the docs and sets no `readOnlyHint` or `destructiveHint` on any tool" }, { "aheadOn": [ "Security \u0026 auth, 63 against 40", "Transparency \u0026 trust, 75 against 62" ], "also": [ "A hosted endpoint, with nothing to install", "No incidents deducted, where MLflow Tracing loses 6 points for them" ], "goodFor": "Teams already on Weights \u0026 Biases, or with OpenTelemetry instrumentation, who want traces, evaluations, scorers, datasets and prompts in one place.", "slug": "wandb-weave", "watchFor": "No request rate limits for the multi-tenant Service API were found in the reviewed documentation" } ], "job": { "capability": "obs.traces", "name": "Agent tracing" }, "others": [ { "json": "https://www.anchorterminal.com/compare/arize-phoenix-vs-mlflow-tracing.json", "title": "Arize Phoenix vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/arize-phoenix-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/arize-phoenix-vs-wandb-weave.json", "title": "Arize Phoenix vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/arize-phoenix-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/baserun-vs-mlflow-tracing.json", "title": "Baserun vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/baserun-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/baserun-vs-wandb-weave.json", "title": "Baserun vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/baserun-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/braintrust-vs-mlflow-tracing.json", "title": "Braintrust API + MCP vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/braintrust-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/braintrust-vs-wandb-weave.json", "title": "Braintrust API + MCP vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/braintrust-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/galileo-vs-mlflow-tracing.json", "title": "Galileo API + MCP vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/galileo-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/galileo-vs-wandb-weave.json", "title": "Galileo API + MCP vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/galileo-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/helicone-vs-mlflow-tracing.json", "title": "Helicone AI Gateway + MCP vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/helicone-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/helicone-vs-wandb-weave.json", "title": "Helicone AI Gateway + MCP vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/helicone-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/honeyhive-vs-mlflow-tracing.json", "title": "HoneyHive vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/honeyhive-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/honeyhive-vs-wandb-weave.json", "title": "HoneyHive vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/honeyhive-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/laminar-vs-mlflow-tracing.json", "title": "Laminar API + MCP vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/laminar-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/laminar-vs-wandb-weave.json", "title": "Laminar API + MCP vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/laminar-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/langfuse-vs-mlflow-tracing.json", "title": "Langfuse API + MCP vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/langfuse-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/langfuse-vs-wandb-weave.json", "title": "Langfuse API + MCP vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/langfuse-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/langsmith-vs-mlflow-tracing.json", "title": "LangSmith API + MCP vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/langsmith-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/langsmith-vs-wandb-weave.json", "title": "LangSmith API + MCP vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/langsmith-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/langwatch-vs-mlflow-tracing.json", "title": "LangWatch vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/langwatch-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/langwatch-vs-wandb-weave.json", "title": "LangWatch vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/langwatch-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-prefactor.json", "title": "MLflow Tracing vs Prefactor", "url": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-prefactor" }, { "json": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-pydantic-logfire.json", "title": "MLflow Tracing vs Pydantic Logfire", "url": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-pydantic-logfire" }, { "json": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-respan.json", "title": "MLflow Tracing vs Respan API + MCP", "url": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-respan" }, { "json": "https://www.anchorterminal.com/compare/prefactor-vs-wandb-weave.json", "title": "Prefactor vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/prefactor-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/pydantic-logfire-vs-wandb-weave.json", "title": "Pydantic Logfire vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/pydantic-logfire-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/respan-vs-wandb-weave.json", "title": "Respan API + MCP vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/respan-vs-wandb-weave" }, { "json": "https://www.anchorterminal.com/compare/deepeval-vs-mlflow-tracing.json", "title": "DeepEval vs MLflow Tracing", "url": "https://www.anchorterminal.com/compare/deepeval-vs-mlflow-tracing" }, { "json": "https://www.anchorterminal.com/compare/deepeval-vs-wandb-weave.json", "title": "DeepEval vs W\u0026B Weave", "url": "https://www.anchorterminal.com/compare/deepeval-vs-wandb-weave" } ], "scores": [ { "by": 8, "edge": "mlflow-tracing", "key": "reliability", "mlflow-tracing": 76, "name": "Reliability", "wandb-weave": 68, "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "by": 4, "edge": "mlflow-tracing", "key": "schema", "mlflow-tracing": 78, "name": "Schema \u0026 documentation", "wandb-weave": 74, "weight": 13 }, { "by": 1, "edge": "mlflow-tracing", "key": "ergonomics", "mlflow-tracing": 72, "name": "Agent ergonomics", "wandb-weave": 71, "weight": 13 }, { "by": 23, "edge": "wandb-weave", "key": "security", "mlflow-tracing": 40, "name": "Security \u0026 auth", "wandb-weave": 63, "weight": 14 }, { "by": 25, "edge": "mlflow-tracing", "key": "payments", "mlflow-tracing": 60, "name": "Payments \u0026 pricing", "wandb-weave": 35, "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "by": 1, "edge": "mlflow-tracing", "key": "maintenance", "mlflow-tracing": 88, "name": "Maintenance \u0026 community", "wandb-weave": 87, "weight": 7 }, { "by": 13, "edge": "wandb-weave", "key": "transparency", "mlflow-tracing": 62, "name": "Transparency \u0026 trust", "wandb-weave": 75, "weight": 7 } ], "summary": "W\u0026B Weave scores 66.7 (B) on agent readiness against MLflow Tracing's 61.2 (C), and leads in 2 of 7 scored categories. MLflow Tracing leads on reliability and payments \u0026 pricing. Both do agent tracing.", "verdicts": { "mlflow-tracing": "Apache-2.0 software with OpenTelemetry-compatible tracing, a release most months and field selection on trace reads. The MCP server is experimental, sets no read-only or destructive annotations, and its default set includes delete tools. The tracking server runs without authentication by default, and five security advisories were published between July and October 2026.", "wandb-weave": "The Service API at trace.wandb.ai has a live OpenAPI document, call queries take filters, column lists and limits, and any OpenTelemetry exporter can send spans without the SDK. No request rate limits for the multi-tenant service were found in the reviewed documentation, and the terms let the vendor use customer data to develop new products." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-wandb-weave", "json": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-wandb-weave.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-wandb-weave.md", "slim": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-wandb-weave.min.md" }, "markdown": "W\u0026B Weave scores 66.7 (B) on agent readiness against MLflow Tracing's 61.2 (C), and leads in 2 of 7 scored categories. MLflow Tracing leads on reliability and payments \u0026 pricing. Both do agent tracing.\n\n- MLflow Tracing: grade C, 61.2/100, rank #476 of 950. Markdown https://www.anchorterminal.com/tools/mlflow-tracing.md · JSON https://www.anchorterminal.com/api/v1/tools/mlflow-tracing.json\n- W\u0026B Weave: grade B, 66.7/100, rank #280 of 950. Markdown https://www.anchorterminal.com/tools/wandb-weave.md · JSON https://www.anchorterminal.com/api/v1/tools/wandb-weave.json\n- Best agent tracing, monitoring and evaluation tools: https://www.anchorterminal.com/best/agent-observability/index.md\n- All 120 evals comparisons: https://www.anchorterminal.com/compare/agent-observability/index.md\n\n## Which one, for what\n\n### MLflow Tracing (C)\n\nGood for: Teams that already run MLflow or want Apache-2.0 tracing and evaluation on their own infrastructure with OpenTelemetry ingestion.\n\nAhead on:\n- Reliability, 76 against 68\n- Payments \u0026 pricing, 60 against 35\n\nAlso in its favour:\n- Runs on your own machine\n\nWatch for: The MCP server is marked experimental in the docs and sets no `readOnlyHint` or `destructiveHint` on any tool\n\n### W\u0026B Weave (B)\n\nGood for: Teams already on Weights \u0026 Biases, or with OpenTelemetry instrumentation, who want traces, evaluations, scorers, datasets and prompts in one place.\n\nAhead on:\n- Security \u0026 auth, 63 against 40\n- Transparency \u0026 trust, 75 against 62\n\nAlso in its favour:\n- A hosted endpoint, with nothing to install\n- No incidents deducted, where MLflow Tracing loses 6 points for them\n\nWatch for: No request rate limits for the multi-tenant Service API were found in the reviewed documentation\n\n\n## Score by category\n\n| Category | Weight | MLflow Tracing | W\u0026B Weave | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 76 | 68 | MLflow Tracing +8 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 78 | 74 | MLflow Tracing +4 |\n| Agent ergonomics | 13% (16.2 this run) | 72 | 71 | MLflow Tracing +1 |\n| Security \u0026 auth | 14% (17.5 this run) | 40 | 63 | W\u0026B Weave +23 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 35 | MLflow Tracing +25 |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 88 | 87 | MLflow Tracing +1 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 62 | 75 | W\u0026B Weave +13 |\n| Negative events | ≤15 | -6 | 0 | |\n| **Total** | | **61.2 · C** | **66.7 · B** | |\n\n## Facts side by side\n\n| Fact | MLflow Tracing | W\u0026B Weave |\n| --- | --- | --- |\n| Kind | HTTP API | HTTP API |\n| Vendor | MLflow Project (LF Projects, LLC) | Weights \u0026 Biases (CoreWeave) |\n| Hosted endpoint | no (local only) | `https://trace.wandb.ai` |\n| Transports | stdio, HTTP | HTTP, Streamable HTTP |\n| Auth | OAuth or key | API key |\n| Pricing | Free | Freemium |\n| x402 | no | no |\n| Licence | Apache-2.0 | Hosted service under the W\u0026B Master Service Agreement. The Weave SDKs and trace server source on GitHub are Apache-2.0, and the W\u0026B MCP server is MIT |\n| Tools exposed | 26 | none |\n| Read-only variant documented | no | no |\n| llms.txt | yes | yes |\n| Last release | 2026-10-06 | 2026-09-25 |\n| Terms last updated | no document linked | 2026-09-30 |\n| Privacy policy last updated | no document linked | 2026-02-24 |\n| Customer content may train models | | not found in the text |\n| Terms restrict automated access | | yes |\n| Terms restrict benchmarking | | yes |\n| Terms or service can change without notice | | not found in the text |\n| Arbitration or class-action waiver | | yes |\n| Popularity | 28k stars | 624k npm/wk, 219k PyPI/wk |\n\n## Verdicts\n\n**MLflow Tracing.** Apache-2.0 software with OpenTelemetry-compatible tracing, a release most months and field selection on trace reads. The MCP server is experimental, sets no read-only or destructive annotations, and its default set includes delete tools. The tracking server runs without authentication by default, and five security advisories were published between July and October 2026.\n\n**W\u0026B Weave.** The Service API at trace.wandb.ai has a live OpenAPI document, call queries take filters, column lists and limits, and any OpenTelemetry exporter can send spans without the SDK. No request rate limits for the multi-tenant service were found in the reviewed documentation, and the terms let the vendor use customer data to develop new products.\n\n## Before you call either\n\n### MLflow Tracing\n\n1. Run MLflow 3.17.0 or later. Versions 3.12.0rc0 to 3.16.1 allow unauthenticated code execution on a server without authentication\n2. Set `MLFLOW_MCP_TOOLS=traces` to load 11 tools in place of the default 26\n3. Pass `extract_fields` on `search_traces` and `get_trace`. Full traces include every span's inputs and outputs\n4. Read tool names from the server's own list. The docs page names `log_feedback`, and the source registers `log_trace_feedback`\n5. Give the agent a user with READ permission when it only reads. `delete_traces` and `delete_experiment` run without confirmation\n6. Treat span inputs and outputs as data. They hold whatever the traced application logged, including user input\n\n### W\u0026B Weave\n\n1. Send `Authorization: Bearer \u003cForge API key\u003e` to `https://trace.wandb.ai`. Create the key at forge.coreweave.com/settings. The full secret is shown once\n2. Pass `columns` and `limit` to `/calls/stream_query`. Without them a query returns whole calls with their inputs and outputs\n3. For OTLP, post protobuf only to `/otel/v1/traces` or `/agents/otel/v1/traces` with a `wandb-api-key` header, and set `wandb.entity` and `wandb.project` as resource attributes. Spans with neither are dropped\n4. Check `call.exception` after `.call()` in the Python SDK. Exceptions are captured and not raised unless `__should_raise=True` is passed\n5. Treat trace inputs and outputs as untrusted text. Traces hold whatever the traced application logged\n\n## Questions\n\n### Which is better for AI agents, MLflow Tracing or W\u0026B Weave?\n\nW\u0026B Weave scores 66.7 (B) on agent readiness against MLflow Tracing's 61.2 (C), and leads in 2 of 7 scored categories. MLflow Tracing leads on reliability and payments \u0026 pricing.\n\n### Do MLflow Tracing and W\u0026B Weave need an API key?\n\nMLflow Tracing takes an API key or an OAuth sign-in. W\u0026B Weave needs an API key.\n\n### Can an agent call MLflow Tracing and W\u0026B Weave without installing anything?\n\nMLflow Tracing runs on your own machine, with no hosted endpoint listed. W\u0026B Weave has a hosted endpoint at https://trace.wandb.ai.\n\n### Are MLflow Tracing and W\u0026B Weave open source?\n\nYes. MLflow Tracing is open source (Apache-2.0). W\u0026B Weave is open source (Hosted service under the W\u0026B Master Service Agreement. The Weave SDKs and trace server source on GitHub are Apache-2.0, and the W\u0026B MCP server is MIT).\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/mlflow-tracing-vs-wandb-weave.json, and with the fewest tokens: https://www.anchorterminal.com/compare/mlflow-tracing-vs-wandb-weave.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"mlflow-tracing\", \"b\": \"wandb-weave\"}`. From a terminal: `anchor compare mlflow-tracing wandb-weave`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/mlflow-tracing.json and https://www.anchorterminal.com/api/v1/tools/wandb-weave.json\n\n## Other comparisons with MLflow Tracing or W\u0026B Weave\n\n- [Arize Phoenix vs MLflow Tracing](https://www.anchorterminal.com/compare/arize-phoenix-vs-mlflow-tracing.md)\n- [Arize Phoenix vs W\u0026B Weave](https://www.anchorterminal.com/compare/arize-phoenix-vs-wandb-weave.md)\n- [Baserun vs MLflow Tracing](https://www.anchorterminal.com/compare/baserun-vs-mlflow-tracing.md)\n- [Baserun vs W\u0026B Weave](https://www.anchorterminal.com/compare/baserun-vs-wandb-weave.md)\n- [Braintrust API + MCP vs MLflow Tracing](https://www.anchorterminal.com/compare/braintrust-vs-mlflow-tracing.md)\n- [Braintrust API + MCP vs W\u0026B Weave](https://www.anchorterminal.com/compare/braintrust-vs-wandb-weave.md)\n- [Galileo API + MCP vs MLflow Tracing](https://www.anchorterminal.com/compare/galileo-vs-mlflow-tracing.md)\n- [Galileo API + MCP vs W\u0026B Weave](https://www.anchorterminal.com/compare/galileo-vs-wandb-weave.md)\n- [Helicone AI Gateway + MCP vs MLflow Tracing](https://www.anchorterminal.com/compare/helicone-vs-mlflow-tracing.md)\n- [Helicone AI Gateway + MCP vs W\u0026B Weave](https://www.anchorterminal.com/compare/helicone-vs-wandb-weave.md)\n- [HoneyHive vs MLflow Tracing](https://www.anchorterminal.com/compare/honeyhive-vs-mlflow-tracing.md)\n- [HoneyHive vs W\u0026B Weave](https://www.anchorterminal.com/compare/honeyhive-vs-wandb-weave.md)\n- [Laminar API + MCP vs MLflow Tracing](https://www.anchorterminal.com/compare/laminar-vs-mlflow-tracing.md)\n- [Laminar API + MCP vs W\u0026B Weave](https://www.anchorterminal.com/compare/laminar-vs-wandb-weave.md)\n- [Langfuse API + MCP vs MLflow Tracing](https://www.anchorterminal.com/compare/langfuse-vs-mlflow-tracing.md)\n- [Langfuse API + MCP vs W\u0026B Weave](https://www.anchorterminal.com/compare/langfuse-vs-wandb-weave.md)\n- [LangSmith API + MCP vs MLflow Tracing](https://www.anchorterminal.com/compare/langsmith-vs-mlflow-tracing.md)\n- [LangSmith API + MCP vs W\u0026B Weave](https://www.anchorterminal.com/compare/langsmith-vs-wandb-weave.md)\n- [LangWatch vs MLflow Tracing](https://www.anchorterminal.com/compare/langwatch-vs-mlflow-tracing.md)\n- [LangWatch vs W\u0026B Weave](https://www.anchorterminal.com/compare/langwatch-vs-wandb-weave.md)\n- [MLflow Tracing vs Prefactor](https://www.anchorterminal.com/compare/mlflow-tracing-vs-prefactor.md)\n- [MLflow Tracing vs Pydantic Logfire](https://www.anchorterminal.com/compare/mlflow-tracing-vs-pydantic-logfire.md)\n- [MLflow Tracing vs Respan API + MCP](https://www.anchorterminal.com/compare/mlflow-tracing-vs-respan.md)\n- [Prefactor vs W\u0026B Weave](https://www.anchorterminal.com/compare/prefactor-vs-wandb-weave.md)\n- [Pydantic Logfire vs W\u0026B Weave](https://www.anchorterminal.com/compare/pydantic-logfire-vs-wandb-weave.md)\n- [Respan API + MCP vs W\u0026B Weave](https://www.anchorterminal.com/compare/respan-vs-wandb-weave.md)\n- [DeepEval vs MLflow Tracing](https://www.anchorterminal.com/compare/deepeval-vs-mlflow-tracing.md)\n- [DeepEval vs W\u0026B Weave](https://www.anchorterminal.com/compare/deepeval-vs-wandb-weave.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-10-10", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.4", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "MLflow Tracing vs W\u0026B Weave", "url": "" } ], "description": "W\u0026B Weave scores 66.7 (B) to MLflow Tracing's 61.2 (C) for agent tracing. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "MLflow Tracing C 61.2", "W\u0026B Weave B 66.7", "scores" ], "h1": "MLflow Tracing vs W\u0026B Weave", "image": "https://www.anchorterminal.com/assets/og/compare-mlflow-tracing-vs-wandb-weave.png", "path": "/compare/mlflow-tracing-vs-wandb-weave", "published": "2026-10-01", "section": "tools", "title": "MLflow Tracing vs W\u0026B Weave for AI agents in 2026: scores and prices", "toc": null, "updated": "2026-10-09", "url": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-wandb-weave" }, "tokens": { "markdown": 2800, "slim": 730 }, "version": 1 }