{
  "data": {
    "a": {
      "slug": "galileo",
      "name": "Galileo API + MCP",
      "vendor": "Galileo (now Splunk Agent Observability, Cisco)",
      "vendorUrl": "https://galileo.ai",
      "company": "galileo.ai",
      "kind": "http-api",
      "category": "agent-observability",
      "summary": "Hosted tracing, evaluation metrics and guardrails for LLM apps and agents, with a REST API, Python and TypeScript SDKs and an 8-tool MCP server in preview.",
      "url": "https://www.anchorterminal.com/tools/galileo",
      "markdownUrl": "https://www.anchorterminal.com/tools/galileo.md",
      "slimMarkdownUrl": "https://www.anchorterminal.com/tools/galileo.min.md",
      "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/galileo.json",
      "dns": "galileo.grade.anchorterminal.com",
      "repo": "https://github.com/rungalileo/galileo-python",
      "license": "Apache-2.0 (SDKs only, platform closed source)",
      "transports": [
        "http",
        "streamable-http"
      ],
      "remoteUrl": "https://api.galileo.ai/v2",
      "packages": [
        {
          "registry": "pypi",
          "name": "galileo"
        },
        {
          "registry": "npm",
          "name": "galileo"
        }
      ],
      "auth": "api-key",
      "authNotes": "API key in a header. The current OpenAPI spec names it `Splunk-AO-API-Key` and older Galileo docs `Galileo-API-Key`. The API also issues a JWT from `/login/api_key` that expires after 24 hours and accepts HTTP Basic with a username and password. The MCP server takes the same API key header. New SaaS accounts on Splunk Observability Cloud use `https://app.{realm}.observability.splunkcloud.com/ao/api/` and Splunk's own authentication. Self-hosted deployments use their own api.* host.",
      "pricing": "freemium",
      "pricingNotes": "Free plan with 5,000 traces a month, unlimited users and unlimited custom evals. Pro $100 a month billed yearly with 50,000 traces, then priced by trace volume with no published rate. Enterprise is custom with unlimited traces, custom rate limits and hosted, VPC or on-prem deployment. These figures are from the 1 October 2026 check; galileo.ai/pricing now redirects to Splunk's pricing page (https://www.splunk.com/en_us/products/pricing.html#agent-observability).",
      "priceSummary": "$100 / mo",
      "where": "hosted",
      "x402": {
        "level": "no",
        "evidence": "No x402 support in docs or pricing (checked 2026-09-30).",
        "endpoints": []
      },
      "toolCount": 8,
      "popularity": {
        "githubStars": null,
        "npmWeekly": null,
        "pypiWeekly": null,
        "asOf": "2026-09-30"
      },
      "docsUrl": "https://docs.galileo.ai",
      "llmsTxt": "https://docs.galileo.ai/llms.txt",
      "openapi": "https://api.galileo.ai/public/v2/openapi.json",
      "capabilities": [
        "obs.traces",
        "obs.evals",
        "obs.prompts",
        "obs.datasets"
      ],
      "tags": [
        "hosted",
        "freemium",
        "mcp",
        "llms-txt",
        "openapi",
        "python",
        "typescript",
        "closed-source",
        "enterprise"
      ],
      "lastRelease": "2026-10-16",
      "graded": true,
      "anchor": {
        "graded": true,
        "score": 46.1,
        "grade": "D",
        "agentReady": false,
        "rank": 1259,
        "ranked": true,
        "rankOf": 1557,
        "categoryRank": 21,
        "methodology": "1.0",
        "run": "2026-10-01",
        "scores": {
          "ergonomics": 73,
          "maintenance": 74,
          "payments": 30,
          "reliability": 18,
          "schema": 79,
          "security": 33,
          "transparency": 55
        },
        "assessment": {
          "confidence": "medium",
          "date": "2026-11-04"
        },
        "negative": -3,
        "negativeNotes": [
          "-3, a breaking change in a patch release without notice. The TypeScript SDK `galileo` 2.1.2 (14 May 2026) renamed the `logstream` parameter of `init()`, `getLogger()`, `reset()` and `flush()` to `logStreamName` with no runtime fallback, and removed exports including `createScorer`, `updateExperiment` and `deleteExperiment`. The CHANGELOG lists the rename under BREAKING CHANGES with no earlier deprecation. The release candidates were tagged on the merge commit the evening before, under a day ahead, which isn't advance notice. An earlier rename the other way in minor 1.30.0 (2 December 2025) folds into the same term. https://github.com/rungalileo/galileo-js/blob/main/CHANGELOG.md"
        ],
        "verdict": "Galileo publishes an OpenAPI 3.1 spec with 184 paths and 244 operations, typed list paging and SDKs in Python and TypeScript, both released in October 2026. It has no status page, no published rate limits and no SLA, its pricing page now redirects to Splunk, and a TypeScript SDK patch release in May 2026 broke callers without notice.",
        "bestFor": "Existing Galileo customers and teams already on Splunk Observability Cloud who want eval metrics and guardrails next to their infrastructure monitoring.",
        "strengths": [
          "OpenAPI 3.1 spec with 184 paths and 244 operations, linked from the docs' llms.txt",
          "Error catalogue of 111 entries with HTTP status, fix and a retriable flag",
          "Free plan with 5,000 traces a month and unlimited users, per the 1 October pricing page",
          "TypeScript SDK 2.4.0 on 16 October and Python SDK 2.7.0 on 14 October 2026",
          "Enterprise deployment in your VPC or on-prem"
        ],
        "weaknesses": [
          "No status page, no published rate limits and no SLA",
          "Split between Galileo and Splunk since 7 August 2026, and galileo.ai/pricing now redirects to Splunk's pricing page",
          "MCP server with 8 tools, only `Get Signals` reads production data",
          "No security page, trust portal, security.txt or certification claim found, and the privacy policy dates from November 2024",
          "TypeScript SDK patch 2.1.2 (May 2026) renamed parameters and removed exports without notice; the Python CHANGELOG.md stops at v0.10.0"
        ],
        "agentNotes": [
          "Check which side the account lives on first. Pre-August Galileo accounts use api.galileo.ai, Splunk SaaS accounts use app.{realm}.observability.splunkcloud.com/ao/api/",
          "Send the key as `Splunk-AO-API-Key`. The current spec no longer lists `Galileo-API-Key`",
          "Page list endpoints with `limit` and `starting_token`",
          "Use the error catalogue's retriable flag to decide whether to retry. 429s carry no documented `Retry-After`",
          "Use the REST API to read traces. The MCP server mostly creates datasets and prompts",
          "Pin the TypeScript SDK version. Patch 2.1.2 renamed `logstream` to `logStreamName` and removed several exports"
        ],
        "metrics": {
          "kind": "remote",
          "measured": false
        },
        "reviewCount": 2,
        "avgRating": 2.5,
        "history": [
          {
            "basis": "public evidence",
            "confidence": "medium",
            "grade": "D",
            "methodology": "1.0",
            "run": "2026-10-01",
            "runLabel": "October 2026 research run",
            "score": 46.1
          }
        ],
        "editorialScores": {
          "ergonomics": 73,
          "maintenance": 74,
          "payments": 30,
          "reliability": 18,
          "schema": 79,
          "security": 33,
          "transparency": 36
        },
        "provenanceScore": 74,
        "checked": {
          "categories": {
            "ergonomics": "2026-11-04",
            "maintenance": "2026-11-04",
            "payments": "2026-11-04",
            "reliability": "2026-11-04",
            "schema": "2026-11-04",
            "security": "2026-11-04",
            "transparency": "2026-11-04"
          },
          "last": "2026-11-04",
          "lastMoved": "2026-11-13",
          "oldest": "2026-11-04",
          "stale": false,
          "staleAfterDays": 90
        }
      },
      "connect": {
        "http": "curl https://api.galileo.ai/v2/current_user -H \"Galileo-API-Key: $GALILEO_API_KEY\"",
        "claudeCode": "claude mcp add --transport http --header \"Galileo-API-Key: $GALILEO_API_KEY\" galileo https://api.galileo.ai/mcp/http/mcp",
        "config": {
          "mcpServers": {
            "galileo": {
              "headers": {
                "Accept": "text/event-stream",
                "Galileo-API-Key": "${GALILEO_API_KEY}"
              },
              "type": "http",
              "url": "https://api.galileo.ai/mcp/http/mcp"
            }
          }
        }
      },
      "letme": {
        "capability": "https://letme.dev/obs.traces",
        "tool": "https://letme.dev/galileo"
      },
      "alsoIn": [
        "guardrails"
      ],
      "area": "developer",
      "unitPrices": [
        {
          "item": "Pro plan",
          "unit": "month",
          "usd": 100,
          "note": "billed yearly, 50,000 traces a month"
        }
      ],
      "provenance": {
        "legalEntity": "Galileo Technologies, Inc.",
        "domain": "galileo.ai",
        "domainRegistered": "2020-05-05",
        "endpointOnVendorDomain": true,
        "terms": "https://galileo.ai/terms-of-service",
        "privacy": "https://galileo.ai/privacy-policy",
        "statusPage": "",
        "changelog": "https://docs.galileo.ai/release-notes",
        "securityTxt": "none",
        "checked": "2026-09-30",
        "notes": [
          "Now owned by Cisco and sold as Splunk Agent Observability; the terms still name Galileo Technologies, Inc."
        ],
        "score": 74
      },
      "pageJsonUrl": "https://www.anchorterminal.com/tools/galileo.json",
      "live": {
        "slug": "galileo",
        "probe": {
          "target": "https://api.galileo.ai/v2",
          "method": "get",
          "lastAt": "2026-11-18T23:01:31.648879237Z",
          "lastOk": true,
          "lastStatus": 404,
          "lastMs": 178,
          "authRequired": false,
          "uptime24h": 100,
          "uptime30d": 100,
          "p50ms24h": 180,
          "p95ms24h": 337,
          "samples24h": 241,
          "samples30d": 7840,
          "days": [
            {
              "date": "2026-10-18",
              "probes": 256,
              "ok": 256
            },
            {
              "date": "2026-10-19",
              "probes": 255,
              "ok": 255
            },
            {
              "date": "2026-10-20",
              "probes": 252,
              "ok": 252
            },
            {
              "date": "2026-10-21",
              "probes": 253,
              "ok": 253
            },
            {
              "date": "2026-10-22",
              "probes": 253,
              "ok": 253
            },
            {
              "date": "2026-10-23",
              "probes": 248,
              "ok": 248
            },
            {
              "date": "2026-10-24",
              "probes": 251,
              "ok": 251
            },
            {
              "date": "2026-10-25",
              "probes": 250,
              "ok": 250
            },
            {
              "date": "2026-10-26",
              "probes": 252,
              "ok": 252
            },
            {
              "date": "2026-10-27",
              "probes": 249,
              "ok": 249
            },
            {
              "date": "2026-10-28",
              "probes": 251,
              "ok": 251
            },
            {
              "date": "2026-10-29",
              "probes": 248,
              "ok": 248
            },
            {
              "date": "2026-10-30",
              "probes": 249,
              "ok": 249
            },
            {
              "date": "2026-10-31",
              "probes": 251,
              "ok": 251
            },
            {
              "date": "2026-11-01",
              "probes": 249,
              "ok": 249
            },
            {
              "date": "2026-11-02",
              "probes": 250,
              "ok": 250
            },
            {
              "date": "2026-11-03",
              "probes": 248,
              "ok": 248
            },
            {
              "date": "2026-11-04",
              "probes": 246,
              "ok": 246
            },
            {
              "date": "2026-11-05",
              "probes": 185,
              "ok": 185
            },
            {
              "date": "2026-11-06",
              "probes": 241,
              "ok": 241
            },
            {
              "date": "2026-11-07",
              "probes": 243,
              "ok": 243
            },
            {
              "date": "2026-11-08",
              "probes": 243,
              "ok": 243
            },
            {
              "date": "2026-11-09",
              "probes": 243,
              "ok": 243
            },
            {
              "date": "2026-11-10",
              "probes": 244,
              "ok": 244
            },
            {
              "date": "2026-11-11",
              "probes": 244,
              "ok": 244
            },
            {
              "date": "2026-11-12",
              "probes": 245,
              "ok": 245
            },
            {
              "date": "2026-11-13",
              "probes": 238,
              "ok": 238
            },
            {
              "date": "2026-11-14",
              "probes": 244,
              "ok": 244
            },
            {
              "date": "2026-11-15",
              "probes": 243,
              "ok": 243
            },
            {
              "date": "2026-11-16",
              "probes": 243,
              "ok": 243
            },
            {
              "date": "2026-11-17",
              "probes": 242,
              "ok": 242
            },
            {
              "date": "2026-11-18",
              "probes": 231,
              "ok": 231
            }
          ],
          "since": "2026-10-08T00:00:00Z"
        },
        "versions": [
          {
            "registry": "github",
            "name": "rungalileo/galileo-python",
            "version": "v2.7.0",
            "released": "2026-10-14",
            "seenAt": "2026-11-18T17:49:31.082154685Z"
          },
          {
            "registry": "npm",
            "name": "galileo",
            "version": "2.4.0",
            "seenAt": "2026-11-18T17:49:30.214772687Z"
          },
          {
            "registry": "pypi",
            "name": "galileo",
            "version": "2.7.0",
            "released": "2026-10-14",
            "seenAt": "2026-11-18T17:49:29.980991639Z"
          }
        ],
        "githubStars": 23,
        "npmWeekly": 1842,
        "pypiWeekly": 12448,
        "securityTxt": {
          "url": "https://galileo.ai/.well-known/security.txt",
          "state": "none",
          "checkedAt": "2026-11-18T16:31:13.306340622Z"
        },
        "llmsTxt": {
          "url": "https://docs.galileo.ai/llms.txt",
          "ok": true,
          "status": 200,
          "checkedAt": "2026-11-18T16:14:23.715969918Z"
        },
        "domain": {
          "domain": "galileo.ai",
          "registered": "2020-05-05",
          "source": "https://rdap.identitydigital.services/rdap/domain/galileo.ai",
          "checkedAt": "2026-11-15T15:35:24.768224287Z"
        },
        "pages": [
          {
            "url": "https://docs.galileo.ai/release-notes",
            "kind": "deprecations",
            "status": 200,
            "checkedAt": "2026-11-18T21:40:16.415983658Z",
            "changedAt": "2026-11-13T18:16:24.203081015Z",
            "fingerprint": "93d1668389b5"
          },
          {
            "url": "https://galileo.ai/pricing",
            "kind": "pricing",
            "status": 304,
            "checkedAt": "2026-11-04T08:24:21.326873352Z",
            "changedAt": "2026-10-23T01:48:13.107203136Z",
            "fingerprint": "8dc28fecc1ec"
          },
          {
            "url": "https://www.splunk.com/en_us/products/pricing.html",
            "kind": "pricing",
            "status": 200,
            "checkedAt": "2026-11-18T22:09:50.159778372Z",
            "changedAt": "0001-01-01T00:00:00Z",
            "fingerprint": "00e56d241b0d"
          },
          {
            "url": "https://galileo.ai/privacy-policy",
            "kind": "privacy",
            "status": 200,
            "checkedAt": "2026-11-18T21:44:09.094781063Z",
            "changedAt": "2026-11-12T17:39:59.390708442Z",
            "fingerprint": "f907facdf1af"
          },
          {
            "url": "https://galileo.ai/terms-of-service",
            "kind": "terms",
            "status": 200,
            "checkedAt": "2026-11-18T21:44:11.431167396Z",
            "changedAt": "2026-11-12T17:40:01.614414595Z",
            "fingerprint": "f907facdf1af"
          }
        ],
        "mcpTools": {
          "url": "https://api.galileo.ai/mcp/http/mcp",
          "checkedAt": "2026-11-18T04:24:02.350072074Z",
          "status": "ok",
          "protocol": "2025-11-25",
          "tools": [
            {
              "name": "integrate_galileo_with_langchain",
              "description": "\nIntegrate Galileo observability into LangChain applications.\n\n**Supported Languages:** python\n**Parameters:**\n- language (optional): Programming language for integration guide. Defaults to \"python\".\n\n**Provides:**\n- Complete integration code examples and setup instructions\n- Automatic logging of prompts, responses, model parameters, and token usage\n- Environment configuration templates\n- Language-specific best practices\n\nReturns working code snippets ready to copy and paste for robust LLM observability.\n",
              "inputSchema": {
                "properties": {
                  "language": {
                    "title": "Language",
                    "type": "string"
                  }
                },
                "required": [
                  "language"
                ],
                "title": "integrate_galileo_with_langchainArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "integrate_galileo_with_openai",
              "description": "\nIntegrate Galileo observability into OpenAI API applications.\n\n**Supported Languages:** python, typescript\n\n**Parameters:**\n- language (optional): Programming language for integration guide. Defaults to \"python\".\n\n**Provides:**\n- Complete integration code examples and setup instructions\n- Automatic logging of prompts, responses, model parameters, and token usage\n- Environment configuration templates\n- Language-specific best practices\n\nReturns working code snippets ready to copy and paste for robust LLM observability.\n",
              "inputSchema": {
                "properties": {
                  "language": {
                    "title": "Language",
                    "type": "string"
                  }
                },
                "required": [
                  "language"
                ],
                "title": "integrate_galileo_with_openaiArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "get_logstream_insights",
              "description": "\nGet the insights (also known as signals) for a log stream in a specific project. This tool analyzes log streams and provides insights/signals that identify issues, patterns, and suggest improvements.\n\n**When to use this tool:**\n- User asks for \"insights\" or \"signals\" about a log stream\n- User mentions a project name and wants to analyze a log stream\n- User asks questions like: \"What's wrong with my application?\", \"Get insights about my log stream\", \"Show me signals for my logs\"\n\n**Parameters:**\n- project (required): The exact name of the Galileo project. Extract this from phrases like:\n  - \"in the {project} project\"\n  - \"for project {project}\"\n  - \"from {project}\"\n  Example: If user says \"in the customer-support project\", use project=\"customer-support\"\n\n- log_stream (required): The exact name of the log stream. Extract this from phrases like:\n  - \"log stream {log_stream}\"\n  - \"logs from {log_stream}\"\n  - \"the {log_stream} log stream\"\n  - If user says \"my log stream\" without a name, ask them for the specific log stream name\n  Example: If user says \"about my log stream in customer-support\", you may need to ask for the log stream name, or infer it from context\n\n**Example Natural Language Queries:**\n- \"Get insights about my log stream in the customer-support project\"\n  → project=\"customer-support\", log_stream={ask user or infer from context}\n\n- \"Get insights for the api-logs log stream in customer-support\"\n  → project=\"customer-support\", log_stream=\"api-logs\"\n\n- \"What insights do you have for my logs in project customer-support?\"\n  → project=\"customer-support\", log_stream={ask user for specific log stream name}\n\n**Returns:**\n- A list of insights/signals about the log stream, including:\n  - Issues and anomalies detected\n  - Patterns and trends\n  - Suggested improvements\n  - Session notes and trace notes if available\n",
              "inputSchema": {
                "properties": {
                  "log_stream": {
                    "title": "Log Stream",
                    "type": "string"
                  },
                  "project": {
                    "title": "Project",
                    "type": "string"
                  }
                },
                "required": [
                  "project",
                  "log_stream"
                ],
                "title": "get_logstream_insightsArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "get_logstream_signals",
              "description": "\nGet the signals (also known as insights) for a log stream in a specific project. This tool analyzes log streams and provides signals/insights that identify issues, patterns, and suggest improvements.\n\n**When to use this tool:**\n- User asks for \"signals\" or \"insights\" about a log stream\n- User mentions a project name and wants to analyze a log stream\n- User asks questions like: \"What's wrong with my application?\", \"Get signals about my log stream\", \"Show me insights for my logs\"\n\n**Parameters:**\n- project (required): The exact name of the Galileo project. Extract this from phrases like:\n  - \"in the {project} project\"\n  - \"for project {project}\"\n  - \"from {project}\"\n  Example: If user says \"in the customer-support project\", use project=\"customer-support\"\n\n- log_stream (required): The exact name of the log stream. Extract this from phrases like:\n  - \"log stream {log_stream}\"\n  - \"logs from {log_stream}\"\n  - \"the {log_stream} log stream\"\n  - If user says \"my log stream\" without a name, ask them for the specific log stream name\n  Example: If user says \"about my log stream in customer-support\", you may need to ask for the log stream name, or infer it from context\n\n**Example Natural Language Queries:**\n- \"Get signals about my log stream in the customer-support project\"\n  → project=\"customer-support\", log_stream={ask user or infer from context}\n\n- \"Get insights for the api-logs log stream in customer-support\"\n  → project=\"customer-support\", log_stream=\"api-logs\"\n\n- \"What signals do you have for my logs in project customer-support?\"\n  → project=\"customer-support\", log_stream={ask user for specific log stream name}\n\n**Returns:**\n- A list of signals/insights about the log stream, including:\n  - Issues and anomalies detected\n  - Patterns and trends\n  - Suggested improvements\n  - Session notes and trace notes if available\n",
              "inputSchema": {
                "properties": {
                  "log_stream": {
                    "title": "Log Stream",
                    "type": "string"
                  },
                  "project": {
                    "title": "Project",
                    "type": "string"
                  }
                },
                "required": [
                  "project",
                  "log_stream"
                ],
                "title": "get_logstream_signalsArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "validate_dataset",
              "description": "\nCheck the status of a synthetic dataset generation job and view dataset contents. This tool allows the user to check the progress of a synthetic dataset generation job that was previously started using the create_galileo_dataset tool. It always shows the first 10 rows of the dataset for preview, regardless of generation status. Users can start by asking a question such as: Check the status of my dataset generation job.\n\n**Parameters:**\n- dataset_id (required): The id of the dataset to check the generation status for.\n\n**Returns:**\n- The current status and progress of the synthetic dataset generation job, including progress message, steps completed, and total steps.\n- Always includes a preview of the first 10 rows of the dataset with column names and values, whether generation is complete, in progress, or failed.\n- Total number of rows in the dataset and how many are being shown.\n\n**Example:**\nAfter creating a dataset with create_galileo_dataset, use this tool to check if the generation is complete and preview the generated data.\n",
              "inputSchema": {
                "properties": {
                  "dataset_id": {
                    "title": "Dataset Id",
                    "type": "string"
                  }
                },
                "required": [
                  "dataset_id"
                ],
                "title": "validate_datasetArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "create_galileo_dataset",
              "description": "\n    Create a new Galileo dataset with multiple data source options.\n\n    **Prerequisites:**\n    - Requires a valid Galileo API key configured in your MCP settings\n    - You must have an active Galileo account with dataset creation permissions\n\n    **Creation Options:**\n        Ask the user which option they prefer:\n        1. Synthetic data generation: Automatically generate data based on description\n        2. CSV file: Provide CSV content to create dataset (columns: input, output, optional metadata)\n        3. JSON data: Provide structured JSON data\n\n    **Required User Inputs:**\n    Please ask the user to provide the following information:\n    - description: A description of the dataset they want to create. This will be used as instructions for the synthetic data generation if the user chooses to use the synthetic data source type.\n    - data_source_type: The type of data source to use for the dataset. Valid types: \"synthetic\", \"csv\", \"json\".\n\n    **Optional User Inputs:**\n    - model: The model to use for generating synthetic data (e.g., \"gpt-4.1-mini\", \"claude-4-sonnet\").\n    - count: Number of synthetic samples to generate (must be between 1 and 100).\n    - data_types: Types of data to generate. Valid types: \"General Query\", \"Prompt Injection\", \"Off-Topic Query\", \"Toxic Content in Query\", \"Multiple Questions in Query\".\n    - sample_data: Sample data to use as reference during generation. Can be newline-separated examples.\n    - csv_content: CSV file content as string (for CSV data source type).\n    - json_data: JSON data as string or array of objects (for JSON data source type).\n    - name: Name for the dataset (optional, defaults to \"New Dataset\").\n\n    **Returns:**\n    - Dataset ID for the created dataset\n    - Status of the generation job\n    - Parameters used for generation\n    - Next steps for accessing the dataset\n\n    **Example Tool Call:**\n    description=\"Generate customer service queries about product returns\",model=\"gpt-4o-mini\",count=20,data_types=\"General Query,Off-Topic Query\",sample_data=\"How do I return a defective product?\nWhat is your return policy?\"\n\n    **What this tool does:**\n    1. Authenticates using your Galileo API key\n    2. Creates a new dataset in your Galileo organization\n    3. Dispatches a background job to generate synthetic data or processes uploaded data\n    4. Returns the dataset ID for tracking progress\n    5. Generated data will be available in your Galileo console\n\n    **Instructions for Agent:**\n    Always ask the user to provide: description and data_source_type before making the tool call. These are required for successful dataset creation.\n    Ask the user to wait for the dataset to be created before using the validate_dataset tool. Continue to ask the user if they want to validate the dataset that was just created.\n    ",
              "inputSchema": {
                "$defs": {
                  "SyntheticDataTypes": {
                    "enum": [
                      "General Query",
                      "Prompt Injection",
                      "Off-Topic Query",
                      "Toxic Content in Query",
                      "Multiple Questions in Query",
                      "Sexist Content in Query"
                    ],
                    "title": "SyntheticDataTypes",
                    "type": "string"
                  }
                },
                "properties": {
                  "count": {
                    "default": 10,
                    "title": "Count",
                    "type": "integer"
                  },
                  "csv_content": {
                    "default": "",
                    "title": "Csv Content",
                    "type": "string"
                  },
                  "data_source_type": {
                    "default": "synthetic",
                    "title": "Data Source Type",
                    "type": "string"
                  },
                  "data_types": {
                    "default": [],
                    "items": {
                      "$ref": "#/$defs/SyntheticDataTypes"
                    },
                    "title": "Data Types",
                    "type": "array"
                  },
                  "description": {
                    "title": "Description",
                    "type": "string"
                  },
                  "json_data": {
                    "default": "",
                    "title": "Json Data",
                    "type": "string"
                  },
                  "model": {
                    "default": "gpt-4.1-mini",
                    "title": "Model",
                    "type": "string"
                  },
                  "name": {
                    "default": "New Dataset",
                    "title": "Name",
                    "type": "string"
                  },
                  "project_id": {
                    "anyOf": [
                      {
                        "type": "string"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Project Id"
                  },
                  "sample_data": {
                    "default": "",
                    "title": "Sample Data",
                    "type": "string"
                  }
                },
                "required": [
                  "description"
                ],
                "title": "create_galileo_datasetArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "create_prompt_template",
              "description": "\nCreate a new global prompt template that can be used across all projects.\n\n**Prerequisites:**\n- Requires a valid Galileo API key configured in your MCP settings\n- You must have an active Galileo account with prompt template creation permissions\n\n**Required User Inputs:**\nPlease ask the user to provide the following information:\n- name: A descriptive name for the prompt template.\n- template: The actual prompt template content. Can be plain text or JSON format for chat templates.\n\n**Optional User Inputs:**\n- raw: Boolean flag indicating if this is a raw template (default: false).\n- output_type: The expected output type for the template (optional).\n- model_alias: The model to use with this template (default: \"gpt-4.1-mini\").\n- temperature: Controls randomness in the output (0.0 to 2.0, default: 0.7).\n- max_tokens: Maximum number of tokens in the response (default: 1000).\n- top_p: Controls diversity of the output (0.0 to 1.0, default: 1.0).\n- frequency_penalty: Penalty for frequent tokens (-2.0 to 2.0, default: 0.0).\n- presence_penalty: Penalty for repeated tokens (-2.0 to 2.0, default: 0.0).\n\n**Returns:**\n- Template ID for the created template\n- Template details including name, version, and settings\n- Success confirmation with template metadata\n\n**Example Tool Calls:**\n\nSimple text template:\nname=\"Customer Support Response\",template=\"You are a helpful customer support agent. Please respond to the following customer inquiry: {inquiry}\",model_alias=\"gpt-4.1-mini\",temperature=0.5\n\nJSON chat template:\nname=\"AI Coding Assistant\",template=\"[{\"role\":\"system\",\"content\":\"You are an Extremely friendly and helpful AI Coding assistant\"}]\",model_alias=\"gpt-4.1-mini\",temperature=0.3\n\n**What this tool does:**\n1. Authenticates using your Galileo API key\n2. Creates a new global prompt template in your Galileo organization\n3. Sets up the template with the specified settings and configuration\n4. Returns the template ID and details for future use\n5. Template will be available globally across all projects\n\n**Instructions for Agent:**\nAlways ask the user to provide: name and template before making the tool call. These are required for successful template creation.\nThe template will be created as a global template, accessible across all projects in the organization.\n",
              "inputSchema": {
                "properties": {
                  "frequency_penalty": {
                    "default": 0,
                    "title": "Frequency Penalty",
                    "type": "number"
                  },
                  "max_tokens": {
                    "default": 1000,
                    "title": "Max Tokens",
                    "type": "integer"
                  },
                  "model_alias": {
                    "default": "gpt-4.1-mini",
                    "title": "Model Alias",
                    "type": "string"
                  },
                  "name": {
                    "title": "Name",
                    "type": "string"
                  },
                  "output_type": {
                    "anyOf": [
                      {
                        "type": "string"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Output Type"
                  },
                  "presence_penalty": {
                    "default": 0,
                    "title": "Presence Penalty",
                    "type": "number"
                  },
                  "project_id": {
                    "anyOf": [
                      {
                        "type": "string"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Project Id"
                  },
                  "raw": {
                    "default": false,
                    "title": "Raw",
                    "type": "boolean"
                  },
                  "temperature": {
                    "default": 0.7,
                    "title": "Temperature",
                    "type": "number"
                  },
                  "template": {
                    "title": "Template",
                    "type": "string"
                  },
                  "top_p": {
                    "default": 1,
                    "title": "Top P",
                    "type": "number"
                  }
                },
                "required": [
                  "name",
                  "template"
                ],
                "title": "create_prompt_templateArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "setup_galileo_experiment",
              "description": "\nSetup and create a Galileo experiment using the Galileo SDK.\n\n**Supported Languages:** python\n**Parameters:**\n- language (optional): Programming language for experiment setup guide. Defaults to \"python\".\n\n**Provides:**\n- Complete experiment setup code examples and instructions\n- Step-by-step guide for creating and running experiments\n- Dataset preparation and metrics configuration\n- Integration with existing application code\n- Advanced usage patterns for agentic/RAG workflows\n\n**What this tool helps you do:**\n- Set up Galileo experiments with datasets (remote or inline)\n- Create and configure prompts for experiments\n- Define custom metrics and use built-in scorers\n- Run experiments with proper logging and tracing\n- Integrate experiment workflows into existing applications\n- Inspect and analyze experiment results\n\nReturns working code snippets ready to copy and paste for robust experiment setup and execution.\n",
              "inputSchema": {
                "properties": {
                  "language": {
                    "default": "python",
                    "title": "Language",
                    "type": "string"
                  }
                },
                "title": "setup_galileo_experimentArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "search_docs",
              "description": "\nSearch across the Galileo documentation to find relevant information, code examples, API references, and guides. Use this tool when you need to answer questions about Galileo, find specific documentation, understand how features work, or locate implementation details. The search returns contextual content with titles and direct links to the documentation pages.\n\n**Parameters:**\n- query (required): The search query to find relevant documentation.\n\n**Returns:**\n- Relevant documentation content and links based on the search query.\n\n**Example:**\nsearch_docs(query=\"how to set up data logging\")\n",
              "inputSchema": {
                "properties": {
                  "query": {
                    "title": "Query",
                    "type": "string"
                  }
                },
                "required": [
                  "query"
                ],
                "title": "search_docsArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "get_code_remediation",
              "description": "Read the selected Signal diagnosis and proposed code change by its existing IDs.",
              "inputSchema": {
                "properties": {
                  "project_id": {
                    "format": "uuid4",
                    "title": "Project Id",
                    "type": "string"
                  },
                  "remediation_id": {
                    "format": "uuid4",
                    "title": "Remediation Id",
                    "type": "string"
                  },
                  "run_id": {
                    "format": "uuid4",
                    "title": "Run Id",
                    "type": "string"
                  },
                  "signal_id": {
                    "format": "uuid4",
                    "title": "Signal Id",
                    "type": "string"
                  }
                },
                "required": [
                  "project_id",
                  "run_id",
                  "signal_id",
                  "remediation_id"
                ],
                "title": "get_code_remediationArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "get_signal_evidence",
              "description": "Page stored occurrences for the selected Signal and its merged descendants.",
              "inputSchema": {
                "properties": {
                  "cursor": {
                    "anyOf": [
                      {
                        "type": "string"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Cursor"
                  },
                  "limit": {
                    "default": 20,
                    "title": "Limit",
                    "type": "integer"
                  },
                  "project_id": {
                    "format": "uuid4",
                    "title": "Project Id",
                    "type": "string"
                  },
                  "remediation_id": {
                    "format": "uuid4",
                    "title": "Remediation Id",
                    "type": "string"
                  },
                  "run_id": {
                    "format": "uuid4",
                    "title": "Run Id",
                    "type": "string"
                  },
                  "signal_id": {
                    "format": "uuid4",
                    "title": "Signal Id",
                    "type": "string"
                  }
                },
                "required": [
                  "project_id",
                  "run_id",
                  "signal_id",
                  "remediation_id"
                ],
                "title": "get_signal_evidenceArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "get_signal_evidence_span",
              "description": "Read a cited span's input and output in 4,000-character pages under the caller's trace access policy.",
              "inputSchema": {
                "properties": {
                  "input_offset": {
                    "default": 0,
                    "title": "Input Offset",
                    "type": "integer"
                  },
                  "occurrence_id": {
                    "format": "uuid4",
                    "title": "Occurrence Id",
                    "type": "string"
                  },
                  "output_offset": {
                    "default": 0,
                    "title": "Output Offset",
                    "type": "integer"
                  },
                  "project_id": {
                    "format": "uuid4",
                    "title": "Project Id",
                    "type": "string"
                  },
                  "remediation_id": {
                    "format": "uuid4",
                    "title": "Remediation Id",
                    "type": "string"
                  },
                  "run_id": {
                    "format": "uuid4",
                    "title": "Run Id",
                    "type": "string"
                  },
                  "signal_id": {
                    "format": "uuid4",
                    "title": "Signal Id",
                    "type": "string"
                  },
                  "span_id": {
                    "format": "uuid4",
                    "title": "Span Id",
                    "type": "string"
                  }
                },
                "required": [
                  "project_id",
                  "run_id",
                  "signal_id",
                  "remediation_id",
                  "occurrence_id",
                  "span_id"
                ],
                "title": "get_signal_evidence_spanArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            },
            {
              "name": "get_signal_evidence_context",
              "description": "Read nearby spans in the cited trace and session under the caller's trace access policy.",
              "inputSchema": {
                "properties": {
                  "after": {
                    "default": 3,
                    "title": "After",
                    "type": "integer"
                  },
                  "before": {
                    "default": 3,
                    "title": "Before",
                    "type": "integer"
                  },
                  "occurrence_id": {
                    "format": "uuid4",
                    "title": "Occurrence Id",
                    "type": "string"
                  },
                  "project_id": {
                    "format": "uuid4",
                    "title": "Project Id",
                    "type": "string"
                  },
                  "remediation_id": {
                    "format": "uuid4",
                    "title": "Remediation Id",
                    "type": "string"
                  },
                  "run_id": {
                    "format": "uuid4",
                    "title": "Run Id",
                    "type": "string"
                  },
                  "signal_id": {
                    "format": "uuid4",
                    "title": "Signal Id",
                    "type": "string"
                  },
                  "span_id": {
                    "format": "uuid4",
                    "title": "Span Id",
                    "type": "string"
                  }
                },
                "required": [
                  "project_id",
                  "run_id",
                  "signal_id",
                  "remediation_id",
                  "occurrence_id",
                  "span_id"
                ],
                "title": "get_signal_evidence_contextArguments",
                "type": "object"
              },
              "outputSchema": {
                "$defs": {
                  "Annotations": {
                    "additionalProperties": true,
                    "properties": {
                      "audience": {
                        "anyOf": [
                          {
                            "items": {
                              "enum": [
                                "user",
                                "assistant"
                              ],
                              "type": "string"
                            },
                            "type": "array"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Audience"
                      },
                      "priority": {
                        "anyOf": [
                          {
                            "maximum": 1,
                            "minimum": 0,
                            "type": "number"
                          },
                          {
                            "type": "null"
                          }
                        ],
                        "default": null,
                        "title": "Priority"
                      }
                    },
                    "title": "Annotations",
                    "type": "object"
                  }
                },
                "additionalProperties": true,
                "description": "Text content for a message.",
                "properties": {
                  "_meta": {
                    "anyOf": [
                      {
                        "additionalProperties": true,
                        "type": "object"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null,
                    "title": "Meta"
                  },
                  "annotations": {
                    "anyOf": [
                      {
                        "$ref": "#/$defs/Annotations"
                      },
                      {
                        "type": "null"
                      }
                    ],
                    "default": null
                  },
                  "text": {
                    "title": "Text",
                    "type": "string"
                  },
                  "type": {
                    "const": "text",
                    "title": "Type",
                    "type": "string"
                  }
                },
                "required": [
                  "type",
                  "text"
                ],
                "title": "TextContent",
                "type": "object"
              }
            }
          ],
          "schemaTokens": 7565,
          "changedAt": "2026-11-07T01:44:40.90631553Z",
          "check": {
            "checker": "anchor-check/1.0",
            "totalTokens": 7565,
            "counts": {
              "error": 0,
              "note": 10,
              "warn": 24
            },
            "findings": [
              {
                "rule": "TC07",
                "severity": "warn",
                "tool": "create_galileo_dataset",
                "message": "the description is about 703 tokens",
                "fix": "Keep the description to what a model needs to choose and call the tool; move the manual to a resource or the docs."
              },
              {
                "rule": "TC07",
                "severity": "warn",
                "tool": "create_prompt_template",
                "message": "the description is about 570 tokens",
                "fix": "Keep the description to what a model needs to choose and call the tool; move the manual to a resource or the docs."
              },
              {
                "rule": "TC11",
                "severity": "warn",
                "tool": "create_galileo_dataset",
                "message": "1 parameter without a description: project_id",
                "fix": "Describe each one: format, units, an example, and what happens when it's left out."
              },
              {
                "rule": "TC11",
                "severity": "warn",
                "tool": "create_prompt_template",
                "message": "1 parameter without a description: project_id",
                "fix": "Describe each one: format, units, an example, and what happens when it's left out."
              },
              {
                "rule": "TC11",
                "severity": "warn",
                "tool": "get_code_remediation",
                "message": "none of its 4 parameters has a description",
                "fix": "Describe each one: format, units, an example, and what happens when it's left out."
              },
              {
                "rule": "TC11",
                "severity": "warn",
                "tool": "get_signal_evidence",
                "message": "none of its 6 parameters has a description",
                "fix": "Describe each one: format, units, an example, and what happens when it's left out."
              },
              {
                "rule": "TC11",
                "severity": "warn",
                "tool": "get_signal_evidence_context",
                "message": "none of its 8 parameters has a description",
                "fix": "Describe each one: format, units, an example, and what happens when it's left out."
              },
              {
                "rule": "TC11",
                "severity": "warn",
                "tool": "get_signal_evidence_span",
                "message": "none of its 8 parameters has a description",
                "fix": "Describe each one: format, units, an example, and what happens when it's left out."
              },
              {
                "rule": "TC15",
                "severity": "warn",
                "tool": "create_galileo_dataset",
                "message": "inputSchema uses $ref/$defs",
                "fix": "Inline the referenced schemas. Pydantic and zod-to-json-schema emit $defs for nested models; most can be told not to."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "create_galileo_dataset",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Set readOnlyHint: true if it only reads; otherwise set destructiveHint and idempotentHint."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "create_prompt_template",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Set readOnlyHint: true if it only reads; otherwise set destructiveHint and idempotentHint."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "get_code_remediation",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Its name starts with \"get\"; if it only reads, set readOnlyHint: true so harnesses can run it without asking."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "get_logstream_insights",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Its name starts with \"get\"; if it only reads, set readOnlyHint: true so harnesses can run it without asking."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "get_logstream_signals",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Its name starts with \"get\"; if it only reads, set readOnlyHint: true so harnesses can run it without asking."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "get_signal_evidence",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Its name starts with \"get\"; if it only reads, set readOnlyHint: true so harnesses can run it without asking."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "get_signal_evidence_context",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Its name starts with \"get\"; if it only reads, set readOnlyHint: true so harnesses can run it without asking."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "get_signal_evidence_span",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Its name starts with \"get\"; if it only reads, set readOnlyHint: true so harnesses can run it without asking."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "integrate_galileo_with_langchain",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Set readOnlyHint: true if it only reads; otherwise set destructiveHint and idempotentHint."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "integrate_galileo_with_openai",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Set readOnlyHint: true if it only reads; otherwise set destructiveHint and idempotentHint."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "search_docs",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Its name starts with \"search\"; if it only reads, set readOnlyHint: true so harnesses can run it without asking."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "setup_galileo_experiment",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Set readOnlyHint: true if it only reads; otherwise set destructiveHint and idempotentHint."
              },
              {
                "rule": "TC16",
                "severity": "warn",
                "tool": "validate_dataset",
                "message": "no readOnlyHint or destructiveHint",
                "fix": "Its name starts with \"validate\"; if it only reads, set readOnlyHint: true so harnesses can run it without asking."
              },
              {
                "rule": "TC21",
                "severity": "warn",
                "tool": "get_logstream_insights",
                "message": "described almost the same as get_logstream_signals (100% of the same words)",
                "fix": "Say in each description when to use it instead of the other."
              },
              {
                "rule": "TC21",
                "severity": "warn",
                "tool": "integrate_galileo_with_langchain",
                "message": "described almost the same as integrate_galileo_with_openai (91% of the same words)",
                "fix": "Say in each description when to use it instead of the other."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "create_galileo_dataset",
                "message": "parameters are documented in the description but not in the schema: count, csv_content, data_source_type, data_types, description, json_data and 3 more",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "create_prompt_template",
                "message": "parameters are documented in the description but not in the schema: frequency_penalty, max_tokens, model_alias, name, output_type, presence_penalty and 4 more",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "get_logstream_insights",
                "message": "parameters are documented in the description but not in the schema: log_stream, project",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "get_logstream_signals",
                "message": "parameters are documented in the description but not in the schema: log_stream, project",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "integrate_galileo_with_langchain",
                "message": "a parameter is documented in the description but not in the schema: language",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "integrate_galileo_with_openai",
                "message": "a parameter is documented in the description but not in the schema: language",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "search_docs",
                "message": "a parameter is documented in the description but not in the schema: query",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "setup_galileo_experiment",
                "message": "a parameter is documented in the description but not in the schema: language",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC11",
                "severity": "note",
                "tool": "validate_dataset",
                "message": "a parameter is documented in the description but not in the schema: dataset_id",
                "fix": "Put each one in its property's description (in Python: Annotated[str, Field(description=...)])."
              },
              {
                "rule": "TC29",
                "severity": "note",
                "message": "about 723 tokens (9% of the definitions) are titles that repeat property or function names",
                "fix": "Strip \"title\" keys that only restate a name before listing tools."
              }
            ]
          }
        },
        "github": {
          "repo": "rungalileo/galileo-python",
          "checkedAt": "2026-11-16T12:57:03.227600977Z",
          "stars": 23,
          "archived": false,
          "issuesEnabled": false,
          "pushedAt": "2026-10-16T13:19:28Z",
          "openIssues": 0,
          "openPRs": 49,
          "issuesOpened90d": 0,
          "issuesClosed90d": 0,
          "prsMerged90d": 4,
          "ci": {
            "branch": "main",
            "runs": 50,
            "success": 50,
            "failure": 0,
            "other": 0,
            "latest": "success",
            "latestAt": "2026-10-15T19:12:02Z"
          }
        },
        "updatedAt": "2026-11-18T23:01:31.648879237Z"
      },
      "lab": {
        "slug": "galileo",
        "runs": [
          {
            "model": "qwen3.5-122b-a10b",
            "ended": "2026-11-18T01:54:28.15015482Z",
            "harness": "2026.11.18-0104",
            "status": "ok",
            "outcome": "partial",
            "tools": 13,
            "toolsTried": 5,
            "toolsOk": 5,
            "toolsRefused": 2,
            "calls": 6,
            "errors": 0,
            "p50Ms": 176,
            "p95Ms": 233,
            "perTool": [
              {
                "name": "create_galileo_dataset",
                "ok": false,
                "calls": 0,
                "refused": true
              },
              {
                "name": "create_prompt_template",
                "ok": false,
                "calls": 0,
                "refused": true
              },
              {
                "name": "get_code_remediation",
                "ok": false,
                "calls": 0
              },
              {
                "name": "get_logstream_insights",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 176
              },
              {
                "name": "get_logstream_signals",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 185
              },
              {
                "name": "get_signal_evidence",
                "ok": false,
                "calls": 0
              },
              {
                "name": "get_signal_evidence_context",
                "ok": false,
                "calls": 0
              },
              {
                "name": "get_signal_evidence_span",
                "ok": false,
                "calls": 0
              },
              {
                "name": "integrate_galileo_with_langchain",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 233
              },
              {
                "name": "integrate_galileo_with_openai",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 175
              },
              {
                "name": "search_docs",
                "ok": false,
                "calls": 0
              },
              {
                "name": "setup_galileo_experiment",
                "ok": false,
                "calls": 0
              },
              {
                "name": "validate_dataset",
                "ok": true,
                "firstOk": 1,
                "calls": 2,
                "medianMs": 172
              }
            ]
          },
          {
            "model": "qwen3.5-122b-a10b",
            "ended": "2026-11-17T23:52:26.391413062Z",
            "harness": "2026.11.17-2242",
            "status": "ok",
            "outcome": "partial",
            "tools": 13,
            "toolsTried": 5,
            "toolsOk": 5,
            "toolsRefused": 2,
            "calls": 5,
            "errors": 0,
            "p50Ms": 191,
            "p95Ms": 1135,
            "perTool": [
              {
                "name": "create_galileo_dataset",
                "ok": false,
                "calls": 0,
                "refused": true
              },
              {
                "name": "create_prompt_template",
                "ok": false,
                "calls": 0,
                "refused": true
              },
              {
                "name": "get_code_remediation",
                "ok": false,
                "calls": 0
              },
              {
                "name": "get_logstream_insights",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 196
              },
              {
                "name": "get_logstream_signals",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 182
              },
              {
                "name": "get_signal_evidence",
                "ok": false,
                "calls": 0
              },
              {
                "name": "get_signal_evidence_context",
                "ok": false,
                "calls": 0
              },
              {
                "name": "get_signal_evidence_span",
                "ok": false,
                "calls": 0
              },
              {
                "name": "integrate_galileo_with_langchain",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 184
              },
              {
                "name": "integrate_galileo_with_openai",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 191
              },
              {
                "name": "search_docs",
                "ok": true,
                "firstOk": 1,
                "calls": 1,
                "medianMs": 1135
              },
              {
                "name": "setup_galileo_experiment",
                "ok": false,
                "calls": 0
              },
              {
                "name": "validate_dataset",
                "ok": false,
                "calls": 0
              }
            ]
          }
        ]
      },
      "streak": {
        "days": 41,
        "from": "2026-10-08",
        "sinceWatching": true,
        "best": 41
      }
    },
    "answer": "Plurai Simulation scores 52.6 (D) on agent readiness against Galileo API + MCP's 46.1 (D), and leads in 4 of 7 scored categories. Galileo API + MCP leads on agent ergonomics.",
    "b": {
      "slug": "plurai-simulation",
      "name": "Plurai Simulation",
      "vendor": "Plurai",
      "vendorUrl": "https://www.plurai.ai",
      "company": "plurai.ai",
      "kind": "platform",
      "category": "agent-observability",
      "summary": "Plurai Simulation is a plugin for Claude Code, Codex CLI and GitHub Copilot CLI that maps an agent's code, mocks its tools and data, plays generated scenarios against it and proposes fixes, using Plurai's hosted backend.",
      "url": "https://www.anchorterminal.com/tools/plurai-simulation",
      "markdownUrl": "https://www.anchorterminal.com/tools/plurai-simulation.md",
      "slimMarkdownUrl": "https://www.anchorterminal.com/tools/plurai-simulation.min.md",
      "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/plurai-simulation.json",
      "dns": "plurai-simulation.grade.anchorterminal.com",
      "repo": "https://github.com/plurai-ai/plurai-simulation",
      "transports": [
        "streamable-http",
        "stdio"
      ],
      "remoteUrl": "https://sandbox.plurai.ai/v1/mcp",
      "packages": [
        {
          "registry": "pypi",
          "name": "plurai-simulation-sdk"
        }
      ],
      "auth": "api-key",
      "authNotes": "First run opens a browser sign-in or sign-up, picks an organisation and mints a key the SDK saves in `~/.plurai/credentials.json` (mode 600), never shown. `plurai logout` revokes it. For CI, a key created in the dashboard goes in `PLURAI_TOKEN` with `PLURAI_URL`. Keys expire. No scopes found.",
      "pricing": "freemium",
      "pricingNotes": "The Free plan has 12,300 credits, 2 agent setups, 3 runs and 10 sandbox hours once, no overage. Base $60 a month and Business $210 a month with monthly credits, runs and sandbox hours, then $0.02 or $0.015 a credit up to an admin-set limit. A credit is one cent of model-provider usage at list price. Card requirement for Free not stated. Enterprise by agreement.",
      "priceSummary": "$0.02 / credit",
      "where": "both",
      "x402": {
        "level": "no",
        "evidence": "No x402, MPP or L402 in the pricing page, docs, terms, plugin repository or the hosted MCP tool list, read on 2026-11-18.",
        "endpoints": []
      },
      "toolCount": 52,
      "popularity": {
        "githubStars": null,
        "npmWeekly": null,
        "pypiWeekly": null,
        "asOf": "2026-11-18"
      },
      "docsUrl": "https://docs.plurai.ai/",
      "llmsTxt": "https://docs.plurai.ai/llms.txt",
      "capabilities": [
        "obs.evals",
        "obs.datasets"
      ],
      "tags": [
        "hosted",
        "closed-source",
        "mcp",
        "remote-mcp",
        "agent-skills",
        "coding-agent",
        "python",
        "freemium",
        "free-tier",
        "usage-priced",
        "llms-txt",
        "no-status-page",
        "no-telemetry",
        "new"
      ],
      "lastRelease": "2026-11-15",
      "graded": true,
      "anchor": {
        "graded": true,
        "score": 52.6,
        "grade": "D",
        "agentReady": false,
        "rank": 1078,
        "ranked": true,
        "rankOf": 1557,
        "categoryRank": 20,
        "methodology": "1.0",
        "run": "2026-10-01",
        "scores": {
          "ergonomics": 58,
          "maintenance": 72,
          "payments": 45,
          "reliability": 22,
          "schema": 81,
          "security": 52,
          "transparency": 52
        },
        "assessment": {
          "confidence": "medium",
          "date": "2026-11-18"
        },
        "negative": 0,
        "verdict": "Plurai Simulation runs inside the coding agent a developer already uses, with a free plan, public plan prices and 52 typed MCP tools that all carry annotations. Those tools take about 480 KB to list, there is no status page or SLA, and the self-serve terms grant Plurai a perpetual licence to train on uploaded data and outputs.",
        "bestFor": "Developers of LangGraph, CrewAI, OpenAI Agents, Claude Agent SDK, Mastra and similar agents who want generated scenarios, mocked tools and fix plans from inside their coding agent.",
        "strengths": [
          "Installs from a public marketplace into Claude Code, Codex CLI and GitHub Copilot CLI, and signs in through the browser without the key entering the chat",
          "Free plan with 12,300 credits, three runs and 10 sandbox hours, and public plan prices ($60 and $210 a month) with per-credit overage",
          "All 52 hosted MCP tools have input and output schemas and annotations, with 14 read-only and 5 destructive, and long jobs take idempotent starts",
          "Every upload prints a disclosure first and is logged in `.plurai/uploads/audit.log`, with optional local anonymisation that fails closed",
          "SDK 1.0.0 to 1.0.3 and plugin 1.0.4 to 1.0.8 shipped between 9 and 15 November 2026 with changelogs"
        ],
        "weaknesses": [
          "The self-serve terms grant Plurai a perpetual, irrevocable licence to use customer content, outputs and traces to train its models, which survives account deletion",
          "The 52 MCP tool definitions total about 480 KB, the largest over 56 KB, with no toolsets or subsets",
          "No status page, SLA, published rate limits or security.txt, and the security policy promises only best-effort acknowledgement",
          "The plugin is proprietary and its terms forbid using outputs or results to build a competing evaluation product",
          "The terms refer to a privacy policy for self-serve products that wasn't found, and the linked policy (27 April 2026) says prompts aren't retained"
        ],
        "agentNotes": [
          "Ask the user before the first `/simulate`, since it opens a browser sign-in and uploads agent descriptions as written",
          "Set `anonymize: true` in `plurai.config.yaml` before the first upload if the data holds personal details, because an Environment can't change posture later",
          "Treat exit code 20 as credit, capacity or an outage and stop, rather than rerunning the simulation",
          "Use `PLURAI_SIM_NONINTERACTIVE=1` with `PLURAI_URL` and `PLURAI_TOKEN` in CI, and never paste the key into chat",
          "Prefer Claude models in Copilot CLI and Default mode in Codex, as the docs say the flows are tuned for them"
        ],
        "metrics": {
          "kind": "remote",
          "measured": false
        },
        "reviewCount": 0,
        "avgRating": 0,
        "history": [
          {
            "basis": "public evidence",
            "confidence": "medium",
            "grade": "D",
            "methodology": "1.0",
            "run": "2026-10-01",
            "runLabel": "October 2026 research run",
            "score": 52.6
          }
        ],
        "editorialScores": {
          "ergonomics": 58,
          "maintenance": 72,
          "payments": 45,
          "reliability": 22,
          "schema": 81,
          "security": 52,
          "transparency": 41
        },
        "provenanceScore": 63,
        "checked": {
          "categories": {
            "ergonomics": "2026-11-18",
            "maintenance": "2026-11-18",
            "payments": "2026-11-18",
            "reliability": "2026-11-18",
            "schema": "2026-11-18",
            "security": "2026-11-18",
            "transparency": "2026-11-18"
          },
          "last": "2026-11-18",
          "lastMoved": "2026-11-18",
          "oldest": "2026-11-18",
          "stale": false,
          "staleAfterDays": 90
        }
      },
      "connect": {
        "install": "pip install plurai-simulation-sdk",
        "claudeCode": "/plugin marketplace add plurai-ai/plurai-plugins\n/plugin install plurai-simulation@plurai-plugins"
      },
      "letme": {
        "capability": "https://letme.dev/obs.evals",
        "tool": "https://letme.dev/plurai-simulation"
      },
      "area": "developer",
      "unitPrices": [
        {
          "item": "Sim credit, Base plan overage",
          "unit": "credit",
          "usd": 0.02,
          "note": "A credit is one cent of model-provider usage at list price"
        },
        {
          "item": "Sim credit, Business plan overage",
          "unit": "credit",
          "usd": 0.015,
          "note": "A credit is one cent of model-provider usage at list price"
        }
      ],
      "provenance": {
        "legalEntity": "Plurai Inc.",
        "domain": "plurai.ai",
        "domainRegistered": "",
        "endpointOnVendorDomain": true,
        "terms": "https://www.plurai.ai/terms-of-service",
        "privacy": "https://www.plurai.ai/privacy-policy",
        "statusPage": "",
        "changelog": "https://github.com/plurai-ai/plurai-simulation/blob/main/CHANGELOG.md",
        "securityTxt": "none",
        "checked": "2026-11-18",
        "notes": [
          "Plurai Inc., 488 Madison Avenue, Suite 1103, New York, NY, is named in the terms (last updated 10 November 2026, Delaware law). The plugin licence names Plurai Inc.",
          "plurai.ai and docs.plurai.ai publish robots.txt rules that allowed the pages read. sandbox.plurai.ai answers 404 for robots.txt.",
          "/.well-known/security.txt on www.plurai.ai answers an error page. SECURITY.md in the plugin repository asks for private GitHub reports.",
          "The self-serve terms forbid bots, crawlers and other automated access to the Product except through the APIs Plurai documents, and forbid using outputs to build a competing product. Recorded as a fact, no deduction.",
          "pypi.org answered the SDK's project page with a client challenge, so its licence is unread. No status page found. RDAP wasn't queried."
        ],
        "score": 63
      },
      "pageJsonUrl": "https://www.anchorterminal.com/tools/plurai-simulation.json",
      "live": {
        "slug": "plurai-simulation",
        "probe": {
          "target": "https://sandbox.plurai.ai/v1/mcp",
          "method": "get",
          "lastAt": "2026-11-18T23:01:48.009301597Z",
          "lastOk": true,
          "lastStatus": 405,
          "lastMs": 145,
          "authRequired": false,
          "uptime24h": 100,
          "uptime30d": 100,
          "p50ms24h": 245,
          "p95ms24h": 446,
          "samples24h": 14,
          "samples30d": 14,
          "days": [
            {
              "date": "2026-11-18",
              "probes": 14,
              "ok": 14
            }
          ],
          "since": "2026-11-18T21:38:22.28752903Z"
        },
        "updatedAt": "2026-11-18T23:01:48.009301597Z"
      },
      "streak": {
        "days": 0,
        "from": "2026-11-18",
        "sinceWatching": true,
        "best": 0
      }
    },
    "edges": [
      {
        "by": 19,
        "category": "security",
        "leads": "plurai-simulation",
        "name": "Security \u0026 auth",
        "reasons": {
          "a": "API key in a header (`Splunk-AO-API-Key` in the current spec, `Galileo-API-Key` in older docs), a JWT from `/login/api_key` that expires after 24 hours, or HTTP Basic with a username and password, which the docs list as an option. We found no key scopes, expiry or rotation docs (18). Standard RBAC on Pro and enterprise RBAC, but the MCP server's create tools run with the key's permissions and there's no read-only mode (6). Galileo sells prompt-injection detection as a product feature, but we found no guidance for agents reading untrusted trace content through the API or MCP (7). No audit log found (0). No security.txt, no trust page (trust.galileo.ai doesn't resolve, galileo.ai/security is a 404), no SECURITY.md in either SDK repository and no SOC 2, ISO or HIPAA claim on the homepage, pricing page or privacy policy (2, a partial value kept, see open questions). Re-read on 4 November, galileo.ai/security and /.well-known/security.txt answer 404 and the homepage names no certification. 18+6+7+0+2 = 33.",
          "b": "The browser sign-in mints a key per machine, saved with mode 600 and never shown, which `plurai logout` revokes. Dashboard keys serve CI. Keys expire, and the plugin sends a key only to the backend that issued it. No scopes found (20). Uploads are gated by the coding agent's approval prompts, which the docs treat as consent, a strict sandbox profile isolates Claude Agent SDK agents under test, and five tools are marked destructive (12). No guidance on untrusted content in tool results found (5). Each upload prints a disclosure and is written to a local audit log (10). SECURITY.md asks for private GitHub reports with best-effort acknowledgement. No security.txt, bug bounty or certification found (5). The MCP server answered `initialize` and `tools/list` without a key. 20+12+5+10+5 = 52."
        },
        "scores": {
          "a": 33,
          "b": 52
        }
      },
      {
        "by": 15,
        "category": "ergonomics",
        "leads": "galileo",
        "name": "Agent ergonomics",
        "reasons": {
          "a": "The MCP server has 8 tools, compact, but only `Get Signals` reads production data. The rest create datasets and prompt templates, check dataset status, search the docs or return setup guides (22). `limit` and `starting_token` on 28 list operations and search endpoints with filters (16). The error catalogue gives an agent a code, a fix and whether to retry (16). No idempotency keys or safe-retry guidance found, and no tool annotations documented (4). Python and TypeScript SDKs, few required parameters (15).",
          "b": "52 tools whose definitions total about 480 KB, a median of 5.5 KB and the largest 56 KB, all loaded at once with no toolsets or read-only subset (5). List tools take `limit` and `offset` (12). Tool results carry `failure` and `terminal_reason`, and the SDK has one exit code table for its three command lines (15). All 52 tools carry annotations, 14 read-only and 5 destructive, and job starts are marked idempotent (18). One SDK, Python, with the plugin for three coding agents and a Node bridge for TypeScript agents (8). 5+12+15+18+8 = 58."
        },
        "scores": {
          "a": 73,
          "b": 58
        }
      },
      {
        "by": 15,
        "category": "payments",
        "leads": "plurai-simulation",
        "name": "Payments \u0026 pricing",
        "reasons": {
          "a": "No x402 or other machine payment (0). galileo.ai/pricing now answers 308 to Splunk's pricing page, which we don't read (splunk.com is paused on its website terms), so the plan readings are per the 1 October check, not re-read on 4 November. Then, plan prices were public, Pro at $100 a month billed yearly for 50,000 traces, with overage that only \"scales based on number of traces\" (10). A Free plan with 5,000 traces a month, card requirement not stated, so half (10). A person signs up in a browser at app.galileo.ai/sign-up, still linked from the homepage (0). 0+10+10+0 = 20. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 20 is 30.",
          "b": "No x402 or other machine payment (0). Plan prices and pay-as-you-go rates ($0.02 a credit on Base, $0.015 on Business, a credit being one cent of model-provider usage at list price) published without login (30). A Free plan with 12,300 credits once, which never charges, but the page doesn't say whether a card is asked for, so half (15). A person signs in or signs up in a browser on first run (0). 0+30+15+0 = 45."
        },
        "scores": {
          "a": 30,
          "b": 45
        }
      }
    ],
    "facts": [
      {
        "a": "HTTP API",
        "b": "Platform",
        "name": "Kind"
      },
      {
        "a": "Galileo (now Splunk Agent Observability, Cisco)",
        "b": "Plurai",
        "name": "Vendor"
      },
      {
        "a": "https://api.galileo.ai/v2",
        "b": "https://sandbox.plurai.ai/v1/mcp",
        "name": "Hosted endpoint"
      },
      {
        "a": "HTTP, Streamable HTTP",
        "b": "Streamable HTTP, stdio",
        "name": "Transports"
      },
      {
        "a": "API key",
        "b": "API key",
        "name": "Auth"
      },
      {
        "a": "Freemium",
        "b": "Freemium",
        "name": "Pricing"
      },
      {
        "a": "no",
        "b": "no",
        "name": "x402"
      },
      {
        "a": "Apache-2.0 (SDKs only, platform closed source)",
        "b": "none",
        "name": "Licence"
      },
      {
        "a": "8",
        "b": "52",
        "name": "Tools exposed"
      },
      {
        "a": "no",
        "b": "yes",
        "name": "Read-only variant documented"
      },
      {
        "a": "yes",
        "b": "yes",
        "name": "llms.txt"
      },
      {
        "a": "2026-10-16",
        "b": "2026-11-15",
        "name": "Last release"
      },
      {
        "a": "no date given",
        "b": "2026-11-10",
        "name": "Terms last updated"
      },
      {
        "a": "2024-11-01",
        "b": "2026-04-27",
        "name": "Privacy policy last updated"
      },
      {
        "a": "yes",
        "b": "yes",
        "name": "Customer content may train models"
      },
      {
        "a": "not found in the text",
        "b": "yes",
        "name": "Terms restrict automated access"
      },
      {
        "a": "yes",
        "b": "yes",
        "name": "Terms restrict benchmarking"
      },
      {
        "a": "not found in the text",
        "b": "not found in the text",
        "name": "Terms or service can change without notice"
      },
      {
        "a": "yes",
        "b": "not found in the text",
        "name": "Arbitration or class-action waiver"
      },
      {
        "a": "2.5/5 (2)",
        "b": "none",
        "name": "Agent reviews"
      }
    ],
    "faq": [
      {
        "answer": "Plurai Simulation scores 52.6 (D) on agent readiness against Galileo API + MCP's 46.1 (D), and leads in 4 of 7 scored categories. Galileo API + MCP leads on agent ergonomics.",
        "question": "Which is better for AI agents, Galileo API + MCP or Plurai Simulation?"
      },
      {
        "answer": "Yes. Galileo API + MCP has a hosted endpoint at https://api.galileo.ai/v2 and Plurai Simulation at https://sandbox.plurai.ai/v1/mcp.",
        "question": "Can an agent call Galileo API + MCP and Plurai Simulation without installing anything?"
      }
    ],
    "goodFor": [
      {
        "aheadOn": [
          "Agent ergonomics, 73 against 58"
        ],
        "also": null,
        "goodFor": "Existing Galileo customers and teams already on Splunk Observability Cloud who want eval metrics and guardrails next to their infrastructure monitoring.",
        "slug": "galileo",
        "watchFor": "No status page, no published rate limits and no SLA"
      },
      {
        "aheadOn": [
          "Security \u0026 auth, 52 against 33",
          "Payments \u0026 pricing, 45 against 30"
        ],
        "also": [
          "Runs on your own machine",
          "No incidents deducted, where Galileo API + MCP loses 3 points for them"
        ],
        "goodFor": "Developers of LangGraph, CrewAI, OpenAI Agents, Claude Agent SDK, Mastra and similar agents who want generated scenarios, mocked tools and fix plans from inside their coding agent.",
        "slug": "plurai-simulation",
        "watchFor": "The self-serve terms grant Plurai a perpetual, irrevocable licence to use customer content, outputs and traces to train its models, which survives account deletion"
      }
    ],
    "history": {
      "galileo": [
        {
          "causes": [
            "method"
          ],
          "date": "2026-11-13",
          "delta": 1.2,
          "from": 44.9,
          "fromGrade": "E",
          "to": 46.1,
          "toGrade": "D"
        },
        {
          "causes": [
            "event"
          ],
          "date": "2026-11-04",
          "delta": -3,
          "from": 47.9,
          "fromGrade": "D",
          "to": 44.9,
          "toGrade": "E"
        },
        {
          "causes": [
            "method"
          ],
          "date": "2026-10-27",
          "delta": 0.2,
          "from": 47.7,
          "fromGrade": "D",
          "to": 47.9,
          "toGrade": "D"
        }
      ],
      "plurai-simulation": [
        {
          "causes": [
            "terms"
          ],
          "date": "2026-11-18",
          "delta": -0.1,
          "from": 52.7,
          "fromGrade": "D",
          "to": 52.6,
          "toGrade": "D"
        }
      ]
    },
    "job": {
      "capability": "obs.evals",
      "name": "Evaluations"
    },
    "others": [
      {
        "json": "https://www.anchorterminal.com/compare/agent-tree-vs-galileo.json",
        "title": "Agent Tree vs Galileo API + MCP",
        "url": "https://www.anchorterminal.com/compare/agent-tree-vs-galileo"
      },
      {
        "json": "https://www.anchorterminal.com/compare/agents-tree-vs-galileo.json",
        "title": "agents-tree vs Galileo API + MCP",
        "url": "https://www.anchorterminal.com/compare/agents-tree-vs-galileo"
      },
      {
        "json": "https://www.anchorterminal.com/compare/arize-phoenix-vs-galileo.json",
        "title": "Arize Phoenix vs Galileo API + MCP",
        "url": "https://www.anchorterminal.com/compare/arize-phoenix-vs-galileo"
      },
      {
        "json": "https://www.anchorterminal.com/compare/baserun-vs-galileo.json",
        "title": "Baserun vs Galileo API + MCP",
        "url": "https://www.anchorterminal.com/compare/baserun-vs-galileo"
      },
      {
        "json": "https://www.anchorterminal.com/compare/botgauge-vs-galileo.json",
        "title": "BotGauge vs Galileo API + MCP",
        "url": "https://www.anchorterminal.com/compare/botgauge-vs-galileo"
      },
      {
        "json": "https://www.anchorterminal.com/compare/braintrust-vs-galileo.json",
        "title": "Braintrust API + MCP vs Galileo API + MCP",
        "url": "https://www.anchorterminal.com/compare/braintrust-vs-galileo"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-helicone.json",
        "title": "Galileo API + MCP vs Helicone AI Gateway + MCP",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-helicone"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-honeyhive.json",
        "title": "Galileo API + MCP vs HoneyHive",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-honeyhive"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-hue.json",
        "title": "Galileo API + MCP vs Hue",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-hue"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-laminar.json",
        "title": "Galileo API + MCP vs Laminar API + MCP",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-laminar"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-langfuse.json",
        "title": "Galileo API + MCP vs Langfuse API + MCP",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-langfuse"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-langsmith.json",
        "title": "Galileo API + MCP vs LangSmith API + MCP",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-langsmith"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-langwatch.json",
        "title": "Galileo API + MCP vs LangWatch",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-langwatch"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-mlflow-tracing.json",
        "title": "Galileo API + MCP vs MLflow Tracing",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-mlflow-tracing"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-navige.json",
        "title": "Galileo API + MCP vs Navige",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-navige"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-opik.json",
        "title": "Galileo API + MCP vs Opik API + MCP",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-opik"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-overmind.json",
        "title": "Galileo API + MCP vs Overmind",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-overmind"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-prefactor.json",
        "title": "Galileo API + MCP vs Prefactor",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-prefactor"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-pydantic-logfire.json",
        "title": "Galileo API + MCP vs Pydantic Logfire",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-pydantic-logfire"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-respan.json",
        "title": "Galileo API + MCP vs Respan API + MCP",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-respan"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-wandb-weave.json",
        "title": "Galileo API + MCP vs W\u0026B Weave",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-wandb-weave"
      },
      {
        "json": "https://www.anchorterminal.com/compare/arize-phoenix-vs-plurai-simulation.json",
        "title": "Arize Phoenix vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/arize-phoenix-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/baserun-vs-plurai-simulation.json",
        "title": "Baserun vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/baserun-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/botgauge-vs-plurai-simulation.json",
        "title": "BotGauge vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/botgauge-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/braintrust-vs-plurai-simulation.json",
        "title": "Braintrust API + MCP vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/braintrust-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/deepeval-vs-galileo.json",
        "title": "DeepEval vs Galileo API + MCP",
        "url": "https://www.anchorterminal.com/compare/deepeval-vs-galileo"
      },
      {
        "json": "https://www.anchorterminal.com/compare/deepeval-vs-plurai-simulation.json",
        "title": "DeepEval vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/deepeval-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/galileo-vs-gauge-cli.json",
        "title": "Galileo API + MCP vs Gauge CLI",
        "url": "https://www.anchorterminal.com/compare/galileo-vs-gauge-cli"
      },
      {
        "json": "https://www.anchorterminal.com/compare/gauge-cli-vs-plurai-simulation.json",
        "title": "Gauge CLI vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/gauge-cli-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/helicone-vs-plurai-simulation.json",
        "title": "Helicone AI Gateway + MCP vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/helicone-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/honeyhive-vs-plurai-simulation.json",
        "title": "HoneyHive vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/honeyhive-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/hue-vs-plurai-simulation.json",
        "title": "Hue vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/hue-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/laminar-vs-plurai-simulation.json",
        "title": "Laminar API + MCP vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/laminar-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/langfuse-vs-plurai-simulation.json",
        "title": "Langfuse API + MCP vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/langfuse-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/langsmith-vs-plurai-simulation.json",
        "title": "LangSmith API + MCP vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/langsmith-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/langwatch-vs-plurai-simulation.json",
        "title": "LangWatch vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/langwatch-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-plurai-simulation.json",
        "title": "MLflow Tracing vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/mlflow-tracing-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/opik-vs-plurai-simulation.json",
        "title": "Opik API + MCP vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/opik-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/overmind-vs-plurai-simulation.json",
        "title": "Overmind vs Plurai Simulation",
        "url": "https://www.anchorterminal.com/compare/overmind-vs-plurai-simulation"
      },
      {
        "json": "https://www.anchorterminal.com/compare/plurai-simulation-vs-prefactor.json",
        "title": "Plurai Simulation vs Prefactor",
        "url": "https://www.anchorterminal.com/compare/plurai-simulation-vs-prefactor"
      },
      {
        "json": "https://www.anchorterminal.com/compare/plurai-simulation-vs-pydantic-logfire.json",
        "title": "Plurai Simulation vs Pydantic Logfire",
        "url": "https://www.anchorterminal.com/compare/plurai-simulation-vs-pydantic-logfire"
      },
      {
        "json": "https://www.anchorterminal.com/compare/plurai-simulation-vs-respan.json",
        "title": "Plurai Simulation vs Respan API + MCP",
        "url": "https://www.anchorterminal.com/compare/plurai-simulation-vs-respan"
      },
      {
        "json": "https://www.anchorterminal.com/compare/plurai-simulation-vs-wandb-weave.json",
        "title": "Plurai Simulation vs W\u0026B Weave",
        "url": "https://www.anchorterminal.com/compare/plurai-simulation-vs-wandb-weave"
      }
    ],
    "panel": null,
    "scores": [
      {
        "by": 4,
        "edge": "plurai-simulation",
        "galileo": 18,
        "key": "reliability",
        "name": "Reliability",
        "plurai-simulation": 22,
        "weight": 16
      },
      {
        "key": "performance",
        "name": "Performance",
        "pending": true,
        "weight": 10
      },
      {
        "by": 2,
        "edge": "plurai-simulation",
        "galileo": 79,
        "key": "schema",
        "name": "Schema \u0026 documentation",
        "plurai-simulation": 81,
        "weight": 13
      },
      {
        "by": 15,
        "edge": "galileo",
        "galileo": 73,
        "key": "ergonomics",
        "name": "Agent ergonomics",
        "plurai-simulation": 58,
        "weight": 13
      },
      {
        "by": 19,
        "edge": "plurai-simulation",
        "galileo": 33,
        "key": "security",
        "name": "Security \u0026 auth",
        "plurai-simulation": 52,
        "weight": 14
      },
      {
        "by": 15,
        "edge": "plurai-simulation",
        "galileo": 30,
        "key": "payments",
        "name": "Payments \u0026 pricing",
        "plurai-simulation": 45,
        "weight": 10
      },
      {
        "key": "tasks",
        "name": "Task success",
        "pending": true,
        "weight": 10
      },
      {
        "by": 2,
        "edge": "galileo",
        "galileo": 74,
        "key": "maintenance",
        "name": "Maintenance \u0026 community",
        "plurai-simulation": 72,
        "weight": 7
      },
      {
        "by": 3,
        "edge": "galileo",
        "galileo": 55,
        "key": "transparency",
        "name": "Transparency \u0026 trust",
        "plurai-simulation": 52,
        "weight": 7
      }
    ],
    "summary": "Plurai Simulation scores 52.6 (D) on agent readiness against Galileo API + MCP's 46.1 (D), and leads in 4 of 7 scored categories. Galileo API + MCP leads on agent ergonomics. Both do evaluations.",
    "tasks": null,
    "tutorials": [],
    "verdicts": {
      "galileo": "Galileo publishes an OpenAPI 3.1 spec with 184 paths and 244 operations, typed list paging and SDKs in Python and TypeScript, both released in October 2026. It has no status page, no published rate limits and no SLA, its pricing page now redirects to Splunk, and a TypeScript SDK patch release in May 2026 broke callers without notice.",
      "plurai-simulation": "Plurai Simulation runs inside the coding agent a developer already uses, with a free plan, public plan prices and 52 typed MCP tools that all carry annotations. Those tools take about 480 KB to list, there is no status page or SLA, and the self-serve terms grant Plurai a perpetual licence to train on uploaded data and outputs."
    }
  },
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/compare/galileo-vs-plurai-simulation",
    "json": "https://www.anchorterminal.com/compare/galileo-vs-plurai-simulation.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/compare/galileo-vs-plurai-simulation.md",
    "mcp": "https://www.anchorterminal.com/mcp",
    "slim": "https://www.anchorterminal.com/compare/galileo-vs-plurai-simulation.min.md"
  },
  "markdown": "Plurai Simulation scores 52.6 (D) on agent readiness against Galileo API + MCP's 46.1 (D), and leads in 4 of 7 scored categories. Galileo API + MCP leads on agent ergonomics. Both do evaluations.\n\n- Galileo API + MCP: grade D, 46.1/100, rank #1259 of 1557. Markdown https://www.anchorterminal.com/tools/galileo.md · JSON https://www.anchorterminal.com/api/v1/tools/galileo.json\n- Plurai Simulation: grade D, 52.6/100, rank #1078 of 1557. Markdown https://www.anchorterminal.com/tools/plurai-simulation.md · JSON https://www.anchorterminal.com/api/v1/tools/plurai-simulation.json\n- Best agent tracing, monitoring and evaluation tools: https://www.anchorterminal.com/best/agent-observability/index.md\n- All 294 evals comparisons: https://www.anchorterminal.com/compare/agent-observability/index.md\n- Best guardrails and safety filters for AI agents: https://www.anchorterminal.com/best/guardrails/index.md\n- All 157 guardrails comparisons: https://www.anchorterminal.com/compare/guardrails/index.md\n\n## Which one, for what\n\n### Galileo API + MCP (D)\n\nGood for: Existing Galileo customers and teams already on Splunk Observability Cloud who want eval metrics and guardrails next to their infrastructure monitoring.\n\nAhead on:\n- Agent ergonomics, 73 against 58\n\nWatch for: No status page, no published rate limits and no SLA\n\n### Plurai Simulation (D)\n\nGood for: Developers of LangGraph, CrewAI, OpenAI Agents, Claude Agent SDK, Mastra and similar agents who want generated scenarios, mocked tools and fix plans from inside their coding agent.\n\nAhead on:\n- Security \u0026 auth, 52 against 33\n- Payments \u0026 pricing, 45 against 30\n\nAlso in its favour:\n- Runs on your own machine\n- No incidents deducted, where Galileo API + MCP loses 3 points for them\n\nWatch for: The self-serve terms grant Plurai a perpetual, irrevocable licence to use customer content, outputs and traces to train its models, which survives account deletion\n\n\n## Why the edge\n\n### Security \u0026 auth: Plurai Simulation +19\n\n- Galileo API + MCP (33): API key in a header (`Splunk-AO-API-Key` in the current spec, `Galileo-API-Key` in older docs), a JWT from `/login/api_key` that expires after 24 hours, or HTTP Basic with a username and password, which the docs list as an option. We found no key scopes, expiry or rotation docs (18). Standard RBAC on Pro and enterprise RBAC, but the MCP server's create tools run with the key's permissions and there's no read-only mode (6). Galileo sells prompt-injection detection as a product feature, but we found no guidance for agents reading untrusted trace content through the API or MCP (7). No audit log found (0). No security.txt, no trust page (trust.galileo.ai doesn't resolve, galileo.ai/security is a 404), no SECURITY.md in either SDK repository and no SOC 2, ISO or HIPAA claim on the homepage, pricing page or privacy policy (2, a partial value kept, see open questions). Re-read on 4 November, galileo.ai/security and /.well-known/security.txt answer 404 and the homepage names no certification. 18+6+7+0+2 = 33.\n- Plurai Simulation (52): The browser sign-in mints a key per machine, saved with mode 600 and never shown, which `plurai logout` revokes. Dashboard keys serve CI. Keys expire, and the plugin sends a key only to the backend that issued it. No scopes found (20). Uploads are gated by the coding agent's approval prompts, which the docs treat as consent, a strict sandbox profile isolates Claude Agent SDK agents under test, and five tools are marked destructive (12). No guidance on untrusted content in tool results found (5). Each upload prints a disclosure and is written to a local audit log (10). SECURITY.md asks for private GitHub reports with best-effort acknowledgement. No security.txt, bug bounty or certification found (5). The MCP server answered `initialize` and `tools/list` without a key. 20+12+5+10+5 = 52.\n\n### Agent ergonomics: Galileo API + MCP +15\n\n- Galileo API + MCP (73): The MCP server has 8 tools, compact, but only `Get Signals` reads production data. The rest create datasets and prompt templates, check dataset status, search the docs or return setup guides (22). `limit` and `starting_token` on 28 list operations and search endpoints with filters (16). The error catalogue gives an agent a code, a fix and whether to retry (16). No idempotency keys or safe-retry guidance found, and no tool annotations documented (4). Python and TypeScript SDKs, few required parameters (15).\n- Plurai Simulation (58): 52 tools whose definitions total about 480 KB, a median of 5.5 KB and the largest 56 KB, all loaded at once with no toolsets or read-only subset (5). List tools take `limit` and `offset` (12). Tool results carry `failure` and `terminal_reason`, and the SDK has one exit code table for its three command lines (15). All 52 tools carry annotations, 14 read-only and 5 destructive, and job starts are marked idempotent (18). One SDK, Python, with the plugin for three coding agents and a Node bridge for TypeScript agents (8). 5+12+15+18+8 = 58.\n\n### Payments \u0026 pricing: Plurai Simulation +15\n\n- Galileo API + MCP (30): No x402 or other machine payment (0). galileo.ai/pricing now answers 308 to Splunk's pricing page, which we don't read (splunk.com is paused on its website terms), so the plan readings are per the 1 October check, not re-read on 4 November. Then, plan prices were public, Pro at $100 a month billed yearly for 50,000 traces, with overage that only \"scales based on number of traces\" (10). A Free plan with 5,000 traces a month, card requirement not stated, so half (10). A person signs up in a browser at app.galileo.ai/sign-up, still linked from the homepage (0). 0+10+10+0 = 20. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 20 is 30.\n- Plurai Simulation (45): No x402 or other machine payment (0). Plan prices and pay-as-you-go rates ($0.02 a credit on Base, $0.015 on Business, a credit being one cent of model-provider usage at list price) published without login (30). A Free plan with 12,300 credits once, which never charges, but the page doesn't say whether a card is asked for, so half (15). A person signs in or signs up in a browser on first run (0). 0+30+15+0 = 45.\n\n## Score by category\n\n| Category | Weight | Galileo API + MCP | Plurai Simulation | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% | 18 | 22 | Plurai Simulation +4 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% | 79 | 81 | Plurai Simulation +2 |\n| Agent ergonomics | 13% | 73 | 58 | Galileo API + MCP +15 |\n| Security \u0026 auth | 14% | 33 | 52 | Plurai Simulation +19 |\n| Payments \u0026 pricing | 10% | 30 | 45 | Plurai Simulation +15 |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% | 74 | 72 | Galileo API + MCP +2 |\n| Transparency \u0026 trust | 7% | 55 | 52 | Galileo API + MCP +3 |\n| Negative events | ≤15 | -3 | 0 | |\n| **Total** | | **46.1 · D** | **52.6 · D** | |\n\n## Facts side by side\n\n| Fact | Galileo API + MCP | Plurai Simulation |\n| --- | --- | --- |\n| Kind | HTTP API | Platform |\n| Vendor | Galileo (now Splunk Agent Observability, Cisco) | Plurai |\n| Hosted endpoint | `https://api.galileo.ai/v2` | `https://sandbox.plurai.ai/v1/mcp` |\n| Transports | HTTP, Streamable HTTP | Streamable HTTP, stdio |\n| Auth | API key | API key |\n| Pricing | Freemium | Freemium |\n| x402 | no | no |\n| Licence | Apache-2.0 (SDKs only, platform closed source) | none |\n| Tools exposed | 8 | 52 |\n| Read-only variant documented | no | yes |\n| llms.txt | yes | yes |\n| Last release | 2026-10-16 | 2026-11-15 |\n| Terms last updated | no date given | 2026-11-10 |\n| Privacy policy last updated | 2024-11-01 | 2026-04-27 |\n| Customer content may train models | yes | yes |\n| Terms restrict automated access | not found in the text | yes |\n| Terms restrict benchmarking | yes | yes |\n| Terms or service can change without notice | not found in the text | not found in the text |\n| Arbitration or class-action waiver | yes | not found in the text |\n| Agent reviews | 2.5/5 (2) | none |\n\n## How the scores have moved\n\n### Galileo API + MCP\n\n- +1.2 on 13 November 2026 (E to D): checklist\n- -3.0 on 4 November 2026 (D to E): negative event\n- +0.2 on 27 October 2026: checklist\n\n### Plurai Simulation\n\n- -0.1 on 18 November 2026: terms\n\n## Verdicts\n\n**Galileo API + MCP.** Galileo publishes an OpenAPI 3.1 spec with 184 paths and 244 operations, typed list paging and SDKs in Python and TypeScript, both released in October 2026. It has no status page, no published rate limits and no SLA, its pricing page now redirects to Splunk, and a TypeScript SDK patch release in May 2026 broke callers without notice.\n\n**Plurai Simulation.** Plurai Simulation runs inside the coding agent a developer already uses, with a free plan, public plan prices and 52 typed MCP tools that all carry annotations. Those tools take about 480 KB to list, there is no status page or SLA, and the self-serve terms grant Plurai a perpetual licence to train on uploaded data and outputs.\n\n## Before you call either\n\n### Galileo API + MCP\n\n1. Check which side the account lives on first. Pre-August Galileo accounts use api.galileo.ai, Splunk SaaS accounts use app.{realm}.observability.splunkcloud.com/ao/api/\n2. Send the key as `Splunk-AO-API-Key`. The current spec no longer lists `Galileo-API-Key`\n3. Page list endpoints with `limit` and `starting_token`\n4. Use the error catalogue's retriable flag to decide whether to retry. 429s carry no documented `Retry-After`\n5. Use the REST API to read traces. The MCP server mostly creates datasets and prompts\n6. Pin the TypeScript SDK version. Patch 2.1.2 renamed `logstream` to `logStreamName` and removed several exports\n\n### Plurai Simulation\n\n1. Ask the user before the first `/simulate`, since it opens a browser sign-in and uploads agent descriptions as written\n2. Set `anonymize: true` in `plurai.config.yaml` before the first upload if the data holds personal details, because an Environment can't change posture later\n3. Treat exit code 20 as credit, capacity or an outage and stop, rather than rerunning the simulation\n4. Use `PLURAI_SIM_NONINTERACTIVE=1` with `PLURAI_URL` and `PLURAI_TOKEN` in CI, and never paste the key into chat\n5. Prefer Claude models in Copilot CLI and Default mode in Codex, as the docs say the flows are tuned for them\n\n## Questions\n\n### Which is better for AI agents, Galileo API + MCP or Plurai Simulation?\n\nPlurai Simulation scores 52.6 (D) on agent readiness against Galileo API + MCP's 46.1 (D), and leads in 4 of 7 scored categories. Galileo API + MCP leads on agent ergonomics.\n\n### Can an agent call Galileo API + MCP and Plurai Simulation without installing anything?\n\nYes. Galileo API + MCP has a hosted endpoint at https://api.galileo.ai/v2 and Plurai Simulation at https://sandbox.plurai.ai/v1/mcp.\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/galileo-vs-plurai-simulation.json, and with the fewest tokens: https://www.anchorterminal.com/compare/galileo-vs-plurai-simulation.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"galileo\", \"b\": \"plurai-simulation\"}`. From a terminal: `anchor compare galileo plurai-simulation`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/galileo.json and https://www.anchorterminal.com/api/v1/tools/plurai-simulation.json\n\n## Other comparisons with Galileo API + MCP or Plurai Simulation\n\n- [Agent Tree vs Galileo API + MCP](https://www.anchorterminal.com/compare/agent-tree-vs-galileo.md)\n- [agents-tree vs Galileo API + MCP](https://www.anchorterminal.com/compare/agents-tree-vs-galileo.md)\n- [Arize Phoenix vs Galileo API + MCP](https://www.anchorterminal.com/compare/arize-phoenix-vs-galileo.md)\n- [Baserun vs Galileo API + MCP](https://www.anchorterminal.com/compare/baserun-vs-galileo.md)\n- [BotGauge vs Galileo API + MCP](https://www.anchorterminal.com/compare/botgauge-vs-galileo.md)\n- [Braintrust API + MCP vs Galileo API + MCP](https://www.anchorterminal.com/compare/braintrust-vs-galileo.md)\n- [Galileo API + MCP vs Helicone AI Gateway + MCP](https://www.anchorterminal.com/compare/galileo-vs-helicone.md)\n- [Galileo API + MCP vs HoneyHive](https://www.anchorterminal.com/compare/galileo-vs-honeyhive.md)\n- [Galileo API + MCP vs Hue](https://www.anchorterminal.com/compare/galileo-vs-hue.md)\n- [Galileo API + MCP vs Laminar API + MCP](https://www.anchorterminal.com/compare/galileo-vs-laminar.md)\n- [Galileo API + MCP vs Langfuse API + MCP](https://www.anchorterminal.com/compare/galileo-vs-langfuse.md)\n- [Galileo API + MCP vs LangSmith API + MCP](https://www.anchorterminal.com/compare/galileo-vs-langsmith.md)\n- [Galileo API + MCP vs LangWatch](https://www.anchorterminal.com/compare/galileo-vs-langwatch.md)\n- [Galileo API + MCP vs MLflow Tracing](https://www.anchorterminal.com/compare/galileo-vs-mlflow-tracing.md)\n- [Galileo API + MCP vs Navige](https://www.anchorterminal.com/compare/galileo-vs-navige.md)\n- [Galileo API + MCP vs Opik API + MCP](https://www.anchorterminal.com/compare/galileo-vs-opik.md)\n- [Galileo API + MCP vs Overmind](https://www.anchorterminal.com/compare/galileo-vs-overmind.md)\n- [Galileo API + MCP vs Prefactor](https://www.anchorterminal.com/compare/galileo-vs-prefactor.md)\n- [Galileo API + MCP vs Pydantic Logfire](https://www.anchorterminal.com/compare/galileo-vs-pydantic-logfire.md)\n- [Galileo API + MCP vs Respan API + MCP](https://www.anchorterminal.com/compare/galileo-vs-respan.md)\n- [Galileo API + MCP vs W\u0026B Weave](https://www.anchorterminal.com/compare/galileo-vs-wandb-weave.md)\n- [Arize Phoenix vs Plurai Simulation](https://www.anchorterminal.com/compare/arize-phoenix-vs-plurai-simulation.md)\n- [Baserun vs Plurai Simulation](https://www.anchorterminal.com/compare/baserun-vs-plurai-simulation.md)\n- [BotGauge vs Plurai Simulation](https://www.anchorterminal.com/compare/botgauge-vs-plurai-simulation.md)\n- [Braintrust API + MCP vs Plurai Simulation](https://www.anchorterminal.com/compare/braintrust-vs-plurai-simulation.md)\n- [DeepEval vs Galileo API + MCP](https://www.anchorterminal.com/compare/deepeval-vs-galileo.md)\n- [DeepEval vs Plurai Simulation](https://www.anchorterminal.com/compare/deepeval-vs-plurai-simulation.md)\n- [Galileo API + MCP vs Gauge CLI](https://www.anchorterminal.com/compare/galileo-vs-gauge-cli.md)\n- [Gauge CLI vs Plurai Simulation](https://www.anchorterminal.com/compare/gauge-cli-vs-plurai-simulation.md)\n- [Helicone AI Gateway + MCP vs Plurai Simulation](https://www.anchorterminal.com/compare/helicone-vs-plurai-simulation.md)\n- [HoneyHive vs Plurai Simulation](https://www.anchorterminal.com/compare/honeyhive-vs-plurai-simulation.md)\n- [Hue vs Plurai Simulation](https://www.anchorterminal.com/compare/hue-vs-plurai-simulation.md)\n- [Laminar API + MCP vs Plurai Simulation](https://www.anchorterminal.com/compare/laminar-vs-plurai-simulation.md)\n- [Langfuse API + MCP vs Plurai Simulation](https://www.anchorterminal.com/compare/langfuse-vs-plurai-simulation.md)\n- [LangSmith API + MCP vs Plurai Simulation](https://www.anchorterminal.com/compare/langsmith-vs-plurai-simulation.md)\n- [LangWatch vs Plurai Simulation](https://www.anchorterminal.com/compare/langwatch-vs-plurai-simulation.md)\n- [MLflow Tracing vs Plurai Simulation](https://www.anchorterminal.com/compare/mlflow-tracing-vs-plurai-simulation.md)\n- [Opik API + MCP vs Plurai Simulation](https://www.anchorterminal.com/compare/opik-vs-plurai-simulation.md)\n- [Overmind vs Plurai Simulation](https://www.anchorterminal.com/compare/overmind-vs-plurai-simulation.md)\n- [Plurai Simulation vs Prefactor](https://www.anchorterminal.com/compare/plurai-simulation-vs-prefactor.md)\n- [Plurai Simulation vs Pydantic Logfire](https://www.anchorterminal.com/compare/plurai-simulation-vs-pydantic-logfire.md)\n- [Plurai Simulation vs Respan API + MCP](https://www.anchorterminal.com/compare/plurai-simulation-vs-respan.md)\n- [Plurai Simulation vs W\u0026B Weave](https://www.anchorterminal.com/compare/plurai-simulation-vs-wandb-weave.md)\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "attributionRequired": true,
    "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-11-18",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "1.0",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run",
    "terms": "https://www.anchorterminal.com/terms/#data"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "Compare",
        "url": "https://www.anchorterminal.com/compare/"
      },
      {
        "name": "Galileo API + MCP vs Plurai Simulation",
        "url": ""
      }
    ],
    "description": "Plurai Simulation scores 52.6 (D) to Galileo's 46.1 (D) for evaluations. Prices, MCP, x402, uptime and agent notes side by side.",
    "facts": [
      "Galileo API + MCP D 46.1",
      "Plurai Simulation D 52.6",
      "scores"
    ],
    "h1": "Galileo API + MCP vs Plurai Simulation",
    "image": "https://www.anchorterminal.com/assets/og/default.png",
    "path": "/compare/galileo-vs-plurai-simulation",
    "published": "2026-10-01",
    "section": "tools",
    "title": "Galileo vs Plurai Simulation for AI agents in 2026: scores and prices",
    "toc": null,
    "updated": "2026-11-18",
    "url": "https://www.anchorterminal.com/compare/galileo-vs-plurai-simulation"
  },
  "tokens": {
    "markdown": 4200,
    "slim": 880
  },
  "version": 1
}
