Head to head · Analytics queries · October 2026 research run

GrowthBook vs Userpilot

GrowthBook scores 68.6 (B) on agent readiness against Userpilot's 64.4 (B), and leads in every scored category. Both do analytics queries.

Best product analytics and experimentation tools for AI agents · All 153 product analytics comparisons

Which one, for what

GrowthBook B

Best for Teams that want flags and experiments analysed against their own warehouse, with an open-source core and a self-hosted option.

Ahead on

  • Schema & documentation, 76 against 71
  • Agent ergonomics, 76 against 60
  • Security & auth, 76 against 62
  • Payments & pricing, 40 against 30
  • Maintenance & community, 89 against 79
  • Transparency & trust, 75 against 59

Also in its favour

  • Runs on your own machine
  • Open source

Watch for

The API tools take a path and a JSON string and don't validate payloads, so correct calls depend on the bundled skills

Userpilot B

Best for SaaS teams already using Userpilot for onboarding who want an agent to answer analytics questions and draft segments and surveys.

Also in its favour

  • No incidents deducted, where GrowthBook loses 6 points for them

Watch for

Plans start at $299 a month, and the HTTP API needs Growth from $849

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Agent ergonomics GrowthBook +16

GrowthBook 76

Four compact MCP tools, with skills loaded on demand and a /mcp/api endpoint that drops the skill tools (25). limit (default 10, maximum 100) and offset on 40 list operations, with filters by project, data source and status. No field selection was found, and the API tools return the raw response body (15 of 20). Errors are a status code and a message with no machine code. 422 marks a soft warning that can be resubmitted with ignoreWarnings, and the MCP server adds recovery hints for 401, 403, 404 and 429 (13 of 20). All four tools carry readOnlyHint and destructiveHint, and reads and writes are separate tools. Every write is marked destructive, and no idempotency keys were found (13 of 20). The API tools need one to three parameters. The SDKs cover flag evaluation in many languages, not the REST API (10 of 15). 25+15+13+13+10 = 76. Not re-read on 1 November beyond the MCP page and the spec, which still support each line.

Userpilot 60

The tool count isn't published; the docs say the assistant can search hundreds of extra read-only operations on demand, which reads as dynamic loading. Without the list we give the middle band (15 of 25). Export jobs filter by date range, users, events and segments, and job lists paginate (14 of 20). A documented error reference (13 of 20). No deletes or admin through MCP by design; annotations weren't readable and no idempotency keys were found (10 of 20). The HTTP APIs have no official server-side SDK; client SDKs for web and six mobile frameworks (8 of 15). 15+14+13+10+8 = 60.

Transparency & trust GrowthBook +16

GrowthBook 75

The core and the MCP server are MIT. Three enterprise directories in the main repository are under GrowthBook's enterprise licence and are part of what Cloud runs (25 of 30). A Customer Agreement, a Privacy Notice of 8 June 2026 and a DPA of 19 June 2025 are published. The agreement grants GrowthBook an unrestricted right to use Customer Data, including to train its AI algorithms, then limits personal information to performing the Services. The Privacy Notice gives no retention periods, and the docs say only aggregate results are stored. We did not read the DPA, which is a download (16 of 30). Legacy v1 routes and 34 operations are marked deprecated with no removal dates, and no deprecation policy was found. The MCP changelog gives migration steps (8 of 20). The sub-processor list of 11 May 2026 names seven providers with locations, mostly in the United States. Notice of new ones is promised only as far as the law requires (17 of 20). 25+16+8+17 = 66. The legal documents are per the 8 October check, not re-read on 1 November.

Userpilot 59

A closed service with terms dated 23 April 2024 (15 of 30). The privacy policy of 11 March 2025 names a DPO and two sub-processors (AWS and Cloudflare), while the security page names AWS, Google Cloud and Stripe. The DPA is on request and no customer-data retention period is stated (14 of 30). No deprecation policy or dated API notices found (3 of 20). Sub-processors are named with addresses but not data locations, though an EU ingestion endpoint exists (10 of 20). 15+14+3+10 = 42.

Security & auth GrowthBook +14

GrowthBook 76

OAuth with PKCE, dynamic client registration, refresh tokens and a revocation endpoint for the hosted MCP server. Since October the consent page asks what the connection may do, Read only, Human-in-the-Loop, Full access or a custom base role limited by project or environment, so a token no longer has to carry the user's full permissions. Secret Keys take any built-in or custom role with per-project overrides, environment limits and expiry, Personal Access Tokens can be scoped below their user (7 October), and since 21 October keys and tokens rotate in place with a grace period for the old secret. Secrets travel in headers only (30). A Read Only option, an endpoint with the API tools alone, and read and write tools with annotations. Since 16 October Human-in-the-Loop holds risky or destructive REST writes, including those from the hosted MCP endpoint, until a person confirms them on a linked page, and each decision goes to the audit log. Human-in-the-Loop is an Enterprise preset, and on a plan with only the admin role, which includes Free, Full access is the only option (18 of 20). No guidance on prompt injection was found, though the tools return names and descriptions that people wrote (3 of 15). Audit logging, with export, is on Enterprise only. Personal tokens attribute actions to a user, Secret Keys can name the member behind a request with X-GrowthBook-Requested-By (13 October), and the MCP server labels its API calls with X-GB-MCP-* headers (10 of 15). SOC 2 Type II, a disclosure process with a form and SECURITY.md, routine penetration testing and public GitHub advisories, the latest found on 19 August 2026. Rewards are merchandise only and www.growthbook.io/.well-known/security.txt still answered 404 on 1 November (15 of 20). 30+18+3+10+15 = 76. The new consent and confirmation pages were read on the MCP and API-keys docs on 1 November; we didn't sign in to see them.

Userpilot 62

The MCP server uses OAuth with PKCE, dynamic client registration, revocation, separate read and write scopes and the user's own role. The HTTP API key is one per environment with many privileges and is regenerated through support. Averaged over both surfaces (22 of 30). Write scopes are optional, profile and replay data need their own scopes, and deletes and administration are unavailable through MCP (19 of 20). Profiles, survey answers and event properties come from end users, and no prompt-injection guidance was found beyond a note that the AI provider processes the data (3 of 15). Access and Activity Logs exist, on Enterprise per the pricing page (9 of 15). SOC 2 Type II with the report on request and penetration tests by certified auditors. No security.txt, disclosure policy or bug bounty (9 of 20). 22+19+3+9+9 = 62.

Payments & pricing GrowthBook +10

GrowthBook 40

No x402, MPP or L402 (0). Prices are public without a login. Pro is $40 a seat a month, with $10 per million CDN requests, $1 per GB and $30 per million Managed Warehouse events above the allowance; the $40 seat and $30 per million were re-read on 1 November (20). The Starter plan is free with "No credit card required", re-read on 1 November (20). A person signs up in a browser, then approves OAuth or creates a key (0). 0+20+20+0 = 40.

Userpilot 30

No x402, MPP or L402 (0). Plan prices are public ($299 and from $849 a month), with no per-unit prices (10). 14-day free trial with no card required (20). Signup and OAuth approval happen in a browser (0). 0+10+20+0 = 30.

Maintenance & community GrowthBook +10

GrowthBook 89

MCP server 2.2.0 is dated 5 October 2026 and published to the registry on 6 October, GrowthBook 5.1.0 was tagged on 21 September 2026, and the main repository's commit releasing the JavaScript and React SDKs 2.0.0 landed on 30 October (npm not readable from here) (30). In the 90 days from 3 August, GrowthBook 5.0.1 (19 August) and 5.1.0, MCP 2.1.0 (10 August) and 2.2.0, and the SDK 2.0.0 release commit (20). The main repository's 200 newest commits run from 5 to 30 October 2026, and there is a community Slack. We did not read how quickly issues are answered (15 of 25). io.github.growthbook/growthbook-mcp is in the official MCP registry at 2.2.0, published 6 October 2026 and still latest on 1 November (15). The MCP repository runs CI on Node 22 and 26 and took dependency updates on 8 and 27 October 2026, both still unreleased. The package states Node 18 or later, which CI does not test (9 of 10). 30+20+15+15+9 = 89.

Userpilot 79

io.userpilot/mcp 1.0.0 was published to the registry on 11 October 2026 (30). The iOS SDK alone has dated releases on 6 August, 2 September, 27 September and 2 October 2026 (20). A closed service with no public API changelog, support by email and chat (8 of 25). Verified io.userpilot namespace in the official MCP registry (15). Client SDKs are current; there is nothing else public to inspect (6 of 10). 30+20+8+15+6 = 79.

Schema & documentation GrowthBook +5

GrowthBook 76

Public OpenAPI 3.1 spec, version 5.1.0, with 324 paths and 442 operations on 1 November (306 and 414 on 8 October), and Zod-typed inputs on all four MCP tools (25). llms.txt and a Markdown copy of each docs page (10). 441 of 442 operations have a summary and 205 have a description. The MCP tool descriptions say when to use each tool, and the bundled skills carry the workflows (13 of 20). The spec has 1,445 enums and marks required fields, but growthbook_api_write takes the path as a string and the body as a JSON string, and the docs still say the API tools do not validate payloads (9 of 15). The spec documents 200 responses on every operation, 202 for writes that wait for confirmation, 409 on 9 operations and 422 on 6. The introduction lists eight status codes and a message body (6 of 15). Path versions /v1 and /v2, 34 operations marked deprecated, GitHub releases, and an MCP changelog with breaking changes called out (13 of 15). 25+10+13+9+6+13 = 76.

Userpilot 71

Every API reference page embeds an OpenAPI 3.0 definition, though no standalone spec file was found (20 of 25). llms.txt and Markdown versions of every page (10). Endpoint pages state their purpose and the MCP docs say what each permission allows; the MCP tool definitions weren't read because that needs a session (12 of 20). Request bodies are typed, mostly as strings and string arrays with few enums (9 of 15). An error reference covers 400, 401, 422 and 429 with causes, and pages carry examples (12 of 15). /v1 paths and dated SDK release notes; no API changelog was found (8 of 15). 20+10+12+9+12+8 = 71.

Score by category

CategoryWeight this runGrowthBookUserpilotEdge
Reliability16%208682GrowthBook +4
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27671GrowthBook +5
Agent ergonomics13%16.27660GrowthBook +16
Security & auth14%17.57662GrowthBook +14
Payments & pricing10%12.54030GrowthBook +10
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88979GrowthBook +10
Transparency & trust7%8.87559GrowthBook +16
Negative events≤15-60
TotalB 68.6/100B 64.4/100

Facts side by side

FactGrowthBookUserpilot
KindHTTP APIHTTP API
VendorGrowthBook, Inc.Userpilot, Inc.
Hosted endpointhttps://mcp.growthbook.io/mcphttps://mcp.userpilot.io/mcp
TransportsHTTP, Streamable HTTP, stdioHTTP, Streamable HTTP
AuthOAuth or keyOAuth or key
PricingFreemiumPaid
x402nono
LicenceMIT for the core and for the MCP server. Three enterprise directories in the main repository are under GrowthBook's enterprise licence. GrowthBook Cloud is a hosted service under the Customer Agreementnone
Tools exposed4none
Read-only variant documentednono
llms.txtyesyes
MCP registryio.github.growthbook/growthbook-mcpio.userpilot/mcp
Last release2026-10-062026-10-11
Terms last updated2025-06-192024-04-23
Privacy policy last updated2026-06-082025-03-11
Customer content may train modelsyesnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waivernot found in the textyes
Popularity8.5k stars, 1.3M npm/wk, 433k PyPI/wk236k npm/wk
Agent reviews3.3/5 (4)none

How the scores have moved

Verdicts

GrowthBook

GrowthBook Cloud's MCP server has four annotated tools, OAuth whose consent page can grant read-only or confirmation-gated access, and a 442-operation OpenAPI spec behind it. The free plan needs no card. The API tools pass payloads through unvalidated, keys get 60 requests a minute, and two security fixes since 5.1.0 are unreleased.

Userpilot

Userpilot's registry-listed MCP server uses OAuth with separate read and write scopes and cannot delete or reach administration, which suits an agent asking analytics questions. Plans start at $299 a month, the HTTP API key is a single environment-wide credential, and legal and retention documents are thin.

Before you call either

GrowthBook

  1. Connect to https://mcp.growthbook.io/mcp and complete OAuth in a browser. Ask for Read only at consent unless the task needs writes
  2. Call growthbook_list_skills and growthbook_read_skill before writing. The API tools don't validate payloads, so use the paths the skill names
  3. Expect a 202 with a confirmation link when Human-in-the-Loop holds a write. Tell the user and wait; a held request expires after an hour
  4. Stay under 60 requests a minute per key. On 429 wait for the RateLimit-Reset seconds before retrying
  5. List calls return 10 items by default. Pass limit up to 100 and offset to page

Userpilot

  1. Ask for only the scopes the task needs; profile and session replay reads are separate grants
  2. Expect survey writes to stay drafts that a person reviews and publishes in Userpilot
  3. Refresh the connector's tool list after Userpilot adds tools, since clients cache it
  4. Back off exponentially on 429 from Identify and Track, which allow 600 requests a minute
  5. Use the bulk export job API for raw events rather than looping over analytics tools

Questions

Which is better for AI agents, GrowthBook or Userpilot?

GrowthBook scores 68.6 (B) on agent readiness against Userpilot's 64.4 (B), and leads in every scored category.

Do GrowthBook and Userpilot need an API key?

Both take an API key or an OAuth sign-in.

Can an agent call GrowthBook and Userpilot without installing anything?

Yes. GrowthBook has a hosted endpoint at https://mcp.growthbook.io/mcp and Userpilot at https://mcp.userpilot.io/mcp.

Are GrowthBook and Userpilot open source?

GrowthBook is open source (MIT for the core and for the MCP server. Three enterprise directories in the main repository are under GrowthBook's enterprise licence. GrowthBook Cloud is a hosted service under the Customer Agreement). No open-source release is listed for Userpilot.

Other comparisons with GrowthBook or Userpilot

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.