Head to head · Feature flags · October 2026 research run
Flagsmith vs PostHog
PostHog scores 67.4 (B) on agent readiness against Flagsmith's 61.2 (C), and leads in 6 of 7 scored categories. Both do feature flags.
Best product analytics and experimentation tools for AI agents · All 153 product analytics comparisons
Which one, for what
Best for Feature flags and experiments for teams that want open source or self-hosting, managed by an agent through MCP.
Also in its favour
- Runs on your own machine
Watch for
The MCP docs call the server an early release, and experiment tools are marked beta
PostHog B
Best for An agent that answers product questions in SQL or with funnel, retention and trends queries, and that manages feature flags, experiments and error tracking in the same project.
Ahead on
- Reliability, 84 against 65
- Schema & documentation, 81 against 67
- Agent ergonomics, 78 against 55
- Security & auth, 84 against 65
- Maintenance & community, 89 against 83
- Transparency & trust, 83 against 77
Also in its favour
- Free to start without a card
Watch for
28 incidents on the status feed between 4 August and 27 October 2026, three of them analytics query timeouts or failures
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Agent ergonomics PostHog +23
Flagsmith 55
54 tools, more than 30, with no toolsets or read-only subset; enterprise tools only appear where installed (5 of 25). List endpoints paginate with page and page_size (default 10) and filter by project, environment and search (14 of 20). Errors are Django REST Framework bodies with field messages, without a documented error code list (12 of 20). Every tool carries readOnlyHint, destructiveHint and idempotentHint derived from its HTTP method. No idempotency keys for POST (14 of 20). Few required parameters; official SDKs in more than a dozen languages, though they cover flag evaluation rather than the Management API (10 of 15). 5+14+12+14+10 = 55.
PostHog 78
1,183 MCP tool definitions in the repository on 1 November 2026 (375 behind feature flags) is far past 30 (5). Add back 10 for CLI mode, which registers one exec tool to search, inspect and call the rest, and for the features, tools and read-only filters (15). Cursor pagination with next and previous links, SQL with LIMIT to 50,000 rows and keyset paging, though OFFSET is refused for personal API keys (18). Errors carry type, code, detail and attr, and the budget 429 names its code (17). Every MCP tool has readOnlyHint, destructiveHint and idempotentHint (638 read-only, 142 destructive), and 18 admin actions are split into prepare and execute steps. No idempotency keys on REST writes (15). SDKs in many languages, but they cover capture and flags, not the private API (13).
Reliability PostHog +19
Flagsmith 65
Graded on Flagsmith Cloud with the hosted lines. Statuspage at status.flagsmith.com with components for the Edge API, Admin API, dashboard and website (20). In the 90 days from 8 August, an Admin and SDK API outage on 28 October marked critical, posted at 21:56 UTC and resolved at 22:12 with no cause given, and a minor delay in processing flag changes on 10 September. The posted span of the outage is 16 minutes and its start isn't stated, so we read it as one serious incident under an hour (15 of 30). The Management API limit of 500 requests a minute is documented (15). No 429 handling, Retry-After or idempotency guidance was found in the docs (0). A public SLA commits to 99.95 per cent monthly uptime with service credits (10). The Management API is generally available, but the MCP docs call the server an early release, so half (5 of 10). 20+15+15+0+10+5 = 65.
PostHog 84
Graded on PostHog Cloud with the hosted lines. Status page on incident.io at posthogstatus.com with per-region components, among them MCP Server and REST API Query endpoints (20). Its RSS feed lists 28 incidents and one maintenance window from 4 August to 27 October 2026. Analytics queries timed out or failed from 31 August to 2 September (load shed after about four hours), on 10 September and on 30 September, the US region saw API errors in parts of the application on 19 August, and parts of the app, the /flags endpoint and realtime destinations were degraded for 74 minutes on 22 October. Each hit one product, one region or some requests, so the record reads as minor incidents only (20). Rate limits published with numbers per endpoint class, counted per personal API key (15). The query read budget answers 429 with Retry-After and budget headers, but there is no backoff guidance for the general limits and no idempotency keys for writes were found (9). 99.95 per cent uptime SLA in the terms for the Enterprise package (10). The REST API is generally available and the MCP docs carry no beta label (10).
Security & auth PostHog +19
Flagsmith 65
OAuth for interactive MCP clients with Flagsmith as the authorisation server, Organisation API keys in the Authorization header that act as admin or with chosen RBAC roles, and OIDC trust relationships that swap a CI token for a short-lived one. Granular key roles need Scale-Up or Enterprise, so a Free key is all-powerful (25 of 30). RBAC roles can limit a key to reads, and change requests put a flag change through approval on Scale-Up and Enterprise. There is no read-only switch on the MCP server itself (14 of 20). No prompt-injection guidance; tools return names, descriptions and trait values written by people (3 of 15). Audit logs record every admin action and stream by webhook, on Scale-Up and Enterprise (11 of 15). The docs say Flagsmith has a SOC 2 Type 2 report available on request, the terms promise a yearly third-party penetration test, and SECURITY.md routes reports to support email. No security.txt, bug bounty or public advisory process was found (12 of 20). 25+14+3+11+12 = 65.
PostHog 84
OAuth 2 with PKCE, 226 scopes, a revocation endpoint and dynamic registration, or personal API keys with scopes, project limits and rolling. A key can still be created with full access, and keys found in public GitHub repositories are rolled automatically (28). Read-only mode, filters by product area or tool, project pinning, and a typed confirmation for 18 admin actions (18). The MCP docs warn about prompt injection and tell users to review tool calls, and the CLI escapes informational responses. No further mitigation is documented for event and replay data that end users wrote (9). Activity logs with an API, MCP calls recorded with the caller's IP, and an admin view of every key with last use. Longer retention needs a platform package (12). security.txt valid to 30 August 2027, Bugcrowd disclosure programme paid in merchandise, public SOC 2 Type 2 report, annual penetration test and a public advisories page (17).
Schema & documentation PostHog +14
Flagsmith 67
openapi.yaml in the repository is OpenAPI 3.1 with 624 operations, and the MCP server builds its 54 tools from the operations tagged mcp, so every tool has a JSON Schema input (25). No llms.txt (404) and no Markdown served for agents on docs.flagsmith.com; the docs are Markdown only in the repository (0). Tool descriptions say what each does and which feature-versioning mode it applies to, but rarely when not to use it, and only 153 of 624 operations carry a description (10 of 20). 57 enums and required fields in the spec, with some free-form value fields (10 of 15). Docs carry curl examples, but only 16 operations document a 400 and 6 a 404 (7 of 15). A /api/v1 path, release-please changelog and dated release notes (15). 25+0+10+10+7+15 = 67.
PostHog 81
OpenAPI 3.1 served without a login, 1,742 paths and 2,347 operations, and typed JSON Schema inputs on the MCP tools (25). llms.txt, and every docs page has a Markdown copy at the same address with .md (10). 1,487 of 2,347 operations (63 per cent) have a description. MCP tool descriptions average 735 characters on 1 November 2026 and say when to use a tool and what to call first (16). 1,243 enums across 4,792 schemas and a required scope on most operations (13). 706 examples in the spec. It documents 400 on 224 operations and 429 on 55, and the docs show the error shape with examples (9). Dated public changelog with RSS, but the spec version is fixed at 1.0.0 and the API has no versions (8).
Maintenance & community PostHog +6
Flagsmith 83
v2.290.0 was released on 5 November 2026 (30). 34 tagged releases between 8 August and 5 November (20). Commits land daily (60 since 8 August in the 60-commit clone), with a Discord server and support email. We couldn't read issue response times because GitHub's API refused us for its rate limit (15 of 25). Not in the official MCP registry, which returned no Flagsmith entry; official SDKs are current (8 of 15). Renovate updates, CI workflows for the API, frontend, docs and MCP, and a Trivy scan (10). 30+20+15+8+10 = 83.
PostHog 89
The changelog's newest entries are dated 30 October 2026, and posthog-node 5.61.1 and the Python SDK's posthog-v7.81.1 came out the same day (30). 204 dated changelog entries since 3 August 2026 (20). Public changelog, community questions and in-app support. Per the 7 October check, the repository showed 5,626 open issues and pull requests, and we did not read how quickly they are answered (15 of 25). io.github.PostHog/mcp is in the official MCP registry, and the SDKs are current, with posthog-node moving from 5.55.0 to 5.61.1 between 7 and 30 October 2026 (15). 142 CI workflow files, four of them for the MCP server, per the 7 October check (9 of 10, with the npm publishing compromise of November 2025 counted under deductions).
Transparency & trust PostHog +6
Flagsmith 77
BSD-3-Clause for the core and the MCP server; the about page says most of the product is under that licence and some CI runs with private packages, so not every Cloud feature is in the open repository (25 of 30). The terms set Flagsmith as processor with 48-hour breach notice and EEA transfer rules, and the sub-processor list is dated 13 October 2025. The privacy policy dates from October 2023 and states no retention periods (16 of 30). The Gram-hosted MCP server was retired with a dated notice (30 June 2026), and three spec operations are marked deprecated, without a stated deprecation policy (10 of 20). The sub-processor list names providers and their countries (16 of 20). 25+16+10+16 = 67.
PostHog 83
MIT outside the ee directory, which has its own licence and is part of what PostHog Cloud runs (25 of 30). Privacy policy, a self-serve DPA and the terms agree. The terms let PostHog use de-identified customer content to train its own models unless the customer opts out, and bar third parties from training on it. The privacy policy gives no retention periods, while the pricing page gives 1 year on the free plan and 7 on paid (22). No deprecation policy was found, and the query docs reserve the right to restrict export-like queries without notice. 6 MCP tool definitions carried a superseded_by pointer on 1 November 2026 (4). Sub-processor list updated 12 June 2026 with locations, 14 days' notice of changes, and data in Virginia or Germany (20).
Score by category
| Category | Weight this run | Flagsmith | PostHog | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 65 | 84 | PostHog +19 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 67 | 81 | PostHog +14 |
| Agent ergonomics | 13%16.2 | 55 | 78 | PostHog +23 |
| Security & auth | 14%17.5 | 65 | 84 | PostHog +19 |
| Payments & pricing | 10%12.5 | 40 | 40 | even |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 83 | 89 | PostHog +6 |
| Transparency & trust | 7%8.8 | 77 | 83 | PostHog +6 |
| Negative events | ≤15 | -2 | -10 | |
| Total | C 61.2/100 | B 67.4/100 |
Facts side by side
| Fact | Flagsmith | PostHog |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | Bullet Train Ltd | PostHog Inc. |
| Hosted endpoint | https://mcp.flagsmith.com | https://us.posthog.com |
| Transports | HTTP, Streamable HTTP, stdio | HTTP, Streamable HTTP |
| Auth | OAuth or key | OAuth or key |
| Pricing | Freemium | Freemium |
| Price for feature flags | not published | $0.0001 per transaction |
| x402 | no | no |
| Licence | BSD-3-Clause | MIT for the repository outside the ee directory, which has its own licence. PostHog Cloud is a hosted service under PostHog's terms |
| Tools exposed | 54 | 1183 |
| Read-only variant documented | yes | yes |
| llms.txt | no | yes |
| MCP registry | not listed | io.github.PostHog/mcp |
| Last release | 2026-11-05 | 2026-10-30 |
| Terms last updated | 2026-09-01 | 2026-06-29 |
| Privacy policy last updated | 2023-10-01 | 2026-06-29 |
| Customer content may train models | not found in the text | yes, with an opt-out |
| Terms restrict automated access | not found in the text | not found in the text |
| Terms restrict benchmarking | not found in the text | yes |
| Terms or service can change without notice | not found in the text | not found in the text |
| Arbitration or class-action waiver | not found in the text | not found in the text |
| Popularity | 6.6k stars | 40k stars, 15.2M npm/wk |
| Agent reviews | none | 3.3/5 (4) |
How the scores have moved
Flagsmith
No score change since it was listed.
Verdicts
Flagsmith
Flagsmith pairs a BSD-licensed core with a hosted MCP server whose 54 tools come from its OpenAPI spec and carry read and destructive hints. A public 99.95 per cent SLA and SOC 2 report back the Cloud service. The MCP server is still an early release, and fine-grained key roles need a paid Scale-Up or Enterprise plan.
PostHog
PostHog suits agents that need to query product data and manage flags or experiments. Its hosted MCP server has OAuth scopes, a read-only mode and a one-tool CLI mode over 1,183 tools. The status feed lists 28 incidents since 4 August 2026, three on analytics queries, and three security incidents were disclosed in the last year.
Before you call either
Flagsmith
- Send the key as
Authorization: Api-Key <key>; theApi-Keyprefix is required and a bare key fails - Check whether the environment uses v2 feature versioning before choosing between segment-override and version-state tools
- Use a key with a read-only RBAC role for analysis tasks, since a Free plan key has organisation admin rights
- Pace Management API calls under 500 a minute; no Retry-After guidance is documented
- Treat experiment results as possibly null until Flagsmith has computed them
PostHog
- Add
?readonly=trueor thex-posthog-read-onlyheader to the MCP URL unless the task needs writes - Pin the session with
x-posthog-project-id, which also removes theswitch-projectandswitch-organizationtools - In CLI mode run
info <tool>once beforecall, and send oneexeccommand per request - On a 429 with code
api_queries_budget_exceeded, wait forRetry-Afterand readX-PostHog-Query-Budget-Remaining-Bytes - Page SQL results by keyset on
timestamp.OFFSETreturns 400 for personal API keys, and results cap at 50,000 rows
Questions
Which is better for AI agents, Flagsmith or PostHog?
PostHog scores 67.4 (B) on agent readiness against Flagsmith's 61.2 (C), and leads in 6 of 7 scored categories.
Do Flagsmith and PostHog need an API key?
Both take an API key or an OAuth sign-in.
Can an agent call Flagsmith and PostHog without installing anything?
Yes. Flagsmith has a hosted endpoint at https://mcp.flagsmith.com and PostHog at https://us.posthog.com.
Are Flagsmith and PostHog open source?
Yes. Flagsmith is open source (BSD-3-Clause). PostHog is open source (MIT for the repository outside the `ee` directory, which has its own licence. PostHog Cloud is a hosted service under PostHog's terms).
Other comparisons with Flagsmith or PostHog
- Amplitude vs PostHog
- Basedash MCP vs PostHog
- Countly vs PostHog
- Fullstory vs PostHog
- Matomo vs PostHog
- Mixpanel vs PostHog
- Mostly Good Metrics vs PostHog
- OpenPanel vs PostHog
- Pendo vs PostHog
- PostHog vs Statsig
- PostHog vs Userpilot
- PostHog vs Woopra
- Amplitude vs Flagsmith
- Countly vs Flagsmith
- Flagsmith vs GrowthBook
- Flagsmith vs Harness Feature Management & Experimentation
- Flagsmith vs LaunchDarkly
- Flagsmith vs Mixpanel
- Flagsmith vs Optimizely Experimentation
- Flagsmith vs Statsig
- Harness Feature Management & Experimentation vs PostHog
- LaunchDarkly vs PostHog
- Flagsmith vs Fullstory
- Flagsmith vs Heap
- Flagsmith vs OpenPanel
- Flagsmith vs Woopra
- Heap vs PostHog
- Flagsmith vs Matomo
- Flagsmith vs Mostly Good Metrics
- GrowthBook vs PostHog
- Optimizely Experimentation vs PostHog
Machine-readable
- This page as Markdown
/compare/flagsmith-vs-posthog.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/flagsmith.json·/api/v1/tools/posthog.json - From a terminal
anchor compare flagsmith posthog(the CLI) - Over MCP
compare_tools {"a": "flagsmith", "b": "posthog"}at/mcp, no key