{ "data": { "a": { "slug": "countly", "name": "Countly", "vendor": "Countly Ltd", "vendorUrl": "https://countly.com", "kind": "http-api", "category": "product-analytics", "summary": "Countly is a product analytics platform sold as a managed private-cloud server (Flex), a self-hosted Enterprise edition and the open-source Countly Lite. Agents reach a Countly server through its HTTP API or the official `countly-mcp-server`.", "url": "https://www.anchorterminal.com/tools/countly", "markdownUrl": "https://www.anchorterminal.com/tools/countly.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/countly.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/countly.json", "dns": "countly.grade.anchorterminal.com", "repo": "https://github.com/Countly/countly-server", "license": "Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT", "transports": [ "http", "stdio", "streamable-http" ], "remoteUrl": "https://mcp.count.ly/mcp", "packages": [ { "registry": "npm", "name": "countly-mcp-server" }, { "registry": "npm", "name": "countly-sdk-web" }, { "registry": "npm", "name": "countly-sdk-nodejs" } ], "auth": "api-key", "authNotes": "Self-serve once a server exists. A dashboard user copies an `api_key`, which has that user's full read and write access, or creates an auth token in the Token Manager or with `/i/token/create`, limited by app, endpoint pattern and lifetime. Tokens go in the `countly-token` header or the `auth_token` query parameter. The MCP server takes `COUNTLY_SERVER_URL` and `COUNTLY_AUTH_TOKEN`, or `X-Countly-Server-Url` and `X-Countly-Auth-Token` headers over HTTP. SDKs send the write-only `app_key`.", "pricing": "paid", "pricingNotes": "Flex starts at $175 a month, billed by tier on monthly active users and data points, with a 14-day trial that needs a credit card. Tier prices appear during signup. Funnels, retention and flows sit in the Intelligence add-on. Enterprise is on custom pricing. Countly Lite is free to self-host. API and MCP calls are not billed (https://countly.com/pricing, checked 2026-11-04).", "priceSummary": "$175 / mo", "where": "both", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the API reference source, the MCP server README or the pricing page (checked 2026-11-04).", "endpoints": [] }, "toolCount": 209, "popularity": { "githubStars": null, "npmWeekly": 27579, "pypiWeekly": null, "asOf": "2026-10-08" }, "docsUrl": "https://api.count.ly/", "llmsTxt": "https://countly.com/llms.txt", "capabilities": [ "analytics.query", "analytics.events", "analytics.funnels", "analytics.experiments", "analytics.flags", "observability.errors" ], "tags": [ "official", "hosted", "self-hosted", "open-source", "mcp", "api-key", "llms-txt", "paid", "trial", "typescript" ], "lastRelease": "2026-10-27", "graded": true, "anchor": { "graded": true, "score": 38.8, "grade": "E", "agentReady": false, "rank": 1352, "ranked": true, "rankOf": 1510, "categoryRank": 19, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 66, "maintenance": 80, "payments": 17, "reliability": 23, "schema": 75, "security": 62, "transparency": 72 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-04" }, "negative": -15, "negativeNotes": [ "2026-10-16. Countly published four GitHub advisories for its own countly-server code, CVE-2026-44977 (stored XSS, CVSS 3.1 9.0 Critical), CVE-2026-41582 (unauthenticated path traversal, 7.5 High), CVE-2026-42270 (unauthenticated denial of service, 7.5 High) and CVE-2026-42269 (path traversal in delete_import, 8.1 High), fixed in 24.05.50 and 25.03.44. Fixed, under two months old, 2 each (-8). https://osv.dev/list?q=countly", "2026-09-10. CVE-2026-87803, a DBViewer authorisation bypass that reaches password-reset tokens, CVSS 4.0 7.1 High, published by Snyk as CNA and fixed in 25.03.53-LTS. A fixed third-party High under two months old (-2, falling to -1 after 10 November). https://osv.dev/vulnerability/CVE-2026-87803", "2026-10-27. Server 25.03.58 lists 10 security fixes to Countly's own code (token permissions and revocation, single-use tokens, read rights on endpoints), after 25.03.54 (22 September, 20 fixes) and MCP server 1.5.0 (25 August) and 1.7.0 (7 October). No advisory was found for them. Released fixes with no advisory, folded (-3). https://github.com/Countly/countly-server/blob/master/CHANGELOG.md", "2026-10-07. `countly-mcp-server` 1.7.0, a minor release, removed the `databases_stats` tool (committed on 6 October as a breaking refactor), with no earlier notice found. A breaking change in a minor release without notice (-3). https://github.com/Countly/countly-mcp-server/blob/main/CHANGELOG.md", "2026-10-27. Server 25.03.58 limits existing app-restricted tokens without permissions to their owner's rights and makes endpoint restrictions match exact API paths, so requests that earlier tokens were allowed to make can now fail. The change was posted with the release, with no earlier notice found. A published behaviour changed for existing clients on the day it took effect (-3). https://github.com/Countly/countly-server/blob/master/CHANGELOG.md", "The five terms add to -19, held at the -15 limit." ], "verdict": "Countly suits an agent working against a server its owner already runs. The official MCP server filters its 209 tools by edition, plugin and permission and has per-category read-only settings. Five countly-server CVEs were published since September, all fixed, and no status page, OpenAPI document or published API rate limit was found.", "bestFor": "An agent whose owner runs Countly on its own infrastructure or a dedicated Flex server and wants analytics, crash and remote-config data through MCP with per-category permissions.", "strengths": [ "Official MIT MCP server, `countly-mcp-server` 1.7.0 of 7 October 2026, with read-only, destructive and idempotent annotations on its tools", "`COUNTLY_TOOLS_ALL=R` makes every MCP tool read-only, and per-category settings take None, R, CR, CRU or CRUD", "Auth tokens can be limited to named apps and endpoint patterns, carry a lifetime in seconds and are revocable", "API reference at api.count.ly is versioned (26.01, 25.03, 24.05) with parameters, examples and error responses per endpoint", "Flex terms, privacy policy, DPA, sub-processor list and a telemetry notice, all dated 20 October 2026, with 30 days' notice of sub-processor changes" ], "weaknesses": [ "No public status page or incident history was found for Flex servers or for mcp.count.ly", "Five CVEs in countly-server were published between 10 September and 16 October 2026, one Critical and four High, all fixed", "`countly-mcp-server` 1.7.0 removed the `databases_stats` tool in a minor release with no earlier notice", "The API accepts `api_key` and `auth_token` in the URL query string, and the `api_key` has its user's full read and write access", "Flex starts at $175 a month, its 14-day trial needs a credit card, and tier prices appear only during signup", "Servers and the MCP server report usage to stats.count.ly by default until it is switched off" ], "agentNotes": [ "Create a dedicated token in the Token Manager, limited to the apps and endpoints the task needs, and send it in the `countly-token` header, not the URL", "Set `COUNTLY_TOOLS_ALL=R` unless the task needs writes. The token's own permissions still apply and the stricter of the two wins", "Call `apps_list` first. Most tools need `app_id` or an exact `app_name`", "Check `get_version` for the detected edition before planning funnel, retention or cohort queries, which need Enterprise plugins", "Set `ENABLE_ANALYTICS=false` to stop MCP usage reports to stats.count.ly, and ask the server owner to check the tracking settings for server reports" ], "metrics": { "kind": "remote", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "E", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 38.8 } ], "editorialScores": { "ergonomics": 66, "maintenance": 80, "payments": 17, "reliability": 23, "schema": 75, "security": 62, "transparency": 73 }, "provenanceScore": 70, "checked": { "categories": { "ergonomics": "2026-11-04", "maintenance": "2026-11-04", "payments": "2026-11-04", "reliability": "2026-11-04", "schema": "2026-11-04", "security": "2026-11-04", "transparency": "2026-11-04" }, "last": "2026-11-04", "lastMoved": "2026-11-04", "oldest": "2026-11-04", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "npx -y countly-mcp-server", "http": "curl -H \"countly-token: YOUR_TOKEN\" \"https://your-countly-url.com/o?app_id=APP_ID\u0026method=funneldata\u0026funnels=[%22FUNNEL_ID%22]\"", "claudeCode": "claude mcp add countly -e COUNTLY_SERVER_URL=https://your-countly-url.com -e COUNTLY_AUTH_TOKEN=YOUR_TOKEN -- npx -y --prefer-online countly-mcp-server@latest", "config": { "mcpServers": { "countly": { "args": [ "-y", "--prefer-online", "countly-mcp-server@latest" ], "command": "npx", "env": { "COUNTLY_AUTH_TOKEN": "YOUR_TOKEN", "COUNTLY_SERVER_URL": "https://your-countly-url.com" } } } } }, "letme": { "capability": "https://letme.dev/analytics.query", "tool": "https://letme.dev/countly" }, "area": "business", "unitPrices": [ { "item": "Flex, lowest tier", "unit": "month", "usd": 175, "note": "starting price, by monthly active users and data points, add-ons extra" } ], "provenance": { "legalEntity": "Countly Ltd", "domain": "countly.com", "domainRegistered": "2011-09-05", "endpointOnVendorDomain": true, "terms": "https://countly.com/legal/flex-terms", "privacy": "https://countly.com/legal/flex-privacy", "statusPage": "", "changelog": "https://github.com/Countly/countly-server/blob/master/CHANGELOG.md", "securityTxt": "none", "checked": "2026-11-04", "notes": [ "Countly's legal pages were split on 20 October 2026 into website, Flex and Enterprise documents. The Flex terms (last updated 20 October 2026) name Countly Ltd, incorporated in England and Wales with registered number 8568329, registered at 1 Bow Churchyard, London EC4M 9DQ. The former terms URL now holds the Enterprise terms.", "The Flex privacy policy (last updated 20 October 2026) covers Flex accounts and the Flex console and excludes data customers process in their Flex servers, which the Flex DPA at countly.com/legal/flex-dpa covers.", "The hosted MCP server answers at mcp.count.ly and the API reference at api.count.ly, a second domain of the vendor's. Each customer's API answers on that customer's own server address.", "countly.com/.well-known/security.txt returns 404. SECURITY.md in the repositories gives a disclosure address at count.ly.", "No status page was found. status.countly.com did not resolve on 4 November 2026.", "RDAP for countly.com gave a registration date of 2011-09-05, per the 8 October check, not re-read on 4 November." ], "score": 70 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/countly.json", "live": { "slug": "countly", "probe": { "target": "https://mcp.count.ly/mcp", "method": "get", "lastAt": "2026-11-07T22:55:52.865908746Z", "lastOk": false, "lastStatus": 0, "lastMs": 0, "lastNote": "DNS lookup failed", "authRequired": false, "uptime24h": 0, "uptime30d": 0, "p50ms24h": 0, "p95ms24h": 0, "samples24h": 244, "samples30d": 7335, "days": [ { "date": "2026-10-09", "probes": 169, "ok": 0 }, { "date": "2026-10-10", "probes": 247, "ok": 0 }, { "date": "2026-10-11", "probes": 247, "ok": 0 }, { "date": "2026-10-12", "probes": 247, "ok": 0 }, { "date": "2026-10-13", "probes": 248, "ok": 0 }, { "date": "2026-10-14", "probes": 249, "ok": 0 }, { "date": "2026-10-15", "probes": 253, "ok": 0 }, { "date": "2026-10-16", "probes": 252, "ok": 0 }, { "date": "2026-10-17", "probes": 253, "ok": 0 }, { "date": "2026-10-18", "probes": 256, "ok": 0 }, { "date": "2026-10-19", "probes": 255, "ok": 0 }, { "date": "2026-10-20", "probes": 252, "ok": 0 }, { "date": "2026-10-21", "probes": 253, "ok": 0 }, { "date": "2026-10-22", "probes": 253, "ok": 0 }, { "date": "2026-10-23", "probes": 248, "ok": 0 }, { "date": "2026-10-24", "probes": 251, "ok": 0 }, { "date": "2026-10-25", "probes": 250, "ok": 0 }, { "date": "2026-10-26", "probes": 252, "ok": 0 }, { "date": "2026-10-27", "probes": 249, "ok": 0 }, { "date": "2026-10-28", "probes": 251, "ok": 0 }, { "date": "2026-10-29", "probes": 248, "ok": 0 }, { "date": "2026-10-30", "probes": 249, "ok": 0 }, { "date": "2026-10-31", "probes": 251, "ok": 0 }, { "date": "2026-11-01", "probes": 249, "ok": 0 }, { "date": "2026-11-02", "probes": 250, "ok": 0 }, { "date": "2026-11-03", "probes": 248, "ok": 0 }, { "date": "2026-11-04", "probes": 246, "ok": 0 }, { "date": "2026-11-05", "probes": 185, "ok": 0 }, { "date": "2026-11-06", "probes": 241, "ok": 0 }, { "date": "2026-11-07", "probes": 233, "ok": 0 } ], "outages": [ { "start": "2026-10-09T07:40:23.474688008Z", "end": "0001-01-01T00:00:00Z", "note": "HTTP 500 server error" } ] }, "versions": [ { "registry": "github", "name": "Countly/countly-server", "version": "25.03.58", "released": "2026-10-27", "seenAt": "2026-11-06T23:18:01.436887578Z" }, { "registry": "npm", "name": "countly-mcp-server", "version": "1.7.0", "seenAt": "2026-11-06T23:17:57.231778538Z" }, { "registry": "npm", "name": "countly-sdk-nodejs", "version": "26.8.0", "seenAt": "2026-11-06T23:17:59.854974474Z" }, { "registry": "npm", "name": "countly-sdk-web", "version": "26.8.1", "seenAt": "2026-11-06T23:17:57.446036177Z" } ], "githubStars": 5926, "npmWeekly": 98, "securityTxt": { "url": "https://countly.com/.well-known/security.txt", "state": "valid", "expires": "2027-11-01T00:00:00.000Z", "checkedAt": "2026-11-07T16:01:40.278221054Z" }, "llmsTxt": { "url": "https://countly.com/llms.txt", "ok": true, "status": 200, "checkedAt": "2026-11-07T15:32:12.439042164Z" }, "domain": { "domain": "countly.com", "registered": "2011-09-05", "source": "https://rdap.verisign.com/com/v1/domain/countly.com", "checkedAt": "2026-11-01T14:23:11.366008393Z" }, "pages": [ { "url": "https://raw.githubusercontent.com/Countly/countly-server/master/CHANGELOG.md", "kind": "changelog", "status": 304, "checkedAt": "2026-11-07T14:18:15.260633274Z", "changedAt": "2026-10-28T04:41:57.810807375Z", "fingerprint": "464bd4917794" }, { "url": "https://countly.com/pricing", "kind": "pricing", "status": 200, "checkedAt": "2026-11-07T14:02:07.279637492Z", "changedAt": "2026-11-07T14:02:07.279637492Z", "fingerprint": "25a1aa31c1a8" }, { "url": "https://countly.com/legal/flex-privacy", "kind": "privacy", "status": 200, "checkedAt": "2026-11-07T14:02:03.050349438Z", "changedAt": "2026-11-07T14:02:03.050349438Z", "fingerprint": "67c45cb07861" }, { "url": "https://countly.com/legal/privacy-policy", "kind": "privacy", "status": 304, "checkedAt": "2026-11-04T08:17:18.582896946Z", "changedAt": "2026-10-30T05:33:48.300790761Z", "fingerprint": "524fd19db10d" }, { "url": "https://countly.com/legal/flex-terms", "kind": "terms", "status": 200, "checkedAt": "2026-11-07T14:02:05.263811859Z", "changedAt": "2026-11-07T14:02:05.263811859Z", "fingerprint": "e6833f089a23" }, { "url": "https://countly.com/legal/terms-of-service", "kind": "terms", "status": 304, "checkedAt": "2026-11-04T08:17:20.792676441Z", "changedAt": "2026-10-30T05:33:50.469505336Z", "fingerprint": "917431844060" } ], "github": { "repo": "countly/countly-server", "checkedAt": "2026-11-02T08:41:46.317370507Z", "stars": 5926, "archived": false, "issuesEnabled": true, "pushedAt": "2026-11-01T20:04:22Z", "openIssues": 1, "openPRs": 9, "issuesOpened90d": 1, "issuesClosed90d": 8, "prsMerged90d": 281, "ci": { "branch": "master", "runs": 50, "success": 25, "failure": 25, "other": 0, "latest": "success", "latestAt": "2026-11-01T19:21:22Z" }, "advisories": [ { "ghsa": "GHSA-gx33-qqr5-376j", "severity": "medium", "published": "2026-10-26T18:20:22Z" }, { "ghsa": "GHSA-p78q-3v9r-c8qg", "severity": "high", "published": "2026-10-26T18:19:48Z" }, { "ghsa": "GHSA-fqgp-6rm9-8696", "cve": "CVE-2026-41582", "severity": "high", "published": "2026-07-15T12:52:34Z" }, { "ghsa": "GHSA-86cv-qwp9-jwp3", "cve": "CVE-2026-42270", "severity": "high", "published": "2026-07-15T12:49:59Z" }, { "ghsa": "GHSA-5pmc-54j6-jcgq", "cve": "CVE-2026-42269", "severity": "high", "published": "2026-07-15T12:49:06Z" }, { "ghsa": "GHSA-jqp4-p86c-phxc", "cve": "CVE-2026-44977", "severity": "high", "published": "2026-07-15T12:48:11Z" }, { "ghsa": "GHSA-98vh-wqw5-p23v", "cve": "CVE-2022-29174", "severity": "high", "published": "2022-05-17T17:17:14Z" } ], "replies": { "sampled": 25, "unanswered": 0, "medianDays": 67 } }, "updatedAt": "2026-11-07T22:55:52.865908746Z" } }, "answer": "Flagsmith scores 61.2 (C) on agent readiness against Countly's 38.8 (E), and leads in 5 of 7 scored categories. Countly leads on schema \u0026 documentation and agent ergonomics.", "b": { "slug": "flagsmith", "name": "Flagsmith", "vendor": "Bullet Train Ltd", "vendorUrl": "https://www.flagsmith.com", "kind": "http-api", "category": "product-analytics", "summary": "Flagsmith is an open-source feature flag, remote config and experimentation service from Bullet Train Ltd. Teams use it on Flagsmith Cloud or self-hosted, through SDKs, a Management API and a remote MCP server.", "url": "https://www.anchorterminal.com/tools/flagsmith", "markdownUrl": "https://www.anchorterminal.com/tools/flagsmith.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/flagsmith.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/flagsmith.json", "dns": "flagsmith.grade.anchorterminal.com", "repo": "https://github.com/Flagsmith/flagsmith", "license": "BSD-3-Clause", "transports": [ "http", "streamable-http", "stdio" ], "remoteUrl": "https://mcp.flagsmith.com", "packages": [ { "registry": "pypi", "name": "flagsmith" }, { "registry": "npm", "name": "flagsmith" } ], "auth": "mixed", "authNotes": "The hosted MCP server takes OAuth (the client discovers Flagsmith as the authorisation server and a person signs in) or an Organisation API key sent as `Authorization: Api-Key \u003ckey\u003e`. Organisation keys act as full organisation admin or with chosen RBAC roles; granular roles need Scale-Up or Enterprise. OIDC trust relationships let CI workloads such as GitHub Actions exchange their token for a short-lived one. SDK environment keys are separate.", "pricing": "freemium", "pricingNotes": "Free plan at $0 with 50,000 requests a month and one team member. Start-Up is $45 a month ($40 billed yearly) for 1,000,000 requests and three members, Scale-Up $300 a month ($250 yearly) for 5,000,000. Enterprise by quote. Extra API calls from $50 per million; the page also quotes $7 per 100,000 for Start-Up. The self-hosted edition is free under BSD-3-Clause.", "priceSummary": "$45 / mo", "where": "both", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs, the OpenAPI spec or the pricing page (checked 2026-11-06).", "endpoints": [] }, "toolCount": 54, "popularity": { "githubStars": 6639, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-11-06" }, "docsUrl": "https://docs.flagsmith.com/", "openapi": "https://github.com/Flagsmith/flagsmith/blob/main/openapi.yaml", "capabilities": [ "analytics.flags", "analytics.experiments", "analytics.events" ], "tags": [ "official", "hosted", "open-source", "self-hosted", "mcp", "remote-mcp", "oauth", "openapi", "free-tier", "status-page", "soc2", "sla", "python", "typescript" ], "lastRelease": "2026-11-05", "graded": true, "anchor": { "graded": true, "score": 61.2, "grade": "C", "agentReady": false, "rank": 623, "ranked": true, "rankOf": 1510, "categoryRank": 12, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 55, "maintenance": 83, "payments": 40, "reliability": 65, "schema": 67, "security": 65, "transparency": 77 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-11-06" }, "negative": -2, "negativeNotes": [ "6 November 2026. The self-hosted API sends a heartbeat to https://api.flagsmith.com/api/v1/analytics/telemetry/ with counts of organisations, projects, environments, feature flags, segments and users, on by default (`ENABLE_TELEMETRY = env.bool(\"ENABLE_TELEMETRY\", default=True)`). The flag isn't in the environment-variable reference or anywhere else in the docs we read. Counts only, self-hosted only, so the minimum deduction (https://github.com/Flagsmith/flagsmith/blob/main/api/app/settings/common.py ; https://github.com/Flagsmith/flagsmith/blob/main/api/telemetry/telemetry.py)." ], "verdict": "Flagsmith pairs a BSD-licensed core with a hosted MCP server whose 54 tools come from its OpenAPI spec and carry read and destructive hints. A public 99.95 per cent SLA and SOC 2 report back the Cloud service. The MCP server is still an early release, and fine-grained key roles need a paid Scale-Up or Enterprise plan.", "bestFor": "Feature flags and experiments for teams that want open source or self-hosting, managed by an agent through MCP.", "strengths": [ "Hosted MCP server at mcp.flagsmith.com with OAuth or an Organisation API key, and a stdio option for local use", "Each of the 54 MCP tools has readOnlyHint, destructiveHint and idempotentHint set from its HTTP method", "Public SLA of 99.95 per cent monthly uptime with service credits, and a status page with component history", "BSD-3-Clause source with a free self-hosted edition and 34 tagged releases in the last 90 days", "OIDC trust relationships let CI jobs get short-lived Management API tokens without stored secrets" ], "weaknesses": [ "The MCP docs call the server an early release, and experiment tools are marked beta", "54 tools load at once, with no toolsets or read-only mode on the server", "Granular API key roles, change requests and audit logs need Scale-Up or Enterprise", "No llms.txt, no documented 429 handling, and few documented error responses in the spec", "Self-hosted installs send a usage heartbeat by default through a flag the docs don't mention" ], "agentNotes": [ "Send the key as `Authorization: Api-Key \u003ckey\u003e`; the `Api-Key ` prefix is required and a bare key fails", "Check whether the environment uses v2 feature versioning before choosing between segment-override and version-state tools", "Use a key with a read-only RBAC role for analysis tasks, since a Free plan key has organisation admin rights", "Pace Management API calls under 500 a minute; no Retry-After guidance is documented", "Treat experiment results as possibly null until Flagsmith has computed them" ], "metrics": { "kind": "remote", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "C", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 61.2 } ], "editorialScores": { "ergonomics": 55, "maintenance": 83, "payments": 40, "reliability": 65, "schema": 67, "security": 65, "transparency": 67 }, "provenanceScore": 86, "checked": { "categories": { "ergonomics": "2026-11-06", "maintenance": "2026-11-06", "payments": "2026-11-06", "reliability": "2026-11-06", "schema": "2026-11-06", "security": "2026-11-06", "transparency": "2026-11-06" }, "last": "2026-11-06", "oldest": "2026-11-06", "stale": false, "staleAfterDays": 90 } }, "connect": { "http": "curl -H \"Authorization: Api-Key $FLAGSMITH_ORG_KEY\" https://api.flagsmith.com/api/v1/projects/", "claudeCode": "claude mcp add --transport http flagsmith https://mcp.flagsmith.com", "config": { "mcpServers": { "flagsmith": { "headers": { "Authorization": "Api-Key \u003cyour-api-key\u003e" }, "url": "https://mcp.flagsmith.com" } } } }, "letme": { "capability": "https://letme.dev/analytics.flags", "tool": "https://letme.dev/flagsmith" }, "area": "business", "unitPrices": [ { "item": "Start-Up plan", "unit": "month", "usd": 45, "note": "1,000,000 requests and 3 team members; $40 a month billed yearly" }, { "item": "Scale-Up plan", "unit": "month", "usd": 300, "note": "5,000,000 requests and 5 team members; $250 a month billed yearly" }, { "item": "Extra API calls", "unit": "1k-requests", "usd": 0.05, "note": "From $50 per million, lower with volume" }, { "item": "Extra Scale-Up team member", "unit": "seat-month", "usd": 50, "note": "Up to 20 members" } ], "provenance": { "legalEntity": "Bullet Train Ltd", "domain": "flagsmith.com", "domainRegistered": "2018-03-01", "endpointOnVendorDomain": true, "terms": "https://www.flagsmith.com/terms-of-service", "privacy": "https://www.flagsmith.com/privacy-policy", "statusPage": "https://status.flagsmith.com", "changelog": "https://github.com/Flagsmith/flagsmith/blob/main/CHANGELOG.md", "securityTxt": "none", "checked": "2026-11-06", "notes": [ "The terms of service name Bullet Train Limited trading as Flagsmith, company number 12353266, registered at 66 Paul St, London, under the laws of England and Wales. Companies House lists the company with five active officers.", "The privacy policy was last updated in October 2023; the GDPR sub-processor list is dated 13 October 2025.", "www.flagsmith.com/robots.txt disallows only sign-up, login and similar paths. docs.flagsmith.com has no robots.txt. The terms contain no clause on automated access that we found.", "www.flagsmith.com/.well-known/security.txt returned 404. SECURITY.md in the repository asks for reports to support@flagsmith.com.", "RDAP gives flagsmith.com a registration date of 1 March 2018." ], "score": 86 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/flagsmith.json", "live": { "slug": "flagsmith", "probe": { "target": "https://mcp.flagsmith.com", "method": "get", "lastAt": "2026-11-07T22:55:57.926747439Z", "lastOk": true, "lastStatus": 401, "lastMs": 60, "lastNote": "asks for credentials", "authRequired": true, "uptime24h": 100, "uptime30d": 100, "p50ms24h": 27, "p95ms24h": 123, "samples24h": 244, "samples30d": 246, "days": [ { "date": "2026-11-06", "probes": 13, "ok": 13 }, { "date": "2026-11-07", "probes": 233, "ok": 233 } ] }, "vendorStatus": { "page": "https://status.flagsmith.com", "indicator": "none", "summary": "All Systems Operational", "checkedAt": "2026-11-07T22:56:58.640471022Z" }, "versions": [ { "registry": "github", "name": "Flagsmith/flagsmith", "version": "v2.290.0", "released": "2026-11-05", "seenAt": "2026-11-06T23:26:24.068130998Z" }, { "registry": "npm", "name": "flagsmith", "version": "10.0.0", "seenAt": "2026-11-06T23:26:23.147625706Z" }, { "registry": "pypi", "name": "flagsmith", "version": "6.5.0", "released": "2026-11-06", "seenAt": "2026-11-06T23:26:23.005711379Z" } ], "githubStars": 6642, "npmWeekly": 156837, "pypiWeekly": 401488, "securityTxt": { "url": "https://flagsmith.com/.well-known/security.txt", "state": "none", "checkedAt": "2026-11-07T16:01:18.95883898Z" }, "pages": [ { "url": "https://raw.githubusercontent.com/Flagsmith/flagsmith/main/CHANGELOG.md", "kind": "changelog", "status": 200, "checkedAt": "2026-11-07T14:18:21.223652009Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "34b306151856" }, { "url": "https://www.flagsmith.com/privacy-policy", "kind": "privacy", "status": 200, "checkedAt": "2026-11-07T14:28:36.671052285Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "ba6cc5c7a64f" }, { "url": "https://www.flagsmith.com/terms-of-service", "kind": "terms", "status": 200, "checkedAt": "2026-11-07T14:28:38.746283857Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "6ada20e0c356" } ], "mcpTools": { "url": "https://mcp.flagsmith.com", "checkedAt": "2026-11-07T01:44:38.567136868Z", "status": "auth", "note": "asks for credentials before listing its tools", "changedAt": "2026-11-07T01:44:38.567136868Z" }, "updatedAt": "2026-11-07T22:56:58.640471022Z" } }, "edges": [ { "by": 42, "category": "reliability", "leads": "flagsmith", "name": "Reliability", "reasons": { "a": "Graded on the hosted lines, for a Countly Flex server reached through its HTTP API and the official MCP server. No status page was found on countly.com, the Flex page, the docs or the legal pages, and status.countly.com did not resolve on 4 November (0). With no page there is no readable incident history (5). The MCP server's HTTP endpoint is limited to 120 requests a minute per IP, but the Countly server's own `api_rate_limit_requests` setting ships at 0 (off), and the Flex terms of 20 October 2026 reserve usage limits without numbers (8 of 15, the earlier partial kept). No 429 or retry guidance and no idempotency keys were found in the API reference source (0). The pricing page lists an SLA as optional on Flex and included in Enterprise, with no SLA document published, which this run scores 0 (0). The API and MCP server 1.7.0 are generally available (10).", "b": "Graded on Flagsmith Cloud with the hosted lines. Statuspage at status.flagsmith.com with components for the Edge API, Admin API, dashboard and website (20). In the 90 days from 8 August, an Admin and SDK API outage on 28 October marked critical, posted at 21:56 UTC and resolved at 22:12 with no cause given, and a minor delay in processing flag changes on 10 September. The posted span of the outage is 16 minutes and its start isn't stated, so we read it as one serious incident under an hour (15 of 30). The Management API limit of 500 requests a minute is documented (15). No 429 handling, Retry-After or idempotency guidance was found in the docs (0). A public SLA commits to 99.95 per cent monthly uptime with service credits (10). The Management API is generally available, but the MCP docs call the server an early release, so half (5 of 10). 20+15+15+0+10+5 = 65." }, "scores": { "a": 23, "b": 65 } }, { "by": 23, "category": "payments", "leads": "flagsmith", "name": "Payments \u0026 pricing", "reasons": { "a": "No x402, MPP or L402 (0). The pricing page gives only a starting price for Flex, $175 a month, priced on monthly active users and data points, with tier prices shown during signup and Enterprise on custom pricing (7 of 20, the earlier partial kept). The 14-day Flex trial needs a credit card, per the Flex page. Countly Lite is free to self-host with no card, without funnels, retention, cohorts or Drill, so half credit (10). A person signs up in a browser, creates a server and makes a token in the dashboard (0).", "b": "No x402, MPP or L402 (0). Plan prices and the per-million overage are public without login, though the page gives two overage rates for Start-Up ($50 per million and $7 per 100,000) (20). A $0 Free plan with 50,000 requests a month and a free BSD-3-Clause self-hosted edition. The pricing page doesn't say whether a card is needed, but the Free plan has no charge and the self-hosted edition needs no account (20). A person signs up in a browser, then approves OAuth or creates a key (0). 0+20+20+0 = 40." }, "scores": { "a": 17, "b": 40 } }, { "by": 11, "category": "ergonomics", "leads": "countly", "name": "Agent ergonomics", "reasons": { "a": "The MCP README counts 209 tools in 43 categories, far past 30 (5). Add back 8 because the server hides tools the edition, enabled plugins or user's permissions cannot run, and `COUNTLY_TOOLS_*` settings switch categories off (13). List endpoints take `iDisplayStart` and `iDisplayLength`, and MCP list tools take `skip`, `limit` and `search` (15). API errors are `{\"result\": \"message\"}` strings with HTTP status codes and no error codes. The MCP server returns failures as `isError` results that name the missing plugin or permission (12). MCP tools carry readOnlyHint, destructiveHint and idempotentHint since 1.7.0. No idempotency keys on API writes (14). MCP tools accept `app_name` in place of `app_id` and set defaults. The SDKs cover data collection, not the read API (12).", "b": "54 tools, more than 30, with no toolsets or read-only subset; enterprise tools only appear where installed (5 of 25). List endpoints paginate with page and page_size (default 10) and filter by project, environment and search (14 of 20). Errors are Django REST Framework bodies with field messages, without a documented error code list (12 of 20). Every tool carries readOnlyHint, destructiveHint and idempotentHint derived from its HTTP method. No idempotency keys for POST (14 of 20). Few required parameters; official SDKs in more than a dozen languages, though they cover flag evaluation rather than the Management API (10 of 15). 5+14+12+14+10 = 55." }, "scores": { "a": 66, "b": 55 } }, { "by": 8, "category": "schema", "leads": "countly", "name": "Schema \u0026 documentation", "reasons": { "a": "No OpenAPI document was found in the API reference source (Countly/countly-docs-site) or in Countly/countly-server. Every MCP tool has a typed JSON Schema input (18 of 25). countly.com/llms.txt (77 KB) indexes the help centre for agents, while api.count.ly has no llms.txt and help article pages answered a bot check on 8 October (8). MCP tool descriptions name the endpoint, the plugin required and the tool to use instead, and API pages state permissions and behaviour (16). 82 enums across the tool sources, but the HTTP API takes JSON arrays and objects as query-string values (9). API pages carry request examples, response fields and error responses, as plain message strings (11). The API reference is versioned 26.01, 25.03 and 24.05 (611 pages for 26.01 in the source), and the server and MCP server keep public changelogs (13).", "b": "openapi.yaml in the repository is OpenAPI 3.1 with 624 operations, and the MCP server builds its 54 tools from the operations tagged `mcp`, so every tool has a JSON Schema input (25). No llms.txt (404) and no Markdown served for agents on docs.flagsmith.com; the docs are Markdown only in the repository (0). Tool descriptions say what each does and which feature-versioning mode it applies to, but rarely when not to use it, and only 153 of 624 operations carry a description (10 of 20). 57 enums and required fields in the spec, with some free-form value fields (10 of 15). Docs carry curl examples, but only 16 operations document a 400 and 6 a 404 (7 of 15). A /api/v1 path, release-please changelog and dated release notes (15). 25+0+10+10+7+15 = 67." }, "scores": { "a": 75, "b": 67 } }, { "by": 5, "category": "transparency", "leads": "flagsmith", "name": "Transparency \u0026 trust", "reasons": { "a": "Countly Lite is AGPL-3.0 with added branding terms under Section 7, the MCP server is MIT, and the Enterprise plugins that hold funnels, retention, cohorts and Drill are closed (20 of 30). Flex now has its own terms, privacy policy, DPA and sub-processor list, all dated 20 October 2026. The Flex privacy policy excludes data customers process and gives no retention periods, and the DPA covers that data (20). The MCP changelog deprecated auth tokens in URL parameters on 23 April 2026 (1.3.0), and the server warns on their use, with no notice period (15, the settled value for dated notices without a period). The Flex sub-processor list names locations, with 30 days' notice of changes in the DPA, and Flex customers choose a Google Cloud region. A Connected Services and Telemetry notice (20 October 2026) says server reports to stats.count.ly are on by default and which settings turn them off, and MCP usage reporting is disclosed with an opt-out (18).", "b": "BSD-3-Clause for the core and the MCP server; the about page says most of the product is under that licence and some CI runs with private packages, so not every Cloud feature is in the open repository (25 of 30). The terms set Flagsmith as processor with 48-hour breach notice and EEA transfer rules, and the sub-processor list is dated 13 October 2025. The privacy policy dates from October 2023 and states no retention periods (16 of 30). The Gram-hosted MCP server was retired with a dated notice (30 June 2026), and three spec operations are marked deprecated, without a stated deprecation policy (10 of 20). The sub-processor list names providers and their countries (16 of 20). 25+16+10+16 = 67." }, "scores": { "a": 72, "b": 77 } } ], "facts": [ { "a": "HTTP API", "b": "HTTP API", "name": "Kind" }, { "a": "Countly Ltd", "b": "Bullet Train Ltd", "name": "Vendor" }, { "a": "https://mcp.count.ly/mcp", "b": "https://mcp.flagsmith.com", "name": "Hosted endpoint" }, { "a": "HTTP, stdio, Streamable HTTP", "b": "HTTP, Streamable HTTP, stdio", "name": "Transports" }, { "a": "API key", "b": "OAuth or key", "name": "Auth" }, { "a": "Paid", "b": "Freemium", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT", "b": "BSD-3-Clause", "name": "Licence" }, { "a": "209", "b": "54", "name": "Tools exposed" }, { "a": "yes", "b": "yes", "name": "Read-only variant documented" }, { "a": "yes", "b": "no", "name": "llms.txt" }, { "a": "2026-10-27", "b": "2026-11-05", "name": "Last release" }, { "a": "not read yet", "b": "2026-09-01", "name": "Terms last updated" }, { "a": "not read yet", "b": "2023-10-01", "name": "Privacy policy last updated" }, { "a": "not read yet", "b": "not found in the text", "name": "Customer content may train models" }, { "a": "not read yet", "b": "not found in the text", "name": "Terms restrict automated access" }, { "a": "not read yet", "b": "not found in the text", "name": "Terms restrict benchmarking" }, { "a": "not read yet", "b": "not found in the text", "name": "Terms or service can change without notice" }, { "a": "not read yet", "b": "not found in the text", "name": "Arbitration or class-action waiver" }, { "a": "28k npm/wk", "b": "6.6k stars", "name": "Popularity" } ], "faq": [ { "answer": "Flagsmith scores 61.2 (C) on agent readiness against Countly's 38.8 (E), and leads in 5 of 7 scored categories. Countly leads on schema \u0026 documentation and agent ergonomics.", "question": "Which is better for AI agents, Countly or Flagsmith?" }, { "answer": "Countly needs an API key. Flagsmith takes an API key or an OAuth sign-in.", "question": "Do Countly and Flagsmith need an API key?" }, { "answer": "Yes. Countly has a hosted endpoint at https://mcp.count.ly/mcp and Flagsmith at https://mcp.flagsmith.com.", "question": "Can an agent call Countly and Flagsmith without installing anything?" }, { "answer": "Yes. Countly is open source (Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT). Flagsmith is open source (BSD-3-Clause).", "question": "Are Countly and Flagsmith open source?" } ], "goodFor": [ { "aheadOn": [ "Schema \u0026 documentation, 75 against 67", "Agent ergonomics, 66 against 55" ], "also": null, "goodFor": "An agent whose owner runs Countly on its own infrastructure or a dedicated Flex server and wants analytics, crash and remote-config data through MCP with per-category permissions.", "slug": "countly", "watchFor": "No public status page or incident history was found for Flex servers or for mcp.count.ly" }, { "aheadOn": [ "Reliability, 65 against 23", "Payments \u0026 pricing, 40 against 17", "Transparency \u0026 trust, 77 against 72" ], "also": null, "goodFor": "Feature flags and experiments for teams that want open source or self-hosting, managed by an agent through MCP.", "slug": "flagsmith", "watchFor": "The MCP docs call the server an early release, and experiment tools are marked beta" } ], "history": { "countly": [ { "causes": [ "security", "correction" ], "date": "2026-11-04", "delta": -16.1, "from": 54.9, "fromGrade": "C", "to": 38.8, "toGrade": "E" }, { "causes": [ "method" ], "date": "2026-10-27", "delta": 0.1, "from": 54.8, "fromGrade": "C", "to": 54.9, "toGrade": "C" } ], "flagsmith": null }, "job": { "capability": "analytics.flags", "name": "Feature flags" }, "others": [ { "json": "https://www.anchorterminal.com/compare/amplitude-vs-countly.json", "title": "Amplitude vs Countly", "url": "https://www.anchorterminal.com/compare/amplitude-vs-countly" }, { "json": "https://www.anchorterminal.com/compare/basedash-mcp-vs-countly.json", "title": "Basedash MCP vs Countly", "url": "https://www.anchorterminal.com/compare/basedash-mcp-vs-countly" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-fullstory.json", "title": "Countly vs Fullstory", "url": "https://www.anchorterminal.com/compare/countly-vs-fullstory" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-growthbook.json", "title": "Countly vs GrowthBook", "url": "https://www.anchorterminal.com/compare/countly-vs-growthbook" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-matomo.json", "title": "Countly vs Matomo", "url": "https://www.anchorterminal.com/compare/countly-vs-matomo" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-mixpanel.json", "title": "Countly vs Mixpanel", "url": "https://www.anchorterminal.com/compare/countly-vs-mixpanel" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-mostly-good-metrics.json", "title": "Countly vs Mostly Good Metrics", "url": "https://www.anchorterminal.com/compare/countly-vs-mostly-good-metrics" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-openpanel.json", "title": "Countly vs OpenPanel", "url": "https://www.anchorterminal.com/compare/countly-vs-openpanel" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-optimizely.json", "title": "Countly vs Optimizely Experimentation", "url": "https://www.anchorterminal.com/compare/countly-vs-optimizely" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-pendo.json", "title": "Countly vs Pendo", "url": "https://www.anchorterminal.com/compare/countly-vs-pendo" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-posthog.json", "title": "Countly vs PostHog", "url": "https://www.anchorterminal.com/compare/countly-vs-posthog" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-rudderstack-mcp.json", "title": "Countly vs RudderStack MCP", "url": "https://www.anchorterminal.com/compare/countly-vs-rudderstack-mcp" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-statsig.json", "title": "Countly vs Statsig", "url": "https://www.anchorterminal.com/compare/countly-vs-statsig" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-userpilot.json", "title": "Countly vs Userpilot", "url": "https://www.anchorterminal.com/compare/countly-vs-userpilot" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-woopra.json", "title": "Countly vs Woopra", "url": "https://www.anchorterminal.com/compare/countly-vs-woopra" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-heap.json", "title": "Countly vs Heap", "url": "https://www.anchorterminal.com/compare/countly-vs-heap" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-fullstory.json", "title": "Flagsmith vs Fullstory", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-fullstory" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-heap.json", "title": "Flagsmith vs Heap", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-heap" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-openpanel.json", "title": "Flagsmith vs OpenPanel", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-openpanel" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-rudderstack-mcp.json", "title": "Flagsmith vs RudderStack MCP", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-rudderstack-mcp" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-woopra.json", "title": "Flagsmith vs Woopra", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-woopra" }, { "json": "https://www.anchorterminal.com/compare/amplitude-vs-flagsmith.json", "title": "Amplitude vs Flagsmith", "url": "https://www.anchorterminal.com/compare/amplitude-vs-flagsmith" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-harness-fme.json", "title": "Countly vs Harness Feature Management \u0026 Experimentation", "url": "https://www.anchorterminal.com/compare/countly-vs-harness-fme" }, { "json": "https://www.anchorterminal.com/compare/countly-vs-launchdarkly.json", "title": "Countly vs LaunchDarkly", "url": "https://www.anchorterminal.com/compare/countly-vs-launchdarkly" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-growthbook.json", "title": "Flagsmith vs GrowthBook", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-growthbook" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-harness-fme.json", "title": "Flagsmith vs Harness Feature Management \u0026 Experimentation", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-harness-fme" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-launchdarkly.json", "title": "Flagsmith vs LaunchDarkly", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-launchdarkly" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-mixpanel.json", "title": "Flagsmith vs Mixpanel", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-mixpanel" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-optimizely.json", "title": "Flagsmith vs Optimizely Experimentation", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-optimizely" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-posthog.json", "title": "Flagsmith vs PostHog", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-posthog" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-statsig.json", "title": "Flagsmith vs Statsig", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-statsig" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-matomo.json", "title": "Flagsmith vs Matomo", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-matomo" }, { "json": "https://www.anchorterminal.com/compare/flagsmith-vs-mostly-good-metrics.json", "title": "Flagsmith vs Mostly Good Metrics", "url": "https://www.anchorterminal.com/compare/flagsmith-vs-mostly-good-metrics" } ], "panel": null, "scores": [ { "by": 42, "countly": 23, "edge": "flagsmith", "flagsmith": 65, "key": "reliability", "name": "Reliability", "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "by": 8, "countly": 75, "edge": "countly", "flagsmith": 67, "key": "schema", "name": "Schema \u0026 documentation", "weight": 13 }, { "by": 11, "countly": 66, "edge": "countly", "flagsmith": 55, "key": "ergonomics", "name": "Agent ergonomics", "weight": 13 }, { "by": 3, "countly": 62, "edge": "flagsmith", "flagsmith": 65, "key": "security", "name": "Security \u0026 auth", "weight": 14 }, { "by": 23, "countly": 17, "edge": "flagsmith", "flagsmith": 40, "key": "payments", "name": "Payments \u0026 pricing", "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "by": 3, "countly": 80, "edge": "flagsmith", "flagsmith": 83, "key": "maintenance", "name": "Maintenance \u0026 community", "weight": 7 }, { "by": 5, "countly": 72, "edge": "flagsmith", "flagsmith": 77, "key": "transparency", "name": "Transparency \u0026 trust", "weight": 7 } ], "summary": "Flagsmith scores 61.2 (C) on agent readiness against Countly's 38.8 (E), and leads in 5 of 7 scored categories. Countly leads on schema \u0026 documentation and agent ergonomics. Both do feature flags.", "tasks": null, "tutorials": [], "verdicts": { "countly": "Countly suits an agent working against a server its owner already runs. The official MCP server filters its 209 tools by edition, plugin and permission and has per-category read-only settings. Five countly-server CVEs were published since September, all fixed, and no status page, OpenAPI document or published API rate limit was found.", "flagsmith": "Flagsmith pairs a BSD-licensed core with a hosted MCP server whose 54 tools come from its OpenAPI spec and carry read and destructive hints. A public 99.95 per cent SLA and SOC 2 report back the Cloud service. The MCP server is still an early release, and fine-grained key roles need a paid Scale-Up or Enterprise plan." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/countly-vs-flagsmith", "json": "https://www.anchorterminal.com/compare/countly-vs-flagsmith.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/countly-vs-flagsmith.md", "mcp": "https://www.anchorterminal.com/mcp", "slim": "https://www.anchorterminal.com/compare/countly-vs-flagsmith.min.md" }, "markdown": "Flagsmith scores 61.2 (C) on agent readiness against Countly's 38.8 (E), and leads in 5 of 7 scored categories. Countly leads on schema \u0026 documentation and agent ergonomics. Both do feature flags.\n\n- Countly: grade E, 38.8/100, rank #1352 of 1510. Markdown https://www.anchorterminal.com/tools/countly.md · JSON https://www.anchorterminal.com/api/v1/tools/countly.json\n- Flagsmith: grade C, 61.2/100, rank #623 of 1510. Markdown https://www.anchorterminal.com/tools/flagsmith.md · JSON https://www.anchorterminal.com/api/v1/tools/flagsmith.json\n- Best product analytics and experimentation tools for AI agents: https://www.anchorterminal.com/best/product-analytics/index.md\n- All 170 product analytics comparisons: https://www.anchorterminal.com/compare/product-analytics/index.md\n\n## Which one, for what\n\n### Countly (E)\n\nGood for: An agent whose owner runs Countly on its own infrastructure or a dedicated Flex server and wants analytics, crash and remote-config data through MCP with per-category permissions.\n\nAhead on:\n- Schema \u0026 documentation, 75 against 67\n- Agent ergonomics, 66 against 55\n\nWatch for: No public status page or incident history was found for Flex servers or for mcp.count.ly\n\n### Flagsmith (C)\n\nGood for: Feature flags and experiments for teams that want open source or self-hosting, managed by an agent through MCP.\n\nAhead on:\n- Reliability, 65 against 23\n- Payments \u0026 pricing, 40 against 17\n- Transparency \u0026 trust, 77 against 72\n\nWatch for: The MCP docs call the server an early release, and experiment tools are marked beta\n\n\n## Why the edge\n\n### Reliability: Flagsmith +42\n\n- Countly (23): Graded on the hosted lines, for a Countly Flex server reached through its HTTP API and the official MCP server. No status page was found on countly.com, the Flex page, the docs or the legal pages, and status.countly.com did not resolve on 4 November (0). With no page there is no readable incident history (5). The MCP server's HTTP endpoint is limited to 120 requests a minute per IP, but the Countly server's own `api_rate_limit_requests` setting ships at 0 (off), and the Flex terms of 20 October 2026 reserve usage limits without numbers (8 of 15, the earlier partial kept). No 429 or retry guidance and no idempotency keys were found in the API reference source (0). The pricing page lists an SLA as optional on Flex and included in Enterprise, with no SLA document published, which this run scores 0 (0). The API and MCP server 1.7.0 are generally available (10).\n- Flagsmith (65): Graded on Flagsmith Cloud with the hosted lines. Statuspage at status.flagsmith.com with components for the Edge API, Admin API, dashboard and website (20). In the 90 days from 8 August, an Admin and SDK API outage on 28 October marked critical, posted at 21:56 UTC and resolved at 22:12 with no cause given, and a minor delay in processing flag changes on 10 September. The posted span of the outage is 16 minutes and its start isn't stated, so we read it as one serious incident under an hour (15 of 30). The Management API limit of 500 requests a minute is documented (15). No 429 handling, Retry-After or idempotency guidance was found in the docs (0). A public SLA commits to 99.95 per cent monthly uptime with service credits (10). The Management API is generally available, but the MCP docs call the server an early release, so half (5 of 10). 20+15+15+0+10+5 = 65.\n\n### Payments \u0026 pricing: Flagsmith +23\n\n- Countly (17): No x402, MPP or L402 (0). The pricing page gives only a starting price for Flex, $175 a month, priced on monthly active users and data points, with tier prices shown during signup and Enterprise on custom pricing (7 of 20, the earlier partial kept). The 14-day Flex trial needs a credit card, per the Flex page. Countly Lite is free to self-host with no card, without funnels, retention, cohorts or Drill, so half credit (10). A person signs up in a browser, creates a server and makes a token in the dashboard (0).\n- Flagsmith (40): No x402, MPP or L402 (0). Plan prices and the per-million overage are public without login, though the page gives two overage rates for Start-Up ($50 per million and $7 per 100,000) (20). A $0 Free plan with 50,000 requests a month and a free BSD-3-Clause self-hosted edition. The pricing page doesn't say whether a card is needed, but the Free plan has no charge and the self-hosted edition needs no account (20). A person signs up in a browser, then approves OAuth or creates a key (0). 0+20+20+0 = 40.\n\n### Agent ergonomics: Countly +11\n\n- Countly (66): The MCP README counts 209 tools in 43 categories, far past 30 (5). Add back 8 because the server hides tools the edition, enabled plugins or user's permissions cannot run, and `COUNTLY_TOOLS_*` settings switch categories off (13). List endpoints take `iDisplayStart` and `iDisplayLength`, and MCP list tools take `skip`, `limit` and `search` (15). API errors are `{\"result\": \"message\"}` strings with HTTP status codes and no error codes. The MCP server returns failures as `isError` results that name the missing plugin or permission (12). MCP tools carry readOnlyHint, destructiveHint and idempotentHint since 1.7.0. No idempotency keys on API writes (14). MCP tools accept `app_name` in place of `app_id` and set defaults. The SDKs cover data collection, not the read API (12).\n- Flagsmith (55): 54 tools, more than 30, with no toolsets or read-only subset; enterprise tools only appear where installed (5 of 25). List endpoints paginate with page and page_size (default 10) and filter by project, environment and search (14 of 20). Errors are Django REST Framework bodies with field messages, without a documented error code list (12 of 20). Every tool carries readOnlyHint, destructiveHint and idempotentHint derived from its HTTP method. No idempotency keys for POST (14 of 20). Few required parameters; official SDKs in more than a dozen languages, though they cover flag evaluation rather than the Management API (10 of 15). 5+14+12+14+10 = 55.\n\n### Schema \u0026 documentation: Countly +8\n\n- Countly (75): No OpenAPI document was found in the API reference source (Countly/countly-docs-site) or in Countly/countly-server. Every MCP tool has a typed JSON Schema input (18 of 25). countly.com/llms.txt (77 KB) indexes the help centre for agents, while api.count.ly has no llms.txt and help article pages answered a bot check on 8 October (8). MCP tool descriptions name the endpoint, the plugin required and the tool to use instead, and API pages state permissions and behaviour (16). 82 enums across the tool sources, but the HTTP API takes JSON arrays and objects as query-string values (9). API pages carry request examples, response fields and error responses, as plain message strings (11). The API reference is versioned 26.01, 25.03 and 24.05 (611 pages for 26.01 in the source), and the server and MCP server keep public changelogs (13).\n- Flagsmith (67): openapi.yaml in the repository is OpenAPI 3.1 with 624 operations, and the MCP server builds its 54 tools from the operations tagged `mcp`, so every tool has a JSON Schema input (25). No llms.txt (404) and no Markdown served for agents on docs.flagsmith.com; the docs are Markdown only in the repository (0). Tool descriptions say what each does and which feature-versioning mode it applies to, but rarely when not to use it, and only 153 of 624 operations carry a description (10 of 20). 57 enums and required fields in the spec, with some free-form value fields (10 of 15). Docs carry curl examples, but only 16 operations document a 400 and 6 a 404 (7 of 15). A /api/v1 path, release-please changelog and dated release notes (15). 25+0+10+10+7+15 = 67.\n\n### Transparency \u0026 trust: Flagsmith +5\n\n- Countly (72): Countly Lite is AGPL-3.0 with added branding terms under Section 7, the MCP server is MIT, and the Enterprise plugins that hold funnels, retention, cohorts and Drill are closed (20 of 30). Flex now has its own terms, privacy policy, DPA and sub-processor list, all dated 20 October 2026. The Flex privacy policy excludes data customers process and gives no retention periods, and the DPA covers that data (20). The MCP changelog deprecated auth tokens in URL parameters on 23 April 2026 (1.3.0), and the server warns on their use, with no notice period (15, the settled value for dated notices without a period). The Flex sub-processor list names locations, with 30 days' notice of changes in the DPA, and Flex customers choose a Google Cloud region. A Connected Services and Telemetry notice (20 October 2026) says server reports to stats.count.ly are on by default and which settings turn them off, and MCP usage reporting is disclosed with an opt-out (18).\n- Flagsmith (77): BSD-3-Clause for the core and the MCP server; the about page says most of the product is under that licence and some CI runs with private packages, so not every Cloud feature is in the open repository (25 of 30). The terms set Flagsmith as processor with 48-hour breach notice and EEA transfer rules, and the sub-processor list is dated 13 October 2025. The privacy policy dates from October 2023 and states no retention periods (16 of 30). The Gram-hosted MCP server was retired with a dated notice (30 June 2026), and three spec operations are marked deprecated, without a stated deprecation policy (10 of 20). The sub-processor list names providers and their countries (16 of 20). 25+16+10+16 = 67.\n\n## Score by category\n\n| Category | Weight | Countly | Flagsmith | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 23 | 65 | Flagsmith +42 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 75 | 67 | Countly +8 |\n| Agent ergonomics | 13% (16.2 this run) | 66 | 55 | Countly +11 |\n| Security \u0026 auth | 14% (17.5 this run) | 62 | 65 | Flagsmith +3 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 17 | 40 | Flagsmith +23 |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 80 | 83 | Flagsmith +3 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 72 | 77 | Flagsmith +5 |\n| Negative events | ≤15 | -15 | -2 | |\n| **Total** | | **38.8 · E** | **61.2 · C** | |\n\n## Facts side by side\n\n| Fact | Countly | Flagsmith |\n| --- | --- | --- |\n| Kind | HTTP API | HTTP API |\n| Vendor | Countly Ltd | Bullet Train Ltd |\n| Hosted endpoint | `https://mcp.count.ly/mcp` | `https://mcp.flagsmith.com` |\n| Transports | HTTP, stdio, Streamable HTTP | HTTP, Streamable HTTP, stdio |\n| Auth | API key | OAuth or key |\n| Pricing | Paid | Freemium |\n| x402 | no | no |\n| Licence | Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT | BSD-3-Clause |\n| Tools exposed | 209 | 54 |\n| Read-only variant documented | yes | yes |\n| llms.txt | yes | no |\n| Last release | 2026-10-27 | 2026-11-05 |\n| Terms last updated | not read yet | 2026-09-01 |\n| Privacy policy last updated | not read yet | 2023-10-01 |\n| Customer content may train models | not read yet | not found in the text |\n| Terms restrict automated access | not read yet | not found in the text |\n| Terms restrict benchmarking | not read yet | not found in the text |\n| Terms or service can change without notice | not read yet | not found in the text |\n| Arbitration or class-action waiver | not read yet | not found in the text |\n| Popularity | 28k npm/wk | 6.6k stars |\n\n## How the scores have moved\n\n### Countly\n\n- -16.1 on 4 November 2026 (C to E): security, correction\n- +0.1 on 27 October 2026: checklist\n\n### Flagsmith\n\nNo score change since it was listed.\n\n## Verdicts\n\n**Countly.** Countly suits an agent working against a server its owner already runs. The official MCP server filters its 209 tools by edition, plugin and permission and has per-category read-only settings. Five countly-server CVEs were published since September, all fixed, and no status page, OpenAPI document or published API rate limit was found.\n\n**Flagsmith.** Flagsmith pairs a BSD-licensed core with a hosted MCP server whose 54 tools come from its OpenAPI spec and carry read and destructive hints. A public 99.95 per cent SLA and SOC 2 report back the Cloud service. The MCP server is still an early release, and fine-grained key roles need a paid Scale-Up or Enterprise plan.\n\n## Before you call either\n\n### Countly\n\n1. Create a dedicated token in the Token Manager, limited to the apps and endpoints the task needs, and send it in the `countly-token` header, not the URL\n2. Set `COUNTLY_TOOLS_ALL=R` unless the task needs writes. The token's own permissions still apply and the stricter of the two wins\n3. Call `apps_list` first. Most tools need `app_id` or an exact `app_name`\n4. Check `get_version` for the detected edition before planning funnel, retention or cohort queries, which need Enterprise plugins\n5. Set `ENABLE_ANALYTICS=false` to stop MCP usage reports to stats.count.ly, and ask the server owner to check the tracking settings for server reports\n\n### Flagsmith\n\n1. Send the key as `Authorization: Api-Key \u003ckey\u003e`; the `Api-Key ` prefix is required and a bare key fails\n2. Check whether the environment uses v2 feature versioning before choosing between segment-override and version-state tools\n3. Use a key with a read-only RBAC role for analysis tasks, since a Free plan key has organisation admin rights\n4. Pace Management API calls under 500 a minute; no Retry-After guidance is documented\n5. Treat experiment results as possibly null until Flagsmith has computed them\n\n## Questions\n\n### Which is better for AI agents, Countly or Flagsmith?\n\nFlagsmith scores 61.2 (C) on agent readiness against Countly's 38.8 (E), and leads in 5 of 7 scored categories. Countly leads on schema \u0026 documentation and agent ergonomics.\n\n### Do Countly and Flagsmith need an API key?\n\nCountly needs an API key. Flagsmith takes an API key or an OAuth sign-in.\n\n### Can an agent call Countly and Flagsmith without installing anything?\n\nYes. Countly has a hosted endpoint at https://mcp.count.ly/mcp and Flagsmith at https://mcp.flagsmith.com.\n\n### Are Countly and Flagsmith open source?\n\nYes. Countly is open source (Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT). Flagsmith is open source (BSD-3-Clause).\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/countly-vs-flagsmith.json, and with the fewest tokens: https://www.anchorterminal.com/compare/countly-vs-flagsmith.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"countly\", \"b\": \"flagsmith\"}`. From a terminal: `anchor compare countly flagsmith`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/countly.json and https://www.anchorterminal.com/api/v1/tools/flagsmith.json\n\n## Other comparisons with Countly or Flagsmith\n\n- [Amplitude vs Countly](https://www.anchorterminal.com/compare/amplitude-vs-countly.md)\n- [Basedash MCP vs Countly](https://www.anchorterminal.com/compare/basedash-mcp-vs-countly.md)\n- [Countly vs Fullstory](https://www.anchorterminal.com/compare/countly-vs-fullstory.md)\n- [Countly vs GrowthBook](https://www.anchorterminal.com/compare/countly-vs-growthbook.md)\n- [Countly vs Matomo](https://www.anchorterminal.com/compare/countly-vs-matomo.md)\n- [Countly vs Mixpanel](https://www.anchorterminal.com/compare/countly-vs-mixpanel.md)\n- [Countly vs Mostly Good Metrics](https://www.anchorterminal.com/compare/countly-vs-mostly-good-metrics.md)\n- [Countly vs OpenPanel](https://www.anchorterminal.com/compare/countly-vs-openpanel.md)\n- [Countly vs Optimizely Experimentation](https://www.anchorterminal.com/compare/countly-vs-optimizely.md)\n- [Countly vs Pendo](https://www.anchorterminal.com/compare/countly-vs-pendo.md)\n- [Countly vs PostHog](https://www.anchorterminal.com/compare/countly-vs-posthog.md)\n- [Countly vs RudderStack MCP](https://www.anchorterminal.com/compare/countly-vs-rudderstack-mcp.md)\n- [Countly vs Statsig](https://www.anchorterminal.com/compare/countly-vs-statsig.md)\n- [Countly vs Userpilot](https://www.anchorterminal.com/compare/countly-vs-userpilot.md)\n- [Countly vs Woopra](https://www.anchorterminal.com/compare/countly-vs-woopra.md)\n- [Countly vs Heap](https://www.anchorterminal.com/compare/countly-vs-heap.md)\n- [Flagsmith vs Fullstory](https://www.anchorterminal.com/compare/flagsmith-vs-fullstory.md)\n- [Flagsmith vs Heap](https://www.anchorterminal.com/compare/flagsmith-vs-heap.md)\n- [Flagsmith vs OpenPanel](https://www.anchorterminal.com/compare/flagsmith-vs-openpanel.md)\n- [Flagsmith vs RudderStack MCP](https://www.anchorterminal.com/compare/flagsmith-vs-rudderstack-mcp.md)\n- [Flagsmith vs Woopra](https://www.anchorterminal.com/compare/flagsmith-vs-woopra.md)\n- [Amplitude vs Flagsmith](https://www.anchorterminal.com/compare/amplitude-vs-flagsmith.md)\n- [Countly vs Harness Feature Management \u0026 Experimentation](https://www.anchorterminal.com/compare/countly-vs-harness-fme.md)\n- [Countly vs LaunchDarkly](https://www.anchorterminal.com/compare/countly-vs-launchdarkly.md)\n- [Flagsmith vs GrowthBook](https://www.anchorterminal.com/compare/flagsmith-vs-growthbook.md)\n- [Flagsmith vs Harness Feature Management \u0026 Experimentation](https://www.anchorterminal.com/compare/flagsmith-vs-harness-fme.md)\n- [Flagsmith vs LaunchDarkly](https://www.anchorterminal.com/compare/flagsmith-vs-launchdarkly.md)\n- [Flagsmith vs Mixpanel](https://www.anchorterminal.com/compare/flagsmith-vs-mixpanel.md)\n- [Flagsmith vs Optimizely Experimentation](https://www.anchorterminal.com/compare/flagsmith-vs-optimizely.md)\n- [Flagsmith vs PostHog](https://www.anchorterminal.com/compare/flagsmith-vs-posthog.md)\n- [Flagsmith vs Statsig](https://www.anchorterminal.com/compare/flagsmith-vs-statsig.md)\n- [Flagsmith vs Matomo](https://www.anchorterminal.com/compare/flagsmith-vs-matomo.md)\n- [Flagsmith vs Mostly Good Metrics](https://www.anchorterminal.com/compare/flagsmith-vs-mostly-good-metrics.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "attributionRequired": true, "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-11-07", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.7", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run", "terms": "https://www.anchorterminal.com/terms/#data" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "Countly vs Flagsmith", "url": "" } ], "description": "Flagsmith scores 61.2 (C) to Countly's 38.8 (E) for feature flags. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "Countly E 38.8", "Flagsmith C 61.2", "scores" ], "h1": "Countly vs Flagsmith", "image": "https://www.anchorterminal.com/assets/og/default.png", "path": "/compare/countly-vs-flagsmith", "published": "2026-10-01", "section": "tools", "title": "Countly vs Flagsmith for AI agents in 2026: scores and prices", "toc": null, "updated": "2026-11-07", "url": "https://www.anchorterminal.com/compare/countly-vs-flagsmith" }, "tokens": { "markdown": 4700, "slim": 2680 }, "version": 1 }