Head to head · Analytics query · October 2026 research run
Countly vs Statsig
Statsig scores 72.3 (BB) on agent readiness against Countly's 54.8 (C), and leads in every scored category. Both do analytics query.
Which one, for what
Countly C
Good for An agent whose owner runs Countly on its own infrastructure or a dedicated Flex server and wants analytics, crash and remote-config data through MCP with per-category permissions.
Also in its favour
- Runs on your own machine
- Open source
Watch for
No public status page or incident history was found for Flex servers or for mcp.count.ly
Statsig BB
Good for An agent that creates, updates and cleans up feature gates, dynamic configs and experiments, and reads experiment results and audit history.
Ahead on
- Reliability, 79 against 28
- Schema & documentation, 82 against 75
- Agent ergonomics, 71 against 66
- Security & auth, 74 against 63
- Payments & pricing, 40 against 17
- Transparency & trust, 75 against 70
Also in its favour
- Agent-ready, a grade of BB or better
- Free to start without a card
Watch for
Console API errors carry only status and message, and the spec documents no 429 response
Score by category
| Category | Weight this run | Countly | Statsig | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 28 | 79 | Statsig +51 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 75 | 82 | Statsig +7 |
| Agent ergonomics | 13%16.2 | 66 | 71 | Statsig +5 |
| Security & auth | 14%17.5 | 63 | 74 | Statsig +11 |
| Payments & pricing | 10%12.5 | 17 | 40 | Statsig +23 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 80 | 81 | Statsig +1 |
| Transparency & trust | 7%8.8 | 70 | 75 | Statsig +5 |
| Negative events | ≤15 | 0 | 0 | |
| Total | 54.8 · C | 72.3 · BB |
Facts side by side
| Fact | Countly | Statsig |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | Countly Ltd | Amplitude, Inc. |
| Hosted endpoint | https://mcp.count.ly/mcp | https://api.statsig.com/v3/mcp |
| Transports | HTTP, stdio, Streamable HTTP | HTTP, Streamable HTTP |
| Auth | API key | OAuth or key |
| Pricing | Paid | Freemium |
| x402 | no | no |
| Licence | Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT | Proprietary hosted service under Statsig's self-service or enterprise terms. The SDKs and the agent skills repository on GitHub are ISC |
| Tools exposed | 209 | 18 |
| Read-only variant documented | yes | no |
| llms.txt | yes | yes |
| MCP registry | not listed | com.statsig/statsig-mcp-server |
| Last release | 2026-10-07 | 2026-09-28 |
| Terms last updated | 2026-09-25 | 2025-08-04 |
| Privacy policy last updated | 2026-09-25 | 2026-08-31 |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | not found in the text | not found in the text |
| Terms restrict benchmarking | not found in the text | yes |
| Terms or service can change without notice | yes | yes |
| Arbitration or class-action waiver | not found in the text | yes |
| Popularity | 28k npm/wk | 4.2M npm/wk, 894k PyPI/wk |
Verdicts
Countly
Countly suits an agent working against a server its owner already runs. The official MCP server filters its 209 tools by edition, plugin and permission and has per-category read-only settings. No status page, OpenAPI document or published API rate limit was found, and the Flex trial needs a credit card.
Statsig
Statsig suits agents that manage feature gates and experiments and read their results. Its MCP server has 18 default tools, OAuth, read-only access by project and role, and a confirmation on updates. Errors carry only a status and a message, no idempotency keys were found, and the privacy notice is Amplitude's and doesn't name Statsig.
Before you call either
Countly
- Create a dedicated token in the Token Manager, limited to the apps and endpoints the task needs, and send it in the
countly-tokenheader, not the URL - Set
COUNTLY_TOOLS_ALL=Runless the task needs writes. The token's own permissions still apply and the stricter of the two wins - Call
apps_listfirst. Most tools needapp_idor an exactapp_name - Check
get_versionfor the detected edition before planning funnel, retention or cohort queries, which need Enterprise plugins - Set
ENABLE_ANALYTICS=falseto stop usage reports to stats.count.ly, and prefer the stdio server to mcp.count.ly so the server URL and token stay local
Statsig
- Connect to https://api.statsig.com/v3/mcp. The official MCP registry entry still lists the V1 URL, which has 93 tools
- Call
get_contextfirst to learn the project, your permissions and the review settings - Read the resource before
gate_update,experiment_updateordynamic_config_update. They replace the whole resource, so resend every field you want kept - Use
discover_toolsfor partial edits, and fetch a freshoperationHandlewhen one expires - On a 429 slow down and back off with jitter. Rejected attempts count towards the quota of about 1,800 mutations per 15 minutes
Questions
Which is better for AI agents, Countly or Statsig?
Statsig scores 72.3 (BB) on agent readiness against Countly's 54.8 (C), and leads in every scored category.
Do Countly and Statsig need an API key?
Countly needs an API key. Statsig takes an API key or an OAuth sign-in.
Can an agent call Countly and Statsig without installing anything?
Yes. Countly has a hosted endpoint at https://mcp.count.ly/mcp and Statsig at https://api.statsig.com/v3/mcp.
Are Countly and Statsig open source?
Countly is open source (Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT). No open-source release is listed for Statsig.
Other comparisons with Countly or Statsig
- Amplitude vs Countly
- Amplitude vs Statsig
- Countly vs Fullstory
- Countly vs GrowthBook
- Countly vs Mixpanel
- Countly vs Optimizely Experimentation
- Countly vs Pendo
- Countly vs PostHog
- Countly vs Woopra
- Fullstory vs Statsig
- Mixpanel vs Statsig
- Pendo vs Statsig
- PostHog vs Statsig
- Statsig vs Woopra
- Countly vs Heap
- Heap vs Statsig
- GrowthBook vs Statsig
- Optimizely Experimentation vs Statsig
- Countly vs LaunchDarkly
- LaunchDarkly vs Statsig
Machine-readable
- This page as Markdown
/compare/countly-vs-statsig.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/countly.json·/api/v1/tools/statsig.json - From a terminal
anchor compare countly statsig(the CLI) - Over MCP
compare_tools {"a": "countly", "b": "statsig"}at/mcp, no key