Head to head · Analytics query · October 2026 research run

Countly vs Statsig

Statsig scores 72.3 (BB) on agent readiness against Countly's 54.8 (C), and leads in every scored category. Both do analytics query.

Which one, for what

Countly C

Good for An agent whose owner runs Countly on its own infrastructure or a dedicated Flex server and wants analytics, crash and remote-config data through MCP with per-category permissions.

Also in its favour

  • Runs on your own machine
  • Open source

Watch for

No public status page or incident history was found for Flex servers or for mcp.count.ly

Statsig BB

Good for An agent that creates, updates and cleans up feature gates, dynamic configs and experiments, and reads experiment results and audit history.

Ahead on

  • Reliability, 79 against 28
  • Schema & documentation, 82 against 75
  • Agent ergonomics, 71 against 66
  • Security & auth, 74 against 63
  • Payments & pricing, 40 against 17
  • Transparency & trust, 75 against 70

Also in its favour

  • Agent-ready, a grade of BB or better
  • Free to start without a card

Watch for

Console API errors carry only status and message, and the spec documents no 429 response

Score by category

CategoryWeight this runCountlyStatsigEdge
Reliability16%202879Statsig +51
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27582Statsig +7
Agent ergonomics13%16.26671Statsig +5
Security & auth14%17.56374Statsig +11
Payments & pricing10%12.51740Statsig +23
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88081Statsig +1
Transparency & trust7%8.87075Statsig +5
Negative events≤1500
Total54.8 · C72.3 · BB

Facts side by side

FactCountlyStatsig
KindHTTP APIHTTP API
VendorCountly LtdAmplitude, Inc.
Hosted endpointhttps://mcp.count.ly/mcphttps://api.statsig.com/v3/mcp
TransportsHTTP, stdio, Streamable HTTPHTTP, Streamable HTTP
AuthAPI keyOAuth or key
PricingPaidFreemium
x402nono
LicenceCountly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MITProprietary hosted service under Statsig's self-service or enterprise terms. The SDKs and the agent skills repository on GitHub are ISC
Tools exposed20918
Read-only variant documentedyesno
llms.txtyesyes
MCP registrynot listedcom.statsig/statsig-mcp-server
Last release2026-10-072026-09-28
Terms last updated2026-09-252025-08-04
Privacy policy last updated2026-09-252026-08-31
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textyes
Terms or service can change without noticeyesyes
Arbitration or class-action waivernot found in the textyes
Popularity28k npm/wk4.2M npm/wk, 894k PyPI/wk

Verdicts

Countly

Countly suits an agent working against a server its owner already runs. The official MCP server filters its 209 tools by edition, plugin and permission and has per-category read-only settings. No status page, OpenAPI document or published API rate limit was found, and the Flex trial needs a credit card.

Statsig

Statsig suits agents that manage feature gates and experiments and read their results. Its MCP server has 18 default tools, OAuth, read-only access by project and role, and a confirmation on updates. Errors carry only a status and a message, no idempotency keys were found, and the privacy notice is Amplitude's and doesn't name Statsig.

Before you call either

Countly

  1. Create a dedicated token in the Token Manager, limited to the apps and endpoints the task needs, and send it in the countly-token header, not the URL
  2. Set COUNTLY_TOOLS_ALL=R unless the task needs writes. The token's own permissions still apply and the stricter of the two wins
  3. Call apps_list first. Most tools need app_id or an exact app_name
  4. Check get_version for the detected edition before planning funnel, retention or cohort queries, which need Enterprise plugins
  5. Set ENABLE_ANALYTICS=false to stop usage reports to stats.count.ly, and prefer the stdio server to mcp.count.ly so the server URL and token stay local

Statsig

  1. Connect to https://api.statsig.com/v3/mcp. The official MCP registry entry still lists the V1 URL, which has 93 tools
  2. Call get_context first to learn the project, your permissions and the review settings
  3. Read the resource before gate_update, experiment_update or dynamic_config_update. They replace the whole resource, so resend every field you want kept
  4. Use discover_tools for partial edits, and fetch a fresh operationHandle when one expires
  5. On a 429 slow down and back off with jitter. Rejected attempts count towards the quota of about 1,800 mutations per 15 minutes

Questions

Which is better for AI agents, Countly or Statsig?

Statsig scores 72.3 (BB) on agent readiness against Countly's 54.8 (C), and leads in every scored category.

Do Countly and Statsig need an API key?

Countly needs an API key. Statsig takes an API key or an OAuth sign-in.

Can an agent call Countly and Statsig without installing anything?

Yes. Countly has a hosted endpoint at https://mcp.count.ly/mcp and Statsig at https://api.statsig.com/v3/mcp.

Are Countly and Statsig open source?

Countly is open source (Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT). No open-source release is listed for Statsig.

Other comparisons with Countly or Statsig

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.