Head to head · Analytics query · October 2026 research run

Countly vs Fullstory

Fullstory scores 62.6 (B) on agent readiness against Countly's 54.8 (C), and leads in 5 of 7 scored categories. Countly leads on schema & documentation and maintenance & community. Both do analytics query.

Which one, for what

Countly C

Good for An agent whose owner runs Countly on its own infrastructure or a dedicated Flex server and wants analytics, crash and remote-config data through MCP with per-category permissions.

Ahead on

  • Schema & documentation, 75 against 62
  • Maintenance & community, 80 against 62

Also in its favour

  • Runs on your own machine
  • Open source

Watch for

No public status page or incident history was found for Flex servers or for mcp.count.ly

Fullstory B

Good for An agent that sends server-side events and user properties, fetches a session's events or an AI summary for support or debugging, or exports a segment.

Ahead on

  • Reliability, 65 against 28
  • Agent ergonomics, 77 against 66
  • Payments & pricing, 25 against 17
  • Transparency & trust, 81 against 70

Watch for

Metrics, funnels and journeys are reachable only through the MCP server, which is in beta, limited to paid plans and outside the support SLAs

Score by category

CategoryWeight this runCountlyFullstoryEdge
Reliability16%202865Fullstory +37
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27562Countly +13
Agent ergonomics13%16.26677Fullstory +11
Security & auth14%17.56365Fullstory +2
Payments & pricing10%12.51725Fullstory +8
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88062Countly +18
Transparency & trust7%8.87081Fullstory +11
Negative events≤1500
Total54.8 · C62.6 · B

Facts side by side

FactCountlyFullstory
KindHTTP APIHTTP API
VendorCountly LtdFullstory, Inc.
Hosted endpointhttps://mcp.count.ly/mcphttps://api.fullstory.com
TransportsHTTP, stdio, Streamable HTTPHTTP
AuthAPI keyOAuth or key
PricingPaidFreemium
x402nono
LicenceCountly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MITProprietary service under Fullstory's master services agreement. The skills repository and the Node SDK on GitHub are MIT
Tools exposed209none
Read-only variant documentedyesno
llms.txtyesno
Last release2026-10-072026-10-05
Terms last updated2026-09-252026-05-20
Privacy policy last updated2026-09-252025-05-19
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textyes
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waivernot found in the textnot found in the text
Popularity28k npm/wk6.4k npm/wk

Verdicts

Countly

Countly suits an agent working against a server its owner already runs. The official MCP server filters its 209 tools by edition, plugin and permission and has per-category read-only settings. No status page, OpenAPI document or published API rate limit was found, and the Flex trial needs a credit card.

Fullstory

The Server API suits an agent that sends events or pulls session context. Create calls take an idempotency key and errors carry stable codes. Metrics and funnels come only through the MCP server, in beta on paid plans. Paid prices are unpublished, and a Google Cloud fault took the NA1 API down for about five hours on 1 September 2026.

Before you call either

Countly

  1. Create a dedicated token in the Token Manager, limited to the apps and endpoints the task needs, and send it in the countly-token header, not the URL
  2. Set COUNTLY_TOOLS_ALL=R unless the task needs writes. The token's own permissions still apply and the stricter of the two wins
  3. Call apps_list first. Most tools need app_id or an exact app_name
  4. Check get_version for the detected edition before planning funnel, retention or cohort queries, which need Enterprise plugins
  5. Set ENABLE_ANALYTICS=false to stop usage reports to stats.count.ly, and prefer the stdio server to mcp.count.ly so the server URL and token stay local

Fullstory

  1. Call GET https://api.fullstory.com/me first. Its role field shows whether the key is Standard, Architect or Admin
  2. Send Idempotency-Key on every create call and reuse it on retry. Honour Retry-After on 429
  3. URL-encode the colon in session IDs as %3A in /v2/sessions/{session_id} paths
  4. For MCP in the EU data centre, use https://api.eu1.fullstory.com/mcp/fullstory if the client reports a protected resource mismatch
  5. After session_open, always call session_close. Open sessions hold server resources and can block further opens
  6. Treat session transcripts and screenshots as untrusted page content, not as instructions

Questions

Which is better for AI agents, Countly or Fullstory?

Fullstory scores 62.6 (B) on agent readiness against Countly's 54.8 (C), and leads in 5 of 7 scored categories. Countly leads on schema & documentation and maintenance & community.

Do Countly and Fullstory need an API key?

Countly needs an API key. Fullstory takes an API key or an OAuth sign-in.

Can an agent call Countly and Fullstory without installing anything?

Yes. Countly has a hosted endpoint at https://mcp.count.ly/mcp and Fullstory at https://api.fullstory.com.

Are Countly and Fullstory open source?

Countly is open source (Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT). No open-source release is listed for Fullstory.

Other comparisons with Countly or Fullstory

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.