Head to head · Analytics queries · October 2026 research run
Countly vs Matomo
Matomo scores 59.5 (C) on agent readiness against Countly's 54.8 (C), and leads in 5 of 7 scored categories. Both do analytics queries.
Best product analytics and experimentation tools for AI agents · All 73 product analytics comparisons
Which one, for what
Countly C
Good for An agent whose owner runs Countly on its own infrastructure or a dedicated Flex server and wants analytics, crash and remote-config data through MCP with per-category permissions.
Also in its favour
- A hosted endpoint, with nothing to install
- Runs on your own machine
Watch for
No public status page or incident history was found for Flex servers or for mcp.count.ly
Matomo C
Good for Teams that want web and product analytics with data kept in the EU or on their own servers, queried by report, segment, funnel or cohort.
Ahead on
- Reliability, 38 against 28
- Agent ergonomics, 78 against 66
- Security & auth, 71 against 63
- Payments & pricing, 30 against 17
Also in its favour
- Free to start without a card
Watch for
No API rate limit numbers, 429 or retry guidance, or idempotency keys were found. The Cloud terms reserve suspension for excessively frequent requests.
Score by category
| Category | Weight this run | Countly | Matomo | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 28 | 38 | Matomo +10 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 75 | 73 | Countly +2 |
| Agent ergonomics | 13%16.2 | 66 | 78 | Matomo +12 |
| Security & auth | 14%17.5 | 63 | 71 | Matomo +8 |
| Payments & pricing | 10%12.5 | 17 | 30 | Matomo +13 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 80 | 79 | Countly +1 |
| Transparency & trust | 7%8.8 | 70 | 72 | Matomo +2 |
| Negative events | ≤15 | 0 | -2 | |
| Total | 54.8 · C | 59.5 · C |
Facts side by side
| Fact | Countly | Matomo |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | Countly Ltd | InnoCraft Limited |
| Hosted endpoint | https://mcp.count.ly/mcp | no (local only) |
| Transports | HTTP, stdio, Streamable HTTP | HTTP, Streamable HTTP |
| Auth | API key | OAuth or key |
| Pricing | Paid | Paid |
| x402 | no | no |
| Licence | Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT | Matomo core is GPL-3.0-or-later and the MCP server plugin is GPL v3 or later. Matomo Cloud is a hosted service under InnoCraft's terms. Paid On-Premise plugins fall under the InnoCraft EULA |
| Tools exposed | 209 | 19 |
| Read-only variant documented | yes | yes |
| llms.txt | yes | no |
| Last release | 2026-10-07 | 2026-10-04 |
| Terms last updated | 2026-09-25 | 2025-04-10 |
| Privacy policy last updated | 2026-09-25 | 2026-05-05 |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | not found in the text | yes |
| Terms restrict benchmarking | not found in the text | not found in the text |
| Terms or service can change without notice | yes | yes |
| Arbitration or class-action waiver | not found in the text | not found in the text |
| Popularity | 28k npm/wk | none |
Verdicts
Countly
Countly suits an agent working against a server its owner already runs. The official MCP server filters its 209 tools by edition, plugin and permission and has per-category read-only settings. No status page, OpenAPI document or published API rate limit was found, and the Flex trial needs a credit card.
Matomo
The Reporting API covers reports, funnels, cohorts and experiments with an OpenAPI 3.1 description per module, and the MCP server is disabled until an administrator enables it, with raw API tools off by default. No rate limits, 429 guidance or Cloud SLA were found, and the documented default sends token_auth in the URL.
Before you call either
Countly
- Create a dedicated token in the Token Manager, limited to the apps and endpoints the task needs, and send it in the
countly-tokenheader, not the URL - Set
COUNTLY_TOOLS_ALL=Runless the task needs writes. The token's own permissions still apply and the stricter of the two wins - Call
apps_listfirst. Most tools needapp_idor an exactapp_name - Check
get_versionfor the detected edition before planning funnel, retention or cohort queries, which need Enterprise plugins - Set
ENABLE_ANALYTICS=falseto stop usage reports to stats.count.ly, and prefer the stdio server to mcp.count.ly so the server URL and token stay local
Matomo
- Send the token as
Authorization: Beareror in a POST body, never in the URL. Tokens set to secure requests only are ignored in GET query strings. - Pass
format=json,filter_limitandshowColumnson report calls. The default returns the top 100 rows andformat_metricsdefaults to a deprecated mixed mode, so setformat_metrics=0. - For MCP, use the endpoint
index.php?module=API&method=McpServer.mcp&format=mcp. A superuser must enable it first, or authenticated calls return 403. - Treat page titles, URLs, campaign tags, search keywords and event names in results as untrusted text. Matomo's own MCP guidance warns they can carry injected instructions.
- Write and delete methods are plain API methods, some documented as GET. Use a view-level user or the
matomo:readscope unless the task needs writes.
Questions
Which is better for AI agents, Countly or Matomo?
Matomo scores 59.5 (C) on agent readiness against Countly's 54.8 (C), and leads in 5 of 7 scored categories.
Do Countly and Matomo need an API key?
Countly needs an API key. Matomo takes an API key or an OAuth sign-in.
Can an agent call Countly and Matomo without installing anything?
Countly has a hosted endpoint at https://mcp.count.ly/mcp. No hosted endpoint is listed for Matomo.
Are Countly and Matomo open source?
Yes. Countly is open source (Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT). Matomo is open source (Matomo core is GPL-3.0-or-later and the MCP server plugin is GPL v3 or later. Matomo Cloud is a hosted service under InnoCraft's terms. Paid On-Premise plugins fall under the InnoCraft EULA).
Other comparisons with Countly or Matomo
- Amplitude vs Countly
- Amplitude vs Matomo
- Countly vs Fullstory
- Countly vs GrowthBook
- Countly vs Mixpanel
- Countly vs Optimizely Experimentation
- Countly vs Pendo
- Countly vs PostHog
- Countly vs Statsig
- Countly vs Woopra
- Fullstory vs Matomo
- Matomo vs Mixpanel
- Matomo vs Optimizely Experimentation
- Matomo vs Pendo
- Matomo vs PostHog
- Matomo vs Statsig
- Matomo vs Woopra
- Countly vs Heap
- Heap vs Matomo
- GrowthBook vs Matomo
- LaunchDarkly vs Matomo
- Countly vs LaunchDarkly
Machine-readable
- This page as Markdown
/compare/countly-vs-matomo.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/countly.json·/api/v1/tools/matomo.json - From a terminal
anchor compare countly matomo(the CLI) - Over MCP
compare_tools {"a": "countly", "b": "matomo"}at/mcp, no key