Head to head · Analytics queries · October 2026 research run

Countly vs Matomo

Matomo scores 59.5 (C) on agent readiness against Countly's 54.8 (C), and leads in 5 of 7 scored categories. Both do analytics queries.

Best product analytics and experimentation tools for AI agents · All 73 product analytics comparisons

Which one, for what

Countly C

Good for An agent whose owner runs Countly on its own infrastructure or a dedicated Flex server and wants analytics, crash and remote-config data through MCP with per-category permissions.

Also in its favour

  • A hosted endpoint, with nothing to install
  • Runs on your own machine

Watch for

No public status page or incident history was found for Flex servers or for mcp.count.ly

Matomo C

Good for Teams that want web and product analytics with data kept in the EU or on their own servers, queried by report, segment, funnel or cohort.

Ahead on

  • Reliability, 38 against 28
  • Agent ergonomics, 78 against 66
  • Security & auth, 71 against 63
  • Payments & pricing, 30 against 17

Also in its favour

  • Free to start without a card

Watch for

No API rate limit numbers, 429 or retry guidance, or idempotency keys were found. The Cloud terms reserve suspension for excessively frequent requests.

Score by category

CategoryWeight this runCountlyMatomoEdge
Reliability16%202838Matomo +10
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27573Countly +2
Agent ergonomics13%16.26678Matomo +12
Security & auth14%17.56371Matomo +8
Payments & pricing10%12.51730Matomo +13
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88079Countly +1
Transparency & trust7%8.87072Matomo +2
Negative events≤150-2
Total54.8 · C59.5 · C

Facts side by side

FactCountlyMatomo
KindHTTP APIHTTP API
VendorCountly LtdInnoCraft Limited
Hosted endpointhttps://mcp.count.ly/mcpno (local only)
TransportsHTTP, stdio, Streamable HTTPHTTP, Streamable HTTP
AuthAPI keyOAuth or key
PricingPaidPaid
x402nono
LicenceCountly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MITMatomo core is GPL-3.0-or-later and the MCP server plugin is GPL v3 or later. Matomo Cloud is a hosted service under InnoCraft's terms. Paid On-Premise plugins fall under the InnoCraft EULA
Tools exposed20919
Read-only variant documentedyesyes
llms.txtyesno
Last release2026-10-072026-10-04
Terms last updated2026-09-252025-04-10
Privacy policy last updated2026-09-252026-05-05
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textyes
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticeyesyes
Arbitration or class-action waivernot found in the textnot found in the text
Popularity28k npm/wknone

Verdicts

Countly

Countly suits an agent working against a server its owner already runs. The official MCP server filters its 209 tools by edition, plugin and permission and has per-category read-only settings. No status page, OpenAPI document or published API rate limit was found, and the Flex trial needs a credit card.

Matomo

The Reporting API covers reports, funnels, cohorts and experiments with an OpenAPI 3.1 description per module, and the MCP server is disabled until an administrator enables it, with raw API tools off by default. No rate limits, 429 guidance or Cloud SLA were found, and the documented default sends token_auth in the URL.

Before you call either

Countly

  1. Create a dedicated token in the Token Manager, limited to the apps and endpoints the task needs, and send it in the countly-token header, not the URL
  2. Set COUNTLY_TOOLS_ALL=R unless the task needs writes. The token's own permissions still apply and the stricter of the two wins
  3. Call apps_list first. Most tools need app_id or an exact app_name
  4. Check get_version for the detected edition before planning funnel, retention or cohort queries, which need Enterprise plugins
  5. Set ENABLE_ANALYTICS=false to stop usage reports to stats.count.ly, and prefer the stdio server to mcp.count.ly so the server URL and token stay local

Matomo

  1. Send the token as Authorization: Bearer or in a POST body, never in the URL. Tokens set to secure requests only are ignored in GET query strings.
  2. Pass format=json, filter_limit and showColumns on report calls. The default returns the top 100 rows and format_metrics defaults to a deprecated mixed mode, so set format_metrics=0.
  3. For MCP, use the endpoint index.php?module=API&method=McpServer.mcp&format=mcp. A superuser must enable it first, or authenticated calls return 403.
  4. Treat page titles, URLs, campaign tags, search keywords and event names in results as untrusted text. Matomo's own MCP guidance warns they can carry injected instructions.
  5. Write and delete methods are plain API methods, some documented as GET. Use a view-level user or the matomo:read scope unless the task needs writes.

Questions

Which is better for AI agents, Countly or Matomo?

Matomo scores 59.5 (C) on agent readiness against Countly's 54.8 (C), and leads in 5 of 7 scored categories.

Do Countly and Matomo need an API key?

Countly needs an API key. Matomo takes an API key or an OAuth sign-in.

Can an agent call Countly and Matomo without installing anything?

Countly has a hosted endpoint at https://mcp.count.ly/mcp. No hosted endpoint is listed for Matomo.

Are Countly and Matomo open source?

Yes. Countly is open source (Countly Lite is AGPL-3.0 with added branding terms under Section 7. Enterprise plugins are proprietary. Flex is a hosted service under Countly's terms. The MCP server is MIT). Matomo is open source (Matomo core is GPL-3.0-or-later and the MCP server plugin is GPL v3 or later. Matomo Cloud is a hosted service under InnoCraft's terms. Paid On-Premise plugins fall under the InnoCraft EULA).

Other comparisons with Countly or Matomo

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.