Head to head · Scraping · October 2026 research run

Microlink vs Scrapingdog

Microlink scores 65.9 (B) on agent readiness against Scrapingdog's 39.3 (E), and leads in 6 of 7 scored categories. Scrapingdog leads on reliability. Both do scraping.

Best web scraping and crawling APIs for AI agents · All 501 scrapers comparisons

Which one, for what

Microlink B

Best for Agents that need link previews, screenshots, PDFs, metadata or a page as Markdown from one GET.

Ahead on

  • Schema & documentation, 89 against 43
  • Agent ergonomics, 82 against 44
  • Security & auth, 44 against 5
  • Payments & pricing, 47 against 40
  • Maintenance & community, 86 against 45
  • Transparency & trust, 75 against 56

Watch for

The status page is drawn by script and couldn't be read, so no incident history was checked

Scrapingdog E

Best for A budget agent that wants parsed Google, Amazon or LinkedIn results and can keep the key out of logs.

Ahead on

  • Reliability, 62 against 52

Watch for

API key only travels in the URL query string

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Schema & documentation Microlink +46

Microlink 89

OpenAPI 3.1 at microlink.io/openapi.json for the one GET endpoint with 58 typed parameters, and typed input schemas on every MCP tool in the source (25). llms.txt of 527 lines, auth.md, an API catalogue and Markdown copies of every docs page (10). Tool descriptions are one line with a pointer to the right sibling, such as 'For custom CSS/MQL fields, use microlink_extract', and microlink_search says it needs a key (15 of 20). Parameters are typed with enums for formats and devices, though data rules and function code are free-form (12 of 15). Examples in seven languages on each page and an error-code page with about 30 codes, each with cause and fix (15). A monthly changelog without day dates, a versioned OpenAPI and dated package CHANGELOGs (12 of 15). 25 + 10 + 15 + 12 + 15 + 12 = 89.

Scrapingdog 43

No OpenAPI spec found. The MCP builds typed zod inputs for 35 tools from a declarative registry, and ai_extract_rules is a JSON string (12 of 25). llms.txt per the 30 September check (10). MCP descriptions say what each endpoint does but not when to avoid it, and the web_scrape tool tells the model the API default for dynamic is false while the docs say rendering is on by default (10 of 20). Booleans, numbers and strings with few enums, plus the JSON-string field (9 of 15). Code examples on each docs page and 8 documented status codes (12 of 15). No changelog and no versioned API paths found (0).

Maintenance & community Microlink +41

Microlink 86

@microlink/mcp 2.8.17 and microlink.io 1.1.4 on 31 October 2026, and October changelog entries for the API (30). 31 MCP releases tagged since 17 September and the October changelog's API changes (20). No open issues on microlinkhq/microlink, a monthly changelog, and email and feedback-form support (18 of 25). Not in the official MCP registry under its own namespace, though the server card names io.microlink/mcp; the JavaScript SDK is current (8 of 15). Lint, tests and coverage run on pull requests (10). 30 + 20 + 18 + 8 + 10 = 86.

Scrapingdog 45

The SDKs and MCP server were first published on 31 July and 1 August 2026, 61 days ago. No API changelog or later release found (20). Three packages and two MCP versions shipped on launch day and nothing since, so we gave half (10 of 20). We couldn't read GitHub issues. The MCP repo has 6 commits, all on 1 August, and support is by chat and email (5 of 25). The MCP is in the official registry under the personal namespace io.github.Darshan972, though the vendor's SDK page links it as its own. SDKs are current (8 of 15). No CI, tests or tags in the MCP repo (2 of 10).

Security & auth Microlink +39

Microlink 44

One API key per account in the x-api-key header, with no scopes, rotation or expiry documented. auth.md says to keep it out of URLs and no query option is documented (20 of 30). Tools are reads apart from microlink_function, which runs caller-supplied code against the page in Microlink's browser, and the checkout tools never return a key (10 of 20). Pages come back as Markdown and text, and no prompt-injection guidance was found in the docs, auth.md or the MCP README (0). A request id on every response, with no per-call log for the customer documented (4 of 15). security.txt is valid to 28 July 2027 and links a responsible-disclosure policy and acknowledgements. No bug bounty or certification found (10 of 20). 20 + 10 + 0 + 4 + 10 = 44.

Scrapingdog 5

One account key with no scopes, and we found no rotation or revocation docs (10). The key goes only in the api_key query string, with no header option, so less 10 (0 of 30). No read-only mode or least-privilege key. The API only reads third-party pages, so there are no destructive account actions (5 of 20). No prompt-injection guidance in the docs or the MCP README (0 of 15). No request log or per-call audit found (0 of 15). No security.txt per the 30 September check, and no disclosure policy, bug bounty or certification found (0 of 20).

Agent ergonomics Microlink +38

Microlink 82

24 MCP tools in @microlink/mcp 2.8.17 with no toolset filter found (15 of 25). filter selects fields, embed returns one field as the body, and Markdown and text tools return only page content (18 of 20). Error codes such as EAUTH, ERATE, ECONCURRENCY, EPRO and EPROXYNEEDED with documented fixes (19 of 20). Every tool but microlink_function sets readOnlyHint true and destructiveHint false, and calls are reads with a cache and force to refresh. No idempotentHint (18 of 20). Only url is required; official JavaScript SDK (@microlink/mql) and CLI, with examples in seven languages but no other official SDK found (12 of 15). 15 + 18 + 19 + 18 + 12 = 82.

Scrapingdog 44

35 MCP tools with no toolsets or subsets (5 of 25). markdown=true, ai_query and parsed JSON endpoints for Google, Amazon and LinkedIn keep responses smaller. No documented pagination or size limits on the raw scrape (12 of 20). 8 HTTP status codes with meanings, and the MCP passes the status and body back (12 of 20). Failed requests aren't billed, but no tool annotations or idempotency guidance (5 of 20). Only url is required, but rendering defaults on at 5 credits and the MCP describes it as off. Node and Python SDKs (10 of 15).

Transparency & trust Microlink +19

Microlink 75

The API is closed under terms naming Microlink Labs, S.L. with its registry details, and the SDK, MCP server and the libraries behind it are MIT (20 of 30). The DPA, updated 30 October 2026, gives cache retention of 24 hours by default up to 31 days, logs 15 days and deletion within 15 days, but the privacy policy is undated, names no controller and gives no periods (20 of 30). The terms promise advance notice before a paid feature is materially reduced, and the changelog records changes by month, with no notice period (10 of 20). Subprocessors list updated 16 October 2026, with services, data types and locations (18 of 20). 20 + 20 + 10 + 18 = 68.

Scrapingdog 56

Closed service with terms revised 13 January 2026, naming OpenData Labs Private Limited under the laws of Rajasthan, India, with no postal address. The MCP is MIT (15 of 30). The privacy policy, revised 17 July 2025, says API calls are stateless and that Scrapingdog doesn't store, log or retain personal data fetched through the API. A DPA is published. No retention periods for account data (22 of 30). No deprecation policy or dated notices found (0). No processors or data locations named (0 of 20).

Reliability Scrapingdog +10

Microlink 52

Graded on the hosted lines. microlink.io/status exists but is drawn by script, showing only 'Please wait' to our reader, and status.microlink.io failed through our proxy, so components and history are unchecked and scored absent (0). No readable history (5). Free and keyed quotas are published, 5 and 25 requests a day and 2 at a time, with paid quotas from 46,000 a month and x-rate-limit headers on every response (15). 429 with ECONCURRENCY says to wait a second and retry, a quota 429 gives the reset time, and every call only reads, but there is no Retry-After header documented (12 of 15). The terms commit to 99.9% uptime on paid plans, with service credits only under an Enterprise agreement (10). Generally available (10). 0 + 5 + 15 + 12 + 10 + 10 = 52.

Scrapingdog 62

UptimeRobot status page linked from the footer per the 30 September check. It renders client-side and its data API is closed to our reader, so we couldn't see components today (15 of 20). No readable incident history (5). Concurrency per plan is published, 1 on Free up to 2,200 on the top plan (15). Over the limit returns 429, requests time out after 60 seconds, and the docs say to retry. Failures aren't billed. No Retry-After found (10 of 15). A public SLA page says Scrapingdog aims for 99 per cent monthly uptime and compensates downtime in credits, with no measurement method or date (7 of 10). Generally available (10).

Score by category

CategoryWeight this runMicrolinkScrapingdogEdge
Reliability16%205262Scrapingdog +10
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28943Microlink +46
Agent ergonomics13%16.28244Microlink +38
Security & auth14%17.5445Microlink +39
Payments & pricing10%12.54740Microlink +7
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88645Microlink +41
Transparency & trust7%8.87556Microlink +19
Negative events≤150-2
TotalB 65.9/100E 39.3/100

Facts side by side

FactMicrolinkScrapingdog
KindHTTP APIHTTP API
VendorMicrolink Labs, S.L.Scrapingdog (OpenData Labs)
Hosted endpointhttps://mcp.microlink.io/mcphttps://api.scrapingdog.com/scrape
Transportsstdio, Streamable HTTPHTTP, stdio
AuthAPI keyAPI key
PricingFreemiumFreemium
x402nono
Tools exposed2435
Read-only variant documentednono
llms.txtyesyes
MCP registrynot listedio.github.Darshan972/scrapingdog-mcp
Last release2026-10-312026-07-31
Terms last updatedno date given2026-01-13
Privacy policy last updatedno date given2025-07-17
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waivernot found in the textnot found in the text
Popularity805 npm/wk0 stars, 41 npm/wk, 12 PyPI/wk
Agent reviewsnone3/5 (2)

How the scores have moved

Verdicts

Microlink

Microlink turns one GET into metadata, Markdown, screenshots or PDFs, with a public OpenAPI spec, about 30 documented error codes, annotated MCP tools and 5 keyless requests a day. Its status page couldn't be read, keys have no scopes, and the official MCP server is not in the official registry.

Scrapingdog

A plain request is 1 credit, about $0.20 per 1,000 on Lite. API key only travels in the URL query string.

Before you call either

Microlink

  1. Send the key in the x-api-key header to https://pro.microlink.io; the free endpoint api.microlink.io answers EPRO to a key
  2. On 429 with ECONCURRENCY wait a second and retry; on a quota 429 wait for x-rate-limit-reset
  3. Use filter to return only the fields needed, and microlink_markdown for page text
  4. Hand checkout URLs from microlink_create_checkout_session to the user; the key arrives by email, never through the tool
  5. Treat Markdown and text from scraped pages as untrusted data, never as instructions

Scrapingdog

  1. Add dynamic=false unless the page needs JavaScript. It cuts the cost from 5 credits to 1, whatever the MCP description says
  2. Keep request URLs out of logs, since they carry api_key
  3. Set client timeouts above 60 seconds and retry on 429 or timeout. Failures aren't billed
  4. Prefer the parsed endpoints (Google, Amazon) over scraping the raw page when one exists

Questions

Which is better for AI agents, Microlink or Scrapingdog?

Microlink scores 65.9 (B) on agent readiness against Scrapingdog's 39.3 (E), and leads in 6 of 7 scored categories. Scrapingdog leads on reliability.

Do Microlink and Scrapingdog need an API key?

Both need an API key.

Can an agent call Microlink and Scrapingdog without installing anything?

Yes. Microlink has a hosted endpoint at https://mcp.microlink.io/mcp and Scrapingdog at https://api.scrapingdog.com/scrape.

Other comparisons with Microlink or Scrapingdog

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.