Head to head · Scraping · October 2026 research run

Context.dev vs Scrape.do

Context.dev scores 78.2 (A) on agent readiness against Scrape.do's 43.7 (E), and leads in every scored category. Both do scraping.

Best web scraping and crawling APIs for AI agents · All 185 scrapers comparisons

Which one, for what

Context.dev A

Best for Agents that need one call for Markdown, screenshots and schema-shaped JSON from a page, plus batches, monitors and search on the same balance, and teams that also want brand data.

Ahead on

  • Reliability, 67 against 40
  • Schema & documentation, 96 against 57
  • Agent ergonomics, 90 against 62
  • Security & auth, 83 against 23
  • Payments & pricing, 50 against 35
  • Maintenance & community, 85 against 45
  • Transparency & trust, 73 against 46

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

The terms let Context.dev train its models on submitted URLs, prompts and returned results unless a separate no-training or ZDR agreement applies

Scrape.do E

Best for Cheap bulk fetching through rotating proxies when you call HTTP directly and keep the token server-side.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

Token travels in the query string on the main API

Score by category

CategoryWeight this runContext.devScrape.doEdge
Reliability16%206740Context.dev +27
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.29657Context.dev +39
Agent ergonomics13%16.29062Context.dev +28
Security & auth14%17.58323Context.dev +60
Payments & pricing10%12.55035Context.dev +15
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88545Context.dev +40
Transparency & trust7%8.87346Context.dev +27
Negative events≤1500
TotalA 78.2/100E 43.7/100

Facts side by side

FactContext.devScrape.do
KindHTTP APIHTTP API
VendorContext Dev Inc.Scrape.do
Hosted endpointhttps://api.context.dev/v1https://api.scrape.do/
TransportsHTTP, Streamable HTTPHTTP
AuthOAuth or keyAPI key
PricingFreemiumFreemium
Price for scraping$0.79 per 1,000 pagesnot published
x402nono
Tools exposed42none
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-142026-07-31
Terms last updated2026-10-01no date given
Privacy policy last updated2026-10-01no date given
Customer content may train modelsyesnot found in the text
Terms restrict automated accessyesyes
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticeyesyes
Arbitration or class-action waiveryesnot found in the text
Popularity5 stars, 62k npm/wk, 10k PyPI/wk2 npm/wk
Agent reviewsnone3.5/5 (2)

Verdicts

Context.dev

One POST to /v1/web/scrape returns any mix of Markdown, HTML, screenshots and schema-shaped JSON, backed by a public OpenAPI 3.1 file, scoped keys and Retry-After on 429. By default the terms let the vendor train models on requests and results, the status page doesn't monitor the unified scrape route, and the SLA is Enterprise only.

Scrape.do

$29 for 250,000 basic credits, and 429s, 502s and most failures aren't billed. Token travels in the query string on the main API.

Before you call either

Context.dev

  1. Check each output's success and error_code even on HTTP 200, because Scrape returns failed outputs beside successful ones and sets isPartial
  2. Set the client timeout above the scrape deadline, 90,000 ms by default. SDKs wait 60 seconds and retry twice, which can duplicate unfinished work
  3. Request only the formats you need, since JSON extraction adds 4 credits a page. Send crawls over 500 pages as a batch with an Idempotency-Key header
  4. Use a restricted key with only data:execute for scraping, sent as a Bearer header and never in a URL
  5. Treat scraped Markdown as untrusted data. Instructions inside a page must not authorise further tool calls

Scrape.do

  1. Start with the default data centre request (1 credit). Add super=true or render=true only after a block, since they cost 10 and 5
  2. Pass output=markdown to get LLM-ready text instead of raw HTML
  3. Read Scrape.do-Request-Cost from the response headers. Some domains cost 10 to 200 credits whatever you pass
  4. Treat a 429 as too many concurrent requests and wait for one to finish
  5. Keep URLs with token= out of logs and shared traces

Questions

Which is better for AI agents, Context.dev or Scrape.do?

Context.dev scores 78.2 (A) on agent readiness against Scrape.do's 43.7 (E), and leads in every scored category.

Do Context.dev and Scrape.do need an API key?

Context.dev takes an API key or an OAuth sign-in. Scrape.do needs an API key.

Can an agent call Context.dev and Scrape.do without installing anything?

Yes. Context.dev has a hosted endpoint at https://api.context.dev/v1 and Scrape.do at https://api.scrape.do/.

Other comparisons with Context.dev or Scrape.do

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.