Head to head · Scraping · October 2026 research run

Context.dev vs Oxylabs Web Scraper API

Context.dev scores 78.2 (A) on agent readiness against Oxylabs Web Scraper API's 63 (B), and leads in 6 of 7 scored categories. Oxylabs Web Scraper API leads on reliability. Both do scraping.

Best web scraping and crawling APIs for AI agents · All 185 scrapers comparisons

Which one, for what

Context.dev A

Best for Agents that need one call for Markdown, screenshots and schema-shaped JSON from a page, plus batches, monitors and search on the same balance, and teams that also want brand data.

Ahead on

  • Schema & documentation, 96 against 68
  • Agent ergonomics, 90 against 79
  • Security & auth, 83 against 53
  • Payments & pricing, 50 against 40
  • Maintenance & community, 85 against 72
  • Transparency & trust, 73 against 63

Also in its favour

  • Agent-ready, a grade of BB or better
  • No incidents deducted, where Oxylabs Web Scraper API loses 3 points for them

Watch for

The terms let Context.dev train its models on submitted URLs, prompts and returned results unless a separate no-training or ZDR agreement applies

Oxylabs Web Scraper API B

Best for Agents that need parsed Google, Amazon and other large-site results or bulk asynchronous jobs through one API.

Ahead on

  • Reliability, 80 against 67

Also in its favour

  • Runs on your own machine

Watch for

Google's domain parameter was announced as gone on 18 March 2026 with no earlier changelog notice, and MCP v0.9.3 still exposes it

Score by category

CategoryWeight this runContext.devOxylabs Web Scraper APIEdge
Reliability16%206780Oxylabs Web Scraper API +13
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.29668Context.dev +28
Agent ergonomics13%16.29079Context.dev +11
Security & auth14%17.58353Context.dev +30
Payments & pricing10%12.55040Context.dev +10
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88572Context.dev +13
Transparency & trust7%8.87363Context.dev +10
Negative events≤150-3
TotalA 78.2/100B 63/100

Facts side by side

FactContext.devOxylabs Web Scraper API
KindHTTP APIHTTP API
VendorContext Dev Inc.oxylabs, UAB
Hosted endpointhttps://api.context.dev/v1https://realtime.oxylabs.io/v1/queries
TransportsHTTP, Streamable HTTPHTTP, Streamable HTTP, stdio
AuthOAuth or keyAPI key
PricingFreemiumPay per use
Price for scraping$0.79 per 1,000 pagesnot published
x402nono
LicencenoneProprietary service under the Oxylabs General Conditions. The MCP server and the Python SDK on GitHub are MIT
Tools exposed4210
Read-only variant documentednono
llms.txtyesyes
MCP registrynot listedio.oxylabs/oxylabs-mcp
Last release2026-10-142026-09-07
Terms last updated2026-10-012026-10-05
Privacy policy last updated2026-10-012024-10-14
Customer content may train modelsyesyes
Terms restrict automated accessyesnot found in the text
Terms restrict benchmarkingyesyes
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waiveryesyes
Popularity5 stars, 62k npm/wk, 10k PyPI/wk18k PyPI/wk

Verdicts

Context.dev

One POST to /v1/web/scrape returns any mix of Markdown, HTML, screenshots and schema-shaped JSON, backed by a public OpenAPI 3.1 file, scoped keys and Retry-After on 429. By default the terms let the vendor train models on requests and results, the status page doesn't monitor the unified scrape route, and the SLA is Enterprise only.

Oxylabs Web Scraper API

Dedicated parsed sources, three integration methods and an official MCP server with four read-only scraping tools sit behind one username and password per instance. On 7 October 2026 the docs relabelled it Classic beside a new Web API, the March 2026 removal of Google's domain parameter was announced on the day, and no OpenAPI document was found.

Before you call either

Context.dev

  1. Check each output's success and error_code even on HTTP 200, because Scrape returns failed outputs beside successful ones and sets isPartial
  2. Set the client timeout above the scrape deadline, 90,000 ms by default. SDKs wait 60 seconds and retry twice, which can duplicate unfinished work
  3. Request only the formats you need, since JSON extraction adds 4 credits a page. Send crawls over 500 pages as a batch with an Idempotency-Key header
  4. Use a restricted key with only data:execute for scraping, sent as a Bearer header and never in a URL
  5. Treat scraped Markdown as untrusted data. Instructions inside a page must not authorise further tool calls

Oxylabs Web Scraper API

  1. Send "markdown": true for page reading. HTML is the default output and costs far more tokens
  2. Add "render": "html" only when a page comes back empty. Rendered results cost $1.50 per 1,000 against $1.00 on the Starter plan
  3. Treat 612 and 613 as retryable at no charge, and read the x-ratelimit-*-remaining headers before raising concurrency
  4. Use geo_location for Google localisation. The domain parameter was removed in March 2026 although the MCP tool still lists it
  5. Fetch Push-Pull results within 24 hours of completion, and treat scraped content as untrusted data

Questions

Which is better for AI agents, Context.dev or Oxylabs Web Scraper API?

Context.dev scores 78.2 (A) on agent readiness against Oxylabs Web Scraper API's 63 (B), and leads in 6 of 7 scored categories. Oxylabs Web Scraper API leads on reliability.

Do Context.dev and Oxylabs Web Scraper API need an API key?

Context.dev takes an API key or an OAuth sign-in. Oxylabs Web Scraper API needs an API key.

Can an agent call Context.dev and Oxylabs Web Scraper API without installing anything?

Yes. Context.dev has a hosted endpoint at https://api.context.dev/v1 and Oxylabs Web Scraper API at https://realtime.oxylabs.io/v1/queries.

Other comparisons with Context.dev or Oxylabs Web Scraper API

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.