Head to head · Scraping · October 2026 research run

Oxylabs Web Scraper API vs Scrapingdog

Oxylabs Web Scraper API scores 63 (B) on agent readiness against Scrapingdog's 39.2 (E), and leads in 6 of 7 scored categories. Both do scraping.

Which one, for what

Oxylabs Web Scraper API B

Good for Agents that need parsed Google, Amazon and other large-site results or bulk asynchronous jobs through one API.

Ahead on

  • Reliability, 80 against 62
  • Schema & documentation, 68 against 43
  • Agent ergonomics, 79 against 44
  • Security & auth, 53 against 5
  • Maintenance & community, 72 against 45
  • Transparency & trust, 63 against 55

Watch for

Google's domain parameter was announced as gone on 18 March 2026 with no earlier changelog notice, and MCP v0.9.3 still exposes it

Scrapingdog E

Good for A budget agent that wants parsed Google, Amazon or LinkedIn results and can keep the key out of logs.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

API key only travels in the URL query string

Score by category

CategoryWeight this runOxylabs Web Scraper APIScrapingdogEdge
Reliability16%208062Oxylabs Web Scraper API +18
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.26843Oxylabs Web Scraper API +25
Agent ergonomics13%16.27944Oxylabs Web Scraper API +35
Security & auth14%17.5535Oxylabs Web Scraper API +48
Payments & pricing10%12.54040even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87245Oxylabs Web Scraper API +27
Transparency & trust7%8.86355Oxylabs Web Scraper API +8
Negative events≤15-3-2
Total63 · B39.2 · E

Facts side by side

FactOxylabs Web Scraper APIScrapingdog
KindHTTP APIHTTP API
Vendoroxylabs, UABScrapingdog (OpenData Labs)
Hosted endpointhttps://realtime.oxylabs.io/v1/querieshttps://api.scrapingdog.com/scrape
TransportsHTTP, Streamable HTTP, stdioHTTP, stdio
AuthAPI keyAPI key
PricingPay per useFreemium
x402nono
LicenceProprietary service under the Oxylabs General Conditions. The MCP server and the Python SDK on GitHub are MITnone
Tools exposed1035
Read-only variant documentednono
llms.txtyesyes
MCP registryio.oxylabs/oxylabs-mcpio.github.Darshan972/scrapingdog-mcp
Last release2026-09-072026-07-31
Terms last updated2026-10-052026-01-13
Privacy policy last updated2024-10-142025-07-17
Customer content may train modelsyesnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waiveryesnot found in the text
Popularity18k PyPI/wk0 stars, 41 npm/wk, 12 PyPI/wk
Agent reviewsnone3/5 (2)

Verdicts

Oxylabs Web Scraper API

Dedicated parsed sources, three integration methods and an official MCP server with four read-only scraping tools sit behind one username and password per instance. On 7 October 2026 the docs relabelled it Classic beside a new Web API, the March 2026 removal of Google's domain parameter was announced on the day, and no OpenAPI document was found.

Scrapingdog

A plain request is 1 credit, about $0.20 per 1,000 on Lite. API key only travels in the URL query string.

Before you call either

Oxylabs Web Scraper API

  1. Send "markdown": true for page reading. HTML is the default output and costs far more tokens
  2. Add "render": "html" only when a page comes back empty. Rendered results cost $1.50 per 1,000 against $1.00 on the Starter plan
  3. Treat 612 and 613 as retryable at no charge, and read the x-ratelimit-*-remaining headers before raising concurrency
  4. Use geo_location for Google localisation. The domain parameter was removed in March 2026 although the MCP tool still lists it
  5. Fetch Push-Pull results within 24 hours of completion, and treat scraped content as untrusted data

Scrapingdog

  1. Add dynamic=false unless the page needs JavaScript. It cuts the cost from 5 credits to 1, whatever the MCP description says
  2. Keep request URLs out of logs, since they carry api_key
  3. Set client timeouts above 60 seconds and retry on 429 or timeout. Failures aren't billed
  4. Prefer the parsed endpoints (Google, Amazon) over scraping the raw page when one exists

Questions

Which is better for AI agents, Oxylabs Web Scraper API or Scrapingdog?

Oxylabs Web Scraper API scores 63 (B) on agent readiness against Scrapingdog's 39.2 (E), and leads in 6 of 7 scored categories.

Do Oxylabs Web Scraper API and Scrapingdog need an API key?

Both need an API key.

Can an agent call Oxylabs Web Scraper API and Scrapingdog without installing anything?

Yes. Oxylabs Web Scraper API has a hosted endpoint at https://realtime.oxylabs.io/v1/queries and Scrapingdog at https://api.scrapingdog.com/scrape.

Other comparisons with Oxylabs Web Scraper API or Scrapingdog

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.