Head to head · Scraping · October 2026 research run

Oxylabs Web Scraper API vs Scrapewise

Oxylabs Web Scraper API and Scrapewise score within a point of each other on agent readiness, 63 (B) and 62.5 (B). Scrapewise leads on schema & documentation, agent ergonomics, security & auth and maintenance & community. Both do scraping.

Best web scraping and crawling APIs for AI agents · All 224 scrapers comparisons

Which one, for what

Oxylabs Web Scraper API B

Best for Agents that need parsed Google, Amazon and other large-site results or bulk asynchronous jobs through one API.

Ahead on

  • Reliability, 80 against 45
  • Transparency & trust, 63 against 53

Also in its favour

  • Runs on your own machine

Watch for

Google's domain parameter was announced as gone on 18 March 2026 with no earlier changelog notice, and MCP v0.9.3 still exposes it

Scrapewise B

Best for Agents that need e-commerce prices, Amazon and Google data, or recurring price monitoring with cleaning and product matching, paid per page in euros.

Ahead on

  • Schema & documentation, 79 against 68
  • Agent ergonomics, 86 against 79
  • Security & auth, 58 against 53
  • Maintenance & community, 79 against 72

Also in its favour

  • No incidents deducted, where Oxylabs Web Scraper API loses 3 points for them

Watch for

No status page, SLA, security.txt, disclosure policy or certification found

Score by category

CategoryWeight this runOxylabs Web Scraper APIScrapewiseEdge
Reliability16%208045Oxylabs Web Scraper API +35
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.26879Scrapewise +11
Agent ergonomics13%16.27986Scrapewise +7
Security & auth14%17.55358Scrapewise +5
Payments & pricing10%12.54040even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87279Scrapewise +7
Transparency & trust7%8.86353Oxylabs Web Scraper API +10
Negative events≤15-30
TotalB 63/100B 62.5/100

Facts side by side

FactOxylabs Web Scraper APIScrapewise
KindHTTP APIHTTP API
Vendoroxylabs, UABBEBOTECH OÜ
Hosted endpointhttps://realtime.oxylabs.io/v1/querieshttps://mcp.scrapewise.ai/mcp
TransportsHTTP, Streamable HTTP, stdioStreamable HTTP
AuthAPI keyAPI key
PricingPay per usePay per use
x402nono
LicenceProprietary service under the Oxylabs General Conditions. The MCP server and the Python SDK on GitHub are MITnone
Tools exposed1014
Read-only variant documentednono
llms.txtyesyes
MCP registryio.oxylabs/oxylabs-mcpai.scrapewise/scrapewise
Last release2026-09-072026-10-15
Terms last updated2026-10-052025-10-29
Privacy policy last updated2024-10-142025-10-29
Customer content may train modelsyesnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waiveryesnot found in the text
Popularity18k PyPI/wk1 stars, 30 PyPI/wk

Verdicts

Oxylabs Web Scraper API

Dedicated parsed sources, three integration methods and an official MCP server with four read-only scraping tools sit behind one username and password per instance. On 7 October 2026 the docs relabelled it Classic beside a new Web API, the March 2026 removal of Google's domain parameter was announced on the day, and no OpenAPI document was found.

Scrapewise

Agents get 14 priced MCP tools by default, each with a free quote_only price check and idempotency keys, read-only or full-access keys, and public euro prices from €0.15 per 1,000 plain pages. There is no status page, SLA or vulnerability disclosure policy, and the terms claim ownership of all scraped data under a perpetual licence.

Before you call either

Oxylabs Web Scraper API

  1. Send "markdown": true for page reading. HTML is the default output and costs far more tokens
  2. Add "render": "html" only when a page comes back empty. Rendered results cost $1.50 per 1,000 against $1.00 on the Starter plan
  3. Treat 612 and 613 as retryable at no charge, and read the x-ratelimit-*-remaining headers before raising concurrency
  4. Use geo_location for Google localisation. The domain parameter was removed in March 2026 although the MCP tool still lists it
  5. Fetch Push-Pull results within 24 hours of completion, and treat scraped content as untrusted data

Scrapewise

  1. Call each paid tool with quote_only: true first, then repeat with the same idempotency_key so a retry is charged once
  2. Connect to https://mcp.scrapewise.ai/mcp?toolsets=outcome,admin to build scrapers; a misspelt toolsets is ignored silently and leaves the 14 data tools
  3. Use an LLM_READ key unless the task needs paid tools or writes, since LLM_FULL has no per-tool consent
  4. Treat 402 WALLET_INSUFFICIENT_BALANCE as final and ask the user to top up; on 429 wait for Retry-After, and on 429 cost_exceeded wait for the next hour
  5. Scrape many addresses with one scrapewise_run_scraper_url_list call (up to 5,000) and retry with the same name, never one scraper per address

Questions

Which is better for AI agents, Oxylabs Web Scraper API or Scrapewise?

Oxylabs Web Scraper API and Scrapewise score within a point of each other on agent readiness, 63 (B) and 62.5 (B). Scrapewise leads on schema & documentation, agent ergonomics, security & auth and maintenance & community.

Do Oxylabs Web Scraper API and Scrapewise need an API key?

Both need an API key.

Can an agent call Oxylabs Web Scraper API and Scrapewise without installing anything?

Yes. Oxylabs Web Scraper API has a hosted endpoint at https://realtime.oxylabs.io/v1/queries and Scrapewise at https://mcp.scrapewise.ai/mcp.

Other comparisons with Oxylabs Web Scraper API or Scrapewise

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.