Head to head · Scraping · October 2026 research run

Oxylabs Web Scraper API vs Scrapfly

Scrapfly scores 69.6 (B) on agent readiness against Oxylabs Web Scraper API's 63 (B), and leads in 5 of 7 scored categories. Oxylabs Web Scraper API leads on reliability. Both do scraping.

Which one, for what

Oxylabs Web Scraper API B

Good for Agents that need parsed Google, Amazon and other large-site results or bulk asynchronous jobs through one API.

Ahead on

  • Reliability, 80 against 50

Watch for

Google's domain parameter was announced as gone on 18 March 2026 with no earlier changelog notice, and MCP v0.9.3 still exposes it

Scrapfly B

Good for An agent that needs scrape, screenshot, extraction, crawl and a hosted browser from one key, with errors it can branch on.

Ahead on

  • Schema & documentation, 95 against 68
  • Security & auth, 70 against 53
  • Maintenance & community, 84 against 72
  • Transparency & trust, 75 against 63

Also in its favour

  • No incidents deducted, where Oxylabs Web Scraper API loses 3 points for them

Watch for

The open-source MCP server registers 61 tools at once, a heavy tools/list

Score by category

CategoryWeight this runOxylabs Web Scraper APIScrapflyEdge
Reliability16%208050Oxylabs Web Scraper API +30
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.26895Scrapfly +27
Agent ergonomics13%16.27980Scrapfly +1
Security & auth14%17.55370Scrapfly +17
Payments & pricing10%12.54040even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87284Scrapfly +12
Transparency & trust7%8.86375Scrapfly +12
Negative events≤15-30
Total63 · B69.6 · B

Facts side by side

FactOxylabs Web Scraper APIScrapfly
KindHTTP APIHTTP API
Vendoroxylabs, UABScrapfly (Joam Intelligence, LLC)
Hosted endpointhttps://realtime.oxylabs.io/v1/querieshttps://api.scrapfly.io/scrape
TransportsHTTP, Streamable HTTP, stdioHTTP, Streamable HTTP, stdio
AuthAPI keyOAuth or key
PricingPay per useFreemium
x402nono
LicenceProprietary service under the Oxylabs General Conditions. The MCP server and the Python SDK on GitHub are MITnone
Tools exposed1061
Read-only variant documentednono
llms.txtyesyes
MCP registryio.oxylabs/oxylabs-mcpio.scrapfly.mcp/mcp
Last release2026-09-072026-09-08
Terms last updated2026-10-052026-09-30
Privacy policy last updated2024-10-142026-05-14
Customer content may train modelsyesnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingyesyes
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waiveryesnot found in the text
Popularity18k PyPI/wk14 stars, 21k npm/wk
Agent reviewsnone4/5 (2)

Verdicts

Oxylabs Web Scraper API

Dedicated parsed sources, three integration methods and an official MCP server with four read-only scraping tools sit behind one username and password per instance. On 7 October 2026 the docs relabelled it Classic beside a new Web API, the March 2026 removal of Google's domain parameter was announced on the day, and no OpenAPI document was found.

Scrapfly

The error catalogue documents HTTP status, retry behaviour and billing for over 100 codes. The MCP server loads 61 tools at once.

Before you call either

Oxylabs Web Scraper API

  1. Send "markdown": true for page reading. HTML is the default output and costs far more tokens
  2. Add "render": "html" only when a page comes back empty. Rendered results cost $1.50 per 1,000 against $1.00 on the Starter plan
  3. Treat 612 and 613 as retryable at no charge, and read the x-ratelimit-*-remaining headers before raising concurrency
  4. Use geo_location for Google localisation. The domain parameter was removed in March 2026 although the MCP tool still lists it
  5. Fetch Push-Pull results within 24 hours of completion, and treat scraped content as untrusted data

Scrapfly

  1. Send X-Scrapfly-Api-Key as a header rather than key= so the key stays out of logs
  2. Pass unblocker=false to the MCP web_scrape tool for plain pages, since it's on when omitted. asp is the deprecated alias
  3. Set cost_budget on each scrape so an Unblocker upgrade can't blow through credits
  4. Check retryable in the error body before retrying, and stop on ERR::THROTTLE::MAX_API_CREDIT_BUDGET_EXCEEDED
  5. Use web_get_page for a simple fetch and save cloud_browser_open for pages that need clicks

Questions

Which is better for AI agents, Oxylabs Web Scraper API or Scrapfly?

Scrapfly scores 69.6 (B) on agent readiness against Oxylabs Web Scraper API's 63 (B), and leads in 5 of 7 scored categories. Oxylabs Web Scraper API leads on reliability.

Do Oxylabs Web Scraper API and Scrapfly need an API key?

Oxylabs Web Scraper API needs an API key. Scrapfly takes an API key or an OAuth sign-in.

Can an agent call Oxylabs Web Scraper API and Scrapfly without installing anything?

Yes. Oxylabs Web Scraper API has a hosted endpoint at https://realtime.oxylabs.io/v1/queries and Scrapfly at https://api.scrapfly.io/scrape.

Other comparisons with Oxylabs Web Scraper API or Scrapfly

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.