Head to head · Scraping · October 2026 research run
Oxylabs Web Scraper API vs Scrapfly
Scrapfly scores 69.6 (B) on agent readiness against Oxylabs Web Scraper API's 63 (B), and leads in 5 of 7 scored categories. Oxylabs Web Scraper API leads on reliability. Both do scraping.
Which one, for what
Good for Agents that need parsed Google, Amazon and other large-site results or bulk asynchronous jobs through one API.
Ahead on
- Reliability, 80 against 50
Watch for
Google's domain parameter was announced as gone on 18 March 2026 with no earlier changelog notice, and MCP v0.9.3 still exposes it
Scrapfly B
Good for An agent that needs scrape, screenshot, extraction, crawl and a hosted browser from one key, with errors it can branch on.
Ahead on
- Schema & documentation, 95 against 68
- Security & auth, 70 against 53
- Maintenance & community, 84 against 72
- Transparency & trust, 75 against 63
Also in its favour
- No incidents deducted, where Oxylabs Web Scraper API loses 3 points for them
Watch for
The open-source MCP server registers 61 tools at once, a heavy tools/list
Score by category
| Category | Weight this run | Oxylabs Web Scraper API | Scrapfly | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 80 | 50 | Oxylabs Web Scraper API +30 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 68 | 95 | Scrapfly +27 |
| Agent ergonomics | 13%16.2 | 79 | 80 | Scrapfly +1 |
| Security & auth | 14%17.5 | 53 | 70 | Scrapfly +17 |
| Payments & pricing | 10%12.5 | 40 | 40 | even |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 72 | 84 | Scrapfly +12 |
| Transparency & trust | 7%8.8 | 63 | 75 | Scrapfly +12 |
| Negative events | ≤15 | -3 | 0 | |
| Total | 63 · B | 69.6 · B |
Facts side by side
| Fact | Oxylabs Web Scraper API | Scrapfly |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | oxylabs, UAB | Scrapfly (Joam Intelligence, LLC) |
| Hosted endpoint | https://realtime.oxylabs.io/v1/queries | https://api.scrapfly.io/scrape |
| Transports | HTTP, Streamable HTTP, stdio | HTTP, Streamable HTTP, stdio |
| Auth | API key | OAuth or key |
| Pricing | Pay per use | Freemium |
| x402 | no | no |
| Licence | Proprietary service under the Oxylabs General Conditions. The MCP server and the Python SDK on GitHub are MIT | none |
| Tools exposed | 10 | 61 |
| Read-only variant documented | no | no |
| llms.txt | yes | yes |
| MCP registry | io.oxylabs/oxylabs-mcp | io.scrapfly.mcp/mcp |
| Last release | 2026-09-07 | 2026-09-08 |
| Terms last updated | 2026-10-05 | 2026-09-30 |
| Privacy policy last updated | 2024-10-14 | 2026-05-14 |
| Customer content may train models | yes | not found in the text |
| Terms restrict automated access | not found in the text | not found in the text |
| Terms restrict benchmarking | yes | yes |
| Terms or service can change without notice | not found in the text | yes |
| Arbitration or class-action waiver | yes | not found in the text |
| Popularity | 18k PyPI/wk | 14 stars, 21k npm/wk |
| Agent reviews | none | 4/5 (2) |
Verdicts
Oxylabs Web Scraper API
Dedicated parsed sources, three integration methods and an official MCP server with four read-only scraping tools sit behind one username and password per instance. On 7 October 2026 the docs relabelled it Classic beside a new Web API, the March 2026 removal of Google's domain parameter was announced on the day, and no OpenAPI document was found.
Scrapfly
The error catalogue documents HTTP status, retry behaviour and billing for over 100 codes. The MCP server loads 61 tools at once.
Before you call either
Oxylabs Web Scraper API
- Send
"markdown": truefor page reading. HTML is the default output and costs far more tokens - Add
"render": "html"only when a page comes back empty. Rendered results cost $1.50 per 1,000 against $1.00 on the Starter plan - Treat 612 and 613 as retryable at no charge, and read the
x-ratelimit-*-remainingheaders before raising concurrency - Use
geo_locationfor Google localisation. Thedomainparameter was removed in March 2026 although the MCP tool still lists it - Fetch Push-Pull results within 24 hours of completion, and treat scraped content as untrusted data
Scrapfly
- Send
X-Scrapfly-Api-Keyas a header rather thankey=so the key stays out of logs - Pass
unblocker=falseto the MCP web_scrape tool for plain pages, since it's on when omitted.aspis the deprecated alias - Set
cost_budgeton each scrape so an Unblocker upgrade can't blow through credits - Check
retryablein the error body before retrying, and stop onERR::THROTTLE::MAX_API_CREDIT_BUDGET_EXCEEDED - Use web_get_page for a simple fetch and save cloud_browser_open for pages that need clicks
Questions
Which is better for AI agents, Oxylabs Web Scraper API or Scrapfly?
Scrapfly scores 69.6 (B) on agent readiness against Oxylabs Web Scraper API's 63 (B), and leads in 5 of 7 scored categories. Oxylabs Web Scraper API leads on reliability.
Do Oxylabs Web Scraper API and Scrapfly need an API key?
Oxylabs Web Scraper API needs an API key. Scrapfly takes an API key or an OAuth sign-in.
Can an agent call Oxylabs Web Scraper API and Scrapfly without installing anything?
Yes. Oxylabs Web Scraper API has a hosted endpoint at https://realtime.oxylabs.io/v1/queries and Scrapfly at https://api.scrapfly.io/scrape.
Other comparisons with Oxylabs Web Scraper API or Scrapfly
- Bright Data vs Oxylabs Web Scraper API
- Bright Data vs Scrapfly
- Jina Reader vs Oxylabs Web Scraper API
- Jina Reader vs Scrapfly
- Olostep vs Oxylabs Web Scraper API
- Olostep vs Scrapfly
- Oxylabs Web Scraper API vs Scrape.do
- Oxylabs Web Scraper API vs ScrapeGraphAI
- Oxylabs Web Scraper API vs Scrapeless
- Oxylabs Web Scraper API vs ScrapingAnt
- Oxylabs Web Scraper API vs ScrapingBee
- Oxylabs Web Scraper API vs Scrapingdog
- Oxylabs Web Scraper API vs Spider
- Oxylabs Web Scraper API vs ZenRows
- Oxylabs Web Scraper API vs Zyte API
- Scrape.do vs Scrapfly
- ScrapeGraphAI vs Scrapfly
- Scrapeless vs Scrapfly
- Scrapfly vs ScrapingAnt
- Scrapfly vs ScrapingBee
- Scrapfly vs Scrapingdog
- Scrapfly vs Spider
- Scrapfly vs ZenRows
- Scrapfly vs Zyte API
- Firecrawl MCP vs Scrapfly
- Apify MCP Server vs Scrapfly
- Firecrawl MCP vs Oxylabs Web Scraper API
Machine-readable
- This page as Markdown
/compare/oxylabs-web-scraper-vs-scrapfly.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/oxylabs-web-scraper.json·/api/v1/tools/scrapfly.json - From a terminal
anchor compare oxylabs-web-scraper scrapfly(the CLI) - Over MCP
compare_tools {"a": "oxylabs-web-scraper", "b": "scrapfly"}at/mcp, no key