# Web scraping and crawling APIs for AI agents (slim)

> 14 web scraping & crawling listings ranked by the Anchor benchmark. Leader Apify MCP Server (A). Hosted APIs that fetch a page for you, render JavaScript and get past anti-bot checks through rotating proxies, then hand back HTML, Markdown or structured JSON. Also page-to-Markdown readers, crawlers and scraper marketplaces. Compared on price per successful request, success rate on protected sites and what the terms let you do with the output.

- Full: https://www.anchorterminal.com/categories/web-scrapers.md (~4,750 tokens) · this version ~680 tokens · JSON https://www.anchorterminal.com/categories/web-scrapers.json · canonical https://www.anchorterminal.com/categories/web-scrapers
- Index: https://www.anchorterminal.com/llms.txt · API: https://www.anchorterminal.com/api/v1/index.json · Updated: 2026-10-04

- Tools: 14 · agent-ready (BB+): 4 · accept x402: 5 · JSON: https://www.anchorterminal.com/api/v1/tools.json · by capability: https://www.anchorterminal.com/api/v1/capabilities.json
- Capabilities: web.scrape, web.extract, web.crawl, scraping.proxies, scraping.js-render, scraping.anti-bot, scraping.actors

| # | Tool | Grade | Score | Confidence | x402 | Auth | Where | Slim |
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 11 | Apify MCP Server | A | 78.6 | medium | yes | OAuth or key | hosted + local | https://www.anchorterminal.com/tools/apify-mcp.min.md |
| 34 | Firecrawl MCP | BB | 75.5 | high | no | OAuth or key | hosted + local | https://www.anchorterminal.com/tools/firecrawl-mcp.min.md |
| 43 | ZenRows | BB | 75.1 | medium | payer | OAuth or key | hosted + local | https://www.anchorterminal.com/tools/zenrows.min.md |
| 49 | Spider | BB | 74.3 | medium | yes | OAuth or key | hosted + local | https://www.anchorterminal.com/tools/spider-cloud.min.md |
| 107 | Scrapfly | B | 69.8 | medium | no | OAuth or key | hosted + local | https://www.anchorterminal.com/tools/scrapfly.min.md |
| 128 | ScrapeGraphAI | B | 68.3 | medium | payer | OAuth or key | hosted | https://www.anchorterminal.com/tools/scrapegraphai.min.md |
| 210 | Olostep | B | 63.1 | medium | payer | API key | hosted + local | https://www.anchorterminal.com/tools/olostep.min.md |
| 254 | Bright Data | C | 60.1 | medium | no | OAuth or key | hosted | https://www.anchorterminal.com/tools/bright-data.min.md |
| 268 | ScrapingBee | C | 59.3 | medium | no | API key | hosted | https://www.anchorterminal.com/tools/scrapingbee.min.md |
| 326 | Scrapeless | C | 54.3 | medium | no | API key | hosted + local | https://www.anchorterminal.com/tools/scrapeless.min.md |
| 402 | Jina Reader | E | 45.3 | medium | no | OAuth or key | hosted | https://www.anchorterminal.com/tools/jina-reader.min.md |
| 406 | Scrape.do | E | 44 | medium | no | API key | hosted | https://www.anchorterminal.com/tools/scrape-do.min.md |
| 425 | Scrapingdog | E | 39.3 | medium | no | API key | hosted + local | https://www.anchorterminal.com/tools/scrapingdog.min.md |
| 440 | ScrapingAnt | F | 35.9 | medium | no | API key | hosted | https://www.anchorterminal.com/tools/scrapingant.min.md |