Category · Web, data & documents
Web scraping and crawling APIs for AI agents
Hosted APIs that fetch a page for you, render JavaScript and get past anti-bot checks through rotating proxies, then hand back HTML, Markdown or structured JSON. Also page-to-Markdown readers, crawlers and scraper marketplaces. Compared on price per successful request, success rate on protected sites and what the terms let you do with the output.
Capability keys web.scrape · web.extract · web.crawl · scraping.proxies · scraping.js-render · scraping.anti-bot · scraping.actors · All tools
letme.dev/web.scrape picks the top-graded tool in this list and says how to call it direct; calling through letme comes later.
The same listing from the live API. Graded results come first, then the official MCP registry when no graded-only filter is set.
https://www.anchorterminal.com/api/v1/searchFilters
| Compare | # | Tool | Category | Grade | Score | Agent rating | p95 | Context | Price / x402 | Auth | Where | Details |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 11 | Apify MCP ServerApify · MCP server | Scrapers | A | 78.6 | 3.4 (8) | n/a | n/a | $1 / call x402 | OAuth or key | Hosted + local | ||
|
Exposes thousands of Apify Store Actors (scrapers, crawlers, automations) as dynamically discovered MCP tools, hosted at mcp.apify.com or run locally; supports OAuth, API tokens and agentic payments (x402 prepaid tokens, Skyfire). Top strength x402 on Apify's own domains, a prepaid token from agi.apify.com for any Actor and per-run payment on mcp.apify.com for Pay Per Event Actors Top weakness API and Actor runs timed out for about 12 hours on 21 and 22 July 2026 |
||||||||||||
| 34 | Firecrawl MCPFirecrawl (Mendable) · MCP server | Scrapers | BB | 75.5 | 3.5 (8) | n/a | n/a | $19 / mo | OAuth or key | Hosted + local | ||
|
Official Firecrawl server for scraping pages to markdown/JSON, mapping and crawling sites, web search, browser interaction, monitoring and an autonomous research agent. Top strength Keyless hosted endpoint with scrape, search and parse, plus OAuth and a search-only endpoint Top weakness No x402 or other machine payment |
||||||||||||
| 43 | ZenRowsZenRows · HTTP API | Scrapers | BB | 75.1 | 3.8 (8) | n/a | n/a | $19 / mo | OAuth or key | Hosted + local | ||
|
Scraping API (Fetch, formerly Universal Scraper API) with JavaScript rendering, residential proxies and anti-bot bypass, plus Extract for structured JSON, Batch for bulk URL jobs and hosted Browser Sessions. Top strength No incidents from July to 1 October 2026 on a six-component Better Stack status page Top weakness The Fetch API only takes the key in the query string |
||||||||||||
| 49 | SpiderSpider (BAGELMEN LLC) · HTTP API | Scrapers | BB | 74.3 | 3.3 (8) | n/a | n/a | $0.0005 / call x402 | OAuth or key | Hosted + local | ||
|
Hosted crawl, scrape, search, links and screenshot API built on the open-source Rust spider crate, plus a cloud browser and proxy pool. Top strength Keyless /scrape and working x402 v2 on every core route, so an agent needs no account Top weakness Operated by BAGELMEN LLC with no address, retention periods or DPA in the privacy policy |
||||||||||||
| 107 | ScrapflyScrapfly (Joam Intelligence, LLC) · HTTP API | Scrapers | B | 69.8 | 4.0 (2) | n/a | n/a | $30 / mo | OAuth or key | Hosted + local | ||
|
Scrape API with datacenter or residential proxies, JS rendering and an anti-bot Unblocker, plus screenshot, LLM extraction, crawler and hosted Cloud Browser APIs on one credit balance. Top strength Error catalogue of 100+ ERR:: codes, each with HTTP status, retryable and billed flags and a doc link Top weakness The open-source MCP server registers 61 tools at once, a heavy tools/list |
||||||||||||
| 128 | ScrapeGraphAIScrapeGraphAI · HTTP API | Scrapers | B | 68.3 | 3.0 (2) | n/a | n/a | $20 / mo | OAuth or key | Hosted | ||
|
LLM-oriented scraping API with page-to-markdown scrape, prompt-based JSON extraction, search, async crawl and change monitors. Top strength An agent can mint an account and key over x402 or MPP with no signup Top weakness Rate limits and plan prices differ between docs pages |
||||||||||||
| 210 | OlostepOlostep Technologies, Inc. · HTTP API | Scrapers | B | 63.1 | 3.5 (2) | n/a | n/a | $9 / mo | API key | Hosted + local | ||
|
Scrape, crawl, map, batch and search API that returns markdown, HTML, JSON or screenshots, with JS rendering and residential IPs on every request. Top strength OpenAPI 3.0.3 for every endpoint and a structured error body Top weakness The x402 challenge came back with no payment requirements in our probe |
||||||||||||
| 254 | Bright DataBright Data · HTTP API | Scrapers | C | 60.1 | 4.0 (2) | n/a | n/a | $1.50 / 1k req | OAuth or key | Hosted | ||
|
Web Unlocker, SERP API, a hosted Browser API and residential proxies, with an official MCP server wrapping them. Top strength Pay only for successful requests, $1.50 per 1,000 on Web Unlocker and SERP Top weakness No public status page or incident history |
||||||||||||
| 268 | ScrapingBeeScrapingBee (Oxylabs group) · HTTP API | Scrapers | C | 59.3 | 4.0 (2) | n/a | n/a | $19 / mo | API key | Hosted | ||
|
HTML API that fetches a URL through rotating, premium or stealth proxies with headless rendering, JavaScript scenarios, screenshots and CSS or AI extraction. Top strength Dedicated Google, Amazon, Walmart, YouTube, ChatGPT and Gemini endpoints next to the general HTML API Top weakness remote-mcp.txt says the hosted MCP only takes the key as ?api_key= in its URL |
||||||||||||
| 326 | ScrapelessScrapeless (NST Labs Tech) · HTTP API | Scrapers | C | 54.3 | 2.0 (2) | n/a | n/a | $49 / mo | API key | Hosted + local | ||
|
Web Unlocker, a hosted cloud browser over CDP, a crawl API, Google and Amazon scraping APIs, AI answer-engine scrapers and residential proxies under one key. Top strength Hosted streamable HTTP MCP at api.scrapeless.com/mcp with header auth, plus a stdio package, both in the official MCP registry Top weakness llms.txt quotes Deep SerpApi at $0.1 per 1,000 while the plan data charges $1 per 1,000 for Google Search |
||||||||||||
| 402 | Jina ReaderJina AI (Elastic) · HTTP API | Scrapers | E | 45.3 | 2.5 (2) | n/a | n/a | Pay per use | OAuth or key | Hosted | ||
|
API that converts web pages and search results to Markdown for agents and applications. Top strength One URL prefix, no key needed, Markdown back Top weakness No price per token in any currency on the public page |
||||||||||||
| 406 | Scrape.doScrape.do · HTTP API | Scrapers | E | 44 | 3.5 (2) | n/a | n/a | $29 / mo | API key | Hosted | ||
|
Single GET endpoint that fetches a URL through rotating datacenter, residential or mobile proxies, with optional headless rendering, screenshots, markdown output and a proxy mode. Top strength $29 for 250,000 basic credits, and 429s, 502s and most failures aren't billed Top weakness Token travels in the query string on the main API |
||||||||||||
| 425 | ScrapingdogScrapingdog (OpenData Labs) · HTTP API | Scrapers | E | 39.3 | 3.0 (2) | n/a | n/a | $40 / mo | API key | Hosted + local | ||
|
Web scraping API billed by credits. Top strength A plain request is 1 credit, about $0.20 per 1,000 on Lite Top weakness API key only travels in the URL query string |
||||||||||||
| 440 | ScrapingAntScrapingAnt (DATAANT) · HTTP API | Scrapers | F | 35.9 | 3.5 (2) | n/a | n/a | $19 / mo | API key | Hosted | ||
|
Scraping API that runs each request in headless Chrome behind rotating datacenter or residential proxies, with markdown and AI extraction endpoints, a 3-tool hosted MCP server and standalone proxies billed by the GB. Top strength 10,000 free credits a month with no card Top weakness API Basics puts the key in the query string, so it lands in logs |
||||||||||||
Nothing matches these filters. .
p95 latency and context cost come from our probes, which haven't run yet, so those columns start hidden. Grades run from AA to F, and agent-ready means BB or better. Filters, sorting and export run in your browser; the table is complete without JavaScript.
Indexed, not reviewed (22)
Listings sorted into this category from public catalogues (the official MCP registry, APIs.guru, the x402 Bazaar and OpenRouter), with facts and our own checks but no score, grade or rank. How the index works.
| Listing | Kind | What it does | Why it's here |
|---|---|---|---|
| alterlab.io MCP server alterlab.io | MCP server | Web scraping MCP server — scrape, extract structured data, screenshot any site with anti-bot bypass. | vendor's own |
| Anakin anakin.io | MCP server | Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation | vendor's own |
| Apollo Intelligence apolloai.team | MCP server | 36 tools: intel feeds, DeFi, crypto, OSINT, NLP, scraping, proxy. x402 micropayments. | vendor's own |
| CrawlConsole crawlconsole.com | MCP server | Backlink Analysis MCP for AI Agents: authority, referring domains, and competitor link gaps. | vendor's own |
| Crawlie crawlie.app | MCP server | Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs. | vendor's own |
| crawlio-browser crawlio.app | MCP server | Bridge a live Chrome browser to your agent: 150 tools for capture, extraction, and observation. | vendor's own |
| geekflare.com MCP server geekflare.com | MCP server | Geekflare MCP server for scraping, search, screenshots, broken links, DNS lookup, and network tools. | vendor's own |
| Glasser glasser.ai | MCP server | One key to 1,000+ paid data APIs: enrichment, SEO/SERP, scraping, places, news. Pay per call. | vendor's own |
| glim.sh glim.sh | MCP server | Give your agent live data from Twitter, Reddit, the web and GitHub. No API keys, no scraping stack. | vendor's own |
| Google Maps Scraper gmapsextractor.com | MCP server | Live Google Maps business search, review, and photo data for AI agents over MCP. | vendor's own |
| IDLE Protocol earnidle.com | MCP server | Web scraping, inference, DNS, monitoring from residential IPs — pay per request in USDC | vendor's own |
| Litescrape litescrape.com | MCP server | Google, Bing, DuckDuckGo and Google Maps search results, free without an API key. | vendor's own |
| mcp-gera-jobs gera.services | MCP server | Search global job categories, real crawled salary benchmarks and country job markets. No auth. | vendor's own |
| OpenAEO openaeo.dev | MCP server | Asks 8 AI crawlers for your page, checks who really answered, and writes the fixes. MIT. | vendor's own |
| oxylabs-mcp oxylabs.io | MCP server | Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API. | vendor's own |
| Rampify rampify.dev | MCP server | SEO MCP server: crawl your site, find AI-visibility gaps, and ship the fix from your coding agent. | vendor's own |
| ReplyNodes replynodes.com | MCP server | Web MCP: scrape/crawl sites, web search, brand assets, app stores, YouTube, Reddit, Hacker News. | vendor's own |
| Scrapeer scrapeer.com | MCP server | Run Scrapeer visual web-scraping flows from AI agents. | vendor's own |
| scrapeunblocker-mcp scrapeunblocker.com | MCP server | Fetch any web page's HTML or AI-parsed JSON through the ScrapeUnblocker anti-bot API. | vendor's own |
| seegeo see-geo.com | MCP server | Audit any website for AI visibility: graded report, findings with fixes, AI crawler access check. | vendor's own |
| Svipall svipall.ilien.dev | MCP server | Read any page past its anti-bot wall, crawl sites, search without an API key, solve captchas locally | vendor's own |
| tooltrace.io MCP server tooltrace.io | MCP server | Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps | vendor's own |
How the ranking works
Every listing is scored 0 to 100 and given a grade from AA to F. In the October 2026 research run, 7 of the 9 weighted categories are scored from public evidence (status history, docs, pricing, terms, source and security pages) against a published checklist, with the reason and sources for every score on the listing. Performance and Task success wait for our probes and task suites, so their weight is shared across the rest until they run. Negative events deduct up to 15 points. Read the methodology.
For companies
Do agents find, use and choose your tools?
An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.