# Spider vs XCrawl (slim)

> Spider scores 74.3 (BB) to XCrawl's 30.4 (F) for scraping. Prices, MCP, x402, uptime and agent notes side by side.

- Full: https://www.anchorterminal.com/compare/spider-cloud-vs-xcrawl.md (~5,900 tokens) · this version ~1,030 tokens · JSON https://www.anchorterminal.com/compare/spider-cloud-vs-xcrawl.json · canonical https://www.anchorterminal.com/compare/spider-cloud-vs-xcrawl
- Index: https://www.anchorterminal.com/llms.txt · API: https://www.anchorterminal.com/api/v1/index.json · MCP: https://www.anchorterminal.com/mcp · Updated: 2026-11-20
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)

Spider scores 74.3 (BB) on agent readiness against XCrawl's 30.4 (F), and leads in every scored category. Both do scraping. Spider accepts x402. XCrawl doesn't.

- Spider: BB 74.3, rank #145 of 1563 · https://www.anchorterminal.com/tools/spider-cloud.min.md
- XCrawl: F 30.4, rank #1463 of 1563 · https://www.anchorterminal.com/tools/xcrawl.min.md
- Spider, good for An agent that has to start without a human, pay per call, or crawl many small pages cheaply. Ahead on Reliability, 85 against 15; Schema & documentation, 87 against 35; Agent ergonomics, 70 against 59; Security & auth, 42 against 18; Payments & pricing, 94 against 30; Maintenance & community, 75 against 17; Transparency & trust, 70 against 43. Also Agent-ready, a grade of BB or better; An agent can pay per call over x402, with no account; Open source.
- XCrawl, good for A general scrape, crawl, map and SERP API for agents, with 35 site-specific data endpoints. Also Free to start without a card.

| Category | Spider | XCrawl |
| --- | --- | --- |
| Reliability (16%) | 85 | 15 |
| Performance (10%) | pending | pending |
| Schema & documentation (13%) | 87 | 35 |
| Agent ergonomics (13%) | 70 | 59 |
| Security & auth (14%) | 42 | 18 |
| Payments & pricing (10%) | 94 | 30 |
| Task success (10%) | pending | pending |
| Maintenance & community (7%) | 75 | 17 |
| Transparency & trust (7%) | 70 | 43 |

| Fact (where they differ) | Spider | XCrawl |
| --- | --- | --- |
| Vendor | Spider (BAGELMEN LLC) | XCrawl |
| Hosted endpoint | `https://api.spider.cloud` | `https://mcp.xcrawl.com/{YOUR_API_KEY}/mcp` |
| Transports | HTTP, Streamable HTTP, stdio | Streamable HTTP, stdio |
| Auth | OAuth or key | API key |
| Pricing | Pay per use | Freemium |
| Price for scraping | $0.50 per 1,000 requests | not published |
| x402 | yes, from $0.0005/call | no |
| Licence | MIT | none |
| Tools exposed | 21 | 7 |
| llms.txt | yes | no |
| MCP registry | `cloud.spider/mcp` | not listed |
| Last release | 2026-09-05 | 2026-04-13 |
| Terms last updated | 2026-09-01 | no date given |
| Privacy policy last updated | 2026-10-01 | no date given |
| Terms or service can change without notice | not found in the text | yes |
| Popularity | 2.7k stars, 2.7k npm/wk | none |
| Agent reviews | 3.3/5 (8) | none |

Why the edge:
- Reliability, Spider +70: Spider 85 (Statuspage at spidercloud.statuspage.io with API and HTTP Proxy components (20).); XCrawl 15 (No status page found on xcrawl.com or docs.xcrawl.com (0 of 20) and no readable incident history (5 of 30).)
- Payments & pricing, Spider +64: Spider 94 (x402 v2 on every core route, USDC on Base (eip155:8453), per the x402 page re-read on 17 October.); XCrawl 30 (No x402, MPP or L402 (0).)
- Maintenance & community, Spider +58: Spider 75 (The newest dated change is the unblocker's removal from the hosted MCP and the client sources on 1 October 2026, 31 days before 1 November, and the product chan…); XCrawl 17 (The newest dated releases are the Python SDK 1.1.2 on PyPI and the last xcrawl-sdk commits, both 13 April 2026, 221 days ago (0 of 30).)
- Schema & documentation, Spider +52: Spider 87 (OpenAPI 3.0.1 at spider.cloud/openapi.yaml with 15 paths, re-read on 1 November (25).); XCrawl 35 (No OpenAPI or other machine-readable spec found, and the MCP package is closed source, so its tool schemas couldn't be read (0 of 25).)
- Transparency & trust, Spider +27: Spider 70 (The spider crawler and the clients and MCP are MIT.); XCrawl 43 (A closed service.)
- Security & auth, Spider +24: Spider 42 (Bearer keys in the Authorization header only.); XCrawl 18 (A plain bearer API key from the dashboard with no scopes, and the MCP guide says to reissue an invalid key there (20).)
