jevcrawl vs Spider

jevcrawl

Three compact, typed MCP tools return verbatim passages with source URLs, cost and stop reasons, and errors arrive as codes with instructions. The project is three days old and alpha, it depends on TypeSafe's paid Jev API, which is in early access with no free tier found, and it does not block crawls of private or local addresses.

Spider

Keyless /scrape and working x402 v2 on every core route, so an agent needs no account. Operated by BAGELMEN LLC with no address, retention periods or DPA in the privacy policy.

jevcrawl

1. Phrase goal as one specific question and start with max_pages between 10 and 30
2. Check stats.stopped_because and stats.degraded, and read uncertain before reporting that something is missing
3. Use scrape without a goal when you need a whole page, since it makes no paid Jev call and needs no key
4. Handle {"error": code, "message": ...} results, for example auth_error means TYPESAFE_API_KEY is missing or rejected
5. Pages in stats.needs_js_urls were not read. Tell the user rather than guessing their content

Spider

1. Every content route returns a JSON array, even /scrape. The status field is the page's, not the API call's
2. Leave request on smart and set return_format to markdown for LLM input
3. Set limit on /crawl. Unset, it caps only at your credit balance
4. Use /scrape with stealth: true instead of /unblocker, which is deprecated
5. Honour Retry-After on 429. Keyless use allows 4 requests a minute