Head to head · Extraction · October 2026 research run
Diffbot vs Scrapling
Scrapling scores 68.5 (B) on agent readiness against Diffbot's 58.6 (C), and leads in 5 of 7 scored categories. Diffbot leads on transparency & trust. Both do extraction.
Best web scraping and crawling APIs for AI agents · All 567 scrapers comparisons
Which one, for what
Diffbot C
Best for Agents that want typed article, product or discussion data from arbitrary pages without writing selectors, and teams that also want the Knowledge Graph.
Ahead on
- Transparency & trust, 68 against 52
Also in its favour
- A hosted endpoint, with nothing to install
- Free to start without a card
Watch for
The token is sent as the token query parameter on Extract and Knowledge Graph calls. It is the only scheme in the OpenAPI file
Best for Agents that need to fetch and drive pages locally, including JavaScript-heavy or bot-protected ones, without a hosted scraping bill.
Ahead on
- Reliability, 65 against 55
- Agent ergonomics, 71 against 63
- Security & auth, 39 against 21
- Payments & pricing, 90 against 60
- Maintenance & community, 93 against 77
Also in its favour
- No key needed to call it
- Runs on your own machine
- Open source
Watch for
Version 0.5.1 with a Beta classifier. v0.4.15, v0.5 and v0.5.1 each carried breaking changes, the last in a patch release
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Payments & pricing Scrapling +30
Diffbot 60
No x402, MPP or L402 was found (0 of 40). Plan prices, the credit cost of each action and overage per credit are public without a login (20). The Free plan has 10,000 credits a month and needs no card (20). A person signs up in a browser at app.diffbot.com to get a token (0). Pricing per the 9 October check, not re-read on 4 November. 0 + 20 + 20 + 0 = 40. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 40 is 60.
Scrapling 90
Free, self-hosted software under BSD-3-Clause with nothing to buy, read with the self-hosted rule. No payment protocol (0), nothing to price (30), free (30), no signup or key (30). 0 + 30 + 30 + 30 = 90.
Security & auth Scrapling +18
Diffbot 21
One token per account, sent in the URL query string as the documented and only scheme in the OpenAPI file. Tokens are revocable in the dashboard per a June 2025 changelog title, and child tokens exist on Plus and above (20 of 30, less 10 for the secret in the URL, so 10). Child tokens have the same rights as the primary one and there is no read-only mode. The skills limit the agent to the db binary through allowed-tools (5 of 20). The API returns untrusted web content and no guidance on prompt injection was found (0 of 15). The token details page shows usage activity and an Account API reports usage. No per-call log was found (6 of 15). No security.txt, security page, certification or bug bounty was found on the pages read, and the privacy policy says some API calls rely on HTTP without encryption (0 of 20). Site pages per the 9 October check, not re-read on 4 November. OSV lists no advisory for diffbot on PyPI or @diffbot/typescript on npm on 4 November. 10 + 5 + 0 + 6 + 0 = 21.
Scrapling 39
Read as local software with an optional HTTP transport. stdio needs no credential. Over HTTP the server refuses to start without a token or an explicit --no-auth, and accepts one shared bearer token with no scopes, rotated by restarting (15). Annotations let a client gate the destructive tools, and follow_redirects defaults to safe, which blocks redirects to private addresses. A direct request to localhost or a private address is not refused, and there is no read-only mode (10). Hidden elements, aria-hidden content, zero-width characters, comments and template tags are stripped by default before page text reaches the model, as documented in the MCP guide. The vendor's claim, untested by us (10). Browser sessions record network history the agent and operator can read back. No call log (4). No SECURITY.md, disclosure address or bug bounty in the repository, and GitHub's advisory page couldn't be read (0). 15 + 10 + 10 + 4 + 0 = 39.
Maintenance & community Scrapling +16
Diffbot 77
Every dated source of the vendor's own was looked for in its GitHub repositories, since its site wasn't re-read. The official Python client, diffbot in the listing's packages, was tagged v3.1.0 on 29 October 2026, adding a Web Search snippet_length option, and the agent skills were tagged v1.2.0 the same day with rewritten skill content, 6 days before this check (30; was 10 on the API changelog's 15 June 2026 entry, which is per the 9 October check, not re-read on 4 November). In the 90 days from 6 August, the skills were tagged v1.1.0 (12 August, five new skills), v1.1.1 (13 August, a plugin marketplace manifest, counted half) and v1.2.0, and the Python client v3.0.0 (28 September) and v3.1.0, counted half as SDK tags, 3.5 in all (20). A public changelog with RSS and a support address exist. GitHub issues were not read (8 of 15 for a closed service). Python and TypeScript clients exist, but the docs named the packages diffbot-python and diffbot-typescript on 9 October while the repositories publish diffbot and @diffbot/typescript, and the TypeScript repository has no tag and no commit since 17 August 2026 (12 of 15). The Python repository tests on Python 3.9 to 3.13. We did not see CI results (7 of 10). 30 + 20 + 8 + 12 + 7 = 77.
Scrapling 93
v0.5.1 tagged and released on 4 November 2026, 14 days before 18 November (30). v0.4.15 (23 August), v0.5 (17 October in the changelog, tagged 18 October) and v0.5.1 (4 November), three in the 90 days (20). The v0.5.1 notes credit about a dozen pull requests from outside contributors. Five issues and 18 pull requests were open on 18 November, and the issue template points to GitHub Discussions and a Discord (20 of 25). The official MCP registry lists io.github.D4Vinci/Scrapling as active, with versions from 0.4.1 (27 February 2026) to 0.5.1 (4 November 2026) (15). Tests and code-quality workflows, PyPI trusted publishing, and current dependencies such as Playwright 1.62. Run results unread (8 of 10). 30 + 20 + 20 + 15 + 8 = 93.
Transparency & trust Diffbot +16
Diffbot 68
A closed service under undated Terms of Use that cover the Site and the Service, cap liability at $10 and grant Diffbot a perpetual licence to process submitted queries. The clients and skills are MIT (13 of 30). The privacy policy of 29 August 2025 says query history and API calls are stored against the API key and kept no longer than necessary, with no retention period given. The GDPR and data rights page was not read (14 of 30). There is no deprecation policy. The changelog carries dated notices, such as a May 2024 entry announcing a field removal for 30 August 2024, and the terms give 14 days' notice of fee changes (8 of 20). The privacy policy names its service providers one by one, among them AWS, Stripe, Intercom, Salesforce, Slack and Amplitude, and says all are in the United States (14 of 20). All per the 9 October check, not re-read on 4 November. 13 + 14 + 8 + 14 = 49.
Scrapling 52
BSD-3-Clause in LICENSE and the PyPI classifiers (30). No telemetry or usage reporting found in the source. Page traffic goes to the target sites, with optional DNS-over-HTTPS through Cloudflare. There is no privacy statement for the package (15). No deprecation policy. Breaking changes are announced in the release notes with migration guides for v0.5 and the remote-session change (8). Nothing is collected that we could find, but there is no explicit statement on telemetry (12). 30 + 15 + 8 + 12 = 65.
Reliability Scrapling +10
Diffbot 55
Graded as a hosted API. status.diffbot.com is a Pingdom public report with 13 checks, among them Analyze API, Article API, Crawlbot and Websearch, with daily uptime for seven days and no incident notes (15 of 20). No 90-day record can be read. In the week to 9 October 2026 Analyze API shows 99.69 per cent, with 2, 11 and 17 minutes down on 4, 5 and 6 October, and Article API 5, 9 and 2 minutes on 5 to 7 October (5 of 30, the line for no readable history). Rate limits are published per plan, 5 calls a minute on Free, 5 a second on Startup and 25 a second on Plus (15). The 429 page says to pause one second and back off. No Retry-After header is documented, though the official client reads one (10 of 15). No SLA was found (0). The Extract APIs are at /v3 with no beta label (10). All per the 9 October check, not re-read on 4 November: Diffbot's terms bar software that scrapes or crawls the Site or Service, so its site and status report weren't fetched. 15 + 5 + 15 + 10 + 0 + 10 = 55.
Scrapling 65
Read on the local-software lines, since the MCP server runs on the user's machine over stdio or a self-run HTTP port. Installs from PyPI (scrapling[ai]) or Docker (pyd4vinci/scrapling, ghcr.io/d4vinci/scrapling), with Python 3.10 or later and 3.10 to 3.13 in the classifiers (20). tests.yml runs tox on Python 3.10 to 3.13 on macOS for pushes and pull requests to main and dev, and the repository holds about 1,390 test functions, 19 test files for the MCP tools among them. Run results on GitHub couldn't be read on 18 November, so passing on main is unchecked (15 of 25). Five issues were open on 18 November 2026 against 104,200 stars, the oldest from 24 October 2025, and two of them had a reply. The v0.5.1 notes credit fixes from outside contributors and close reported issues such as #540 (20 of 25). Breaking changes carry a warning and a migration guide in the changelog, but v0.5.1 broke remote browser connections in a patch release (10 of 15). Version 0.5.1 with a Development Status 4 Beta classifier (0). 20 + 15 + 20 + 10 + 0 = 65.
Agent ergonomics Scrapling +8
Diffbot 63
Graded on the REST API, with the skills noted. mode limits extraction to one page type, fields adds optional fields and discussion=false drops comments, but an article response carries both html and text with no way found to drop either. The skills return Markdown by default (14 of 25). A single-URL call has no pagination. Web Search takes size and maxTokens and DQL takes size per the client. Crawl result paging was not read (10 of 20). Errors are JSON with errorCode and error and six docs pages. A failed extraction can arrive in a 200, and the 429 text says the site received too many requests when the cause is the caller's plan limit (12 of 20). Extract calls are GET reads and safe to retry. Whether a failed call uses a credit was not found, and there is no idempotency key for creating crawl jobs or custom APIs (12 of 20). Only url and token are required, with official Python and TypeScript clients and a CLI (15). Docs per the 9 October check, not re-read on 4 November. The Python client 3.1.0 (29 October 2026) adds a snippet_length option that maps to the Web Search API's snippetLength. 14 + 10 + 12 + 12 + 15 = 63.
Scrapling 71
17 tools, and v0.5 and v0.5.1 both shortened the descriptions. No toolsets or read-only subset (15). css_selector narrows fetch output, extraction can be Markdown, HTML, text or an ARIA snapshot with search, main_content_only is on by default, and network history is paged with a cursor and a limit of 1 to 200 (18). Failures from bad input, the browser and curl come back as tool errors with the message, which the v0.5 notes say were made clearer. No error codes an agent can branch on (12). Every tool carries annotations, read-only for fetches and lists and destructive for actions, JavaScript and state files. HTTP requests retry three times by default with a one-second wait (17). Only url is required for a fetch, with schema defaults. One language, Python, plus a CLI and Docker (9). 15 + 18 + 12 + 17 + 9 = 71.
Score by category
| Category | Weight | Diffbot | Scrapling | Edge |
|---|---|---|---|---|
| Reliability | 16% | 55 | 65 | Scrapling +10 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 83 | 81 | Diffbot +2 |
| Agent ergonomics | 13% | 63 | 71 | Scrapling +8 |
| Security & auth | 14% | 21 | 39 | Scrapling +18 |
| Payments & pricing | 10% | 60 | 90 | Scrapling +30 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 77 | 93 | Scrapling +16 |
| Transparency & trust | 7% | 68 | 52 | Diffbot +16 |
| Negative events | ≤15 | 0 | 0 | |
| Total | C 58.6/100 | B 68.5/100 |
Facts side by side
| Fact | Diffbot | Scrapling |
|---|---|---|
| Kind | HTTP API | MCP server |
| Vendor | Diffbot Technologies Corp. | Karim Shoair |
| Hosted endpoint | https://api.diffbot.com/v3 | no (local only) |
| Transports | HTTP | stdio, Streamable HTTP |
| Auth | API key | None |
| Pricing | Freemium | Free |
| Price for extraction | $0.90 per 1,000 pages | free |
| x402 | no | no |
| Licence | Proprietary service under Diffbot's Terms of Use. The Python client, the TypeScript client and the agent skills are MIT | BSD-3-Clause |
| Tools exposed | none | 17 |
| Read-only variant documented | no | no |
| llms.txt | yes | no |
| MCP registry | not listed | io.github.D4Vinci/Scrapling |
| Last release | 2026-10-29 | 2026-11-04 |
| Terms last updated | no date given | no document linked |
| Privacy policy last updated | 2025-08-29 | no document linked |
| Customer content may train models | not found in the text | not read yet |
| Terms restrict automated access | yes | not read yet |
| Terms restrict benchmarking | not found in the text | not read yet |
| Terms or service can change without notice | not found in the text | not read yet |
| Arbitration or class-action waiver | yes | not read yet |
| Popularity | 9 npm/wk | 104k stars |
How the scores have moved
Verdicts
Diffbot
Extract returns typed JSON for articles, products, discussions and other page types with no selectors to write, under a public OpenAPI 3.1 contract and a free plan that needs no card. The API token travels in the URL query string, tokens carry no scopes, and no security page, certification or security.txt was found.
Scrapling
Scrapling's MCP server gives agents 17 typed tools with read-only and destructive hints, output trimming by CSS selector and default stripping of hidden page text. It is pre-1.0 (0.5.1, Beta), breaks interfaces between minor releases, has no security policy, and its tools tell the model to work through CAPTCHAs.
Before you call either
Diffbot
- Call
GET https://api.diffbot.com/v3/analyze?url=<encoded URL>&token=<token>when the page type is unknown. Use/v3/articleor/v3/productto force one schema - Keep the token out of logs and shared URLs. It sits in the query string, so any proxy or log that records the request URL records the token
- Stay under 5 calls a minute on Free, 5 a second on Startup and 25 a second on Plus. On 429 wait at least one second and back off
- Check a 200 response for
errorCode. The official client raisesExtractionErrorwhen a 200 reports a failed extraction - Set
useProxy=defaultonly when a site blocks the fetch. A proxied page costs 2 credits against 1 - Install
diffbotfrom PyPI, notdiffbot-python, which stopped at 0.3.0
Scrapling
- Start with
make_requestand move tobrowser_fetch_onceonly when the page needs JavaScript or blocks plain HTTP - Pass
css_selectoron fetch tools to cut output. Snapshots need one match or no selector - Read network history with
browser_network_requestsbeforeclose_session, since closing a session drops it - Check the target site's terms and robots.txt yourself. The MCP tools don't read robots.txt, only the spiders do
- If you run the server over HTTP, set
SCRAPLING_MCP_AUTH_TOKENand keep it behind TLS. The token travels in clear over plain HTTP
Questions
Which is better for AI agents, Diffbot or Scrapling?
Scrapling scores 68.5 (B) on agent readiness against Diffbot's 58.6 (C), and leads in 5 of 7 scored categories. Diffbot leads on transparency & trust.
Which is cheaper for extraction, Diffbot or Scrapling?
Scrapling, at free against $0.90 per 1,000 pages for Diffbot. These are the vendors' published prices for the job.
Do Diffbot and Scrapling need an API key?
Diffbot needs an API key. Scrapling needs no key.
Can an agent call Diffbot and Scrapling without installing anything?
Diffbot has a hosted endpoint at https://api.diffbot.com/v3. Scrapling runs on your own machine, with no hosted endpoint listed.
Are Diffbot and Scrapling open source?
No open-source release is listed for Diffbot. Scrapling is open source (BSD-3-Clause).
Other comparisons with Diffbot or Scrapling
- Bright Data vs Diffbot
- Bright Data vs Scrapling
- BrowserAct vs Diffbot
- BrowserAct vs Scrapling
- Context.dev vs Diffbot
- Context.dev vs Scrapling
- Crawl4AI vs Diffbot
- Crawl4AI vs Scrapling
- fastCRW vs Diffbot
- fastCRW vs Scrapling
- Decodo Web Data API vs Diffbot
- Decodo Web Data API vs Scrapling
- Diffbot vs Jina Reader
- Diffbot vs Scrape.do
- Diffbot vs Scrapeless
- Jina Reader vs Scrapling
- Microlink vs Scrapling
- Olostep vs Scrapling
- Outcrawl vs Scrapling
- Oxylabs Web Scraper API vs Scrapling
- Scrape.do vs Scrapling
- ScrapeGraphAI vs Scrapling
- Scrapeless vs Scrapling
- ScraperAPI vs Scrapling
- Scrapewise vs Scrapling
- Scrapfly vs Scrapling
- ScrapingAnt vs Scrapling
- ScrapingBee vs Scrapling
- Scrapingdog vs Scrapling
- Scrapling vs Spider
- Scrapling vs WebScraping.AI
- Scrapling vs ZenRows
- Scrapling vs Zyte API
- Diffbot vs Firecrawl MCP
- Diffbot vs jevcrawl
- Diffbot vs Microlink
- Diffbot vs Nexscope
- Diffbot vs Olostep
- Diffbot vs Outcrawl
- Diffbot vs Oxylabs Web Scraper API
- Diffbot vs PrintFriendly MCP server
- Diffbot vs Qovia
- Diffbot vs ScrapeAtlas
- Diffbot vs ScrapeGraphAI
- Diffbot vs ScrapeOps Proxy API Aggregator
- Diffbot vs ScraperAPI
- Diffbot vs Scrapewise
- Diffbot vs Scrapfly
- Diffbot vs ScrapingAnt
- Diffbot vs ScrapingBee
- Diffbot vs Scrapingdog
- Diffbot vs SoldFetch
- Diffbot vs Spider
- Diffbot vs WebScraping.AI
- Diffbot vs ZenRows
- Diffbot vs Zyte API
- Firecrawl MCP vs Scrapling
- Nexscope vs Scrapling
- Qovia vs Scrapling
- ScrapeAtlas vs Scrapling
- Scrapling vs SoldFetch
- Apify MCP Server vs Diffbot
- Apify MCP Server vs Scrapling
- jevcrawl vs Scrapling
- ScrapeOps Proxy API Aggregator vs Scrapling
Machine-readable
- This page as Markdown
/compare/diffbot-vs-scrapling.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/diffbot.json·/api/v1/tools/scrapling.json - From a terminal
anchor compare diffbot scrapling(the CLI) - Over MCP
compare_tools {"a": "diffbot", "b": "scrapling"}at/mcp, no key