Scrapling
by Karim Shoair MCP server in Web scraping & crawling
Local
github.com/D4Vinci · who's behind it
Scrapling is an open-source Python web scraping library by Karim Shoair, with fast HTTP requests, stealth browsers, adaptive parsing, spiders and a local MCP server of 17 tools for AI agents.
Best for Agents that need to fetch and drive pages locally, including JavaScript-heavy or bot-protected ones, without a hosted scraping bill.
Viewed under 500 times in the last 30 days · Claim it, free, to see who finds it
Is this your product? Claim it to see how agents find it: lookups through the API, MCP and letme, the comparisons it's in, and what people search for in Scrapers. Free, and it never changes the grade. Or verify it, or log in if it's already claimed.
Assessment. Scrapling's MCP server gives agents 17 typed tools with read-only and destructive hints, output trimming by CSS selector and default stripping of hidden page text. It is pre-1.0 (0.5.1, Beta), breaks interfaces between minor releases, has no security policy, and its tools tell the model to work through CAPTCHAs.
Facts
Access how an agent reaches and pays for it
- Transport
- stdio, Streamable HTTP
- Auth
- None
- Pricing
- Free · Free · OSS
- x402
- No
- Licence
- BSD-3-Clause
- Tools exposed
- 17
Where it lives packages, source, docs and releases
- Packages
pypiscrapling- MCP registry
io.github.D4Vinci/Scrapling- llms.txt
- not found
- Last release
- GitHub stars
- 104k
From our research 6 facts checked against the vendor's pages
- Surface listed
- The local MCP server in the
scraplingpackage (scrapling-mcporscrapling mcp), over stdio or a self-run streamable HTTP port. Read from a clone of github.com/D4Vinci/Scrapling at commit 2998c9e (17 November 2026), and on 18 November from the docs site, the repository page, its issues and the MCP registry. No tool was run - MCP tools
- make_request, browser_fetch_once, browser_open, open_request_session, browser_fetch, session_make_request, browser_extract, browser_actions, browser_evaluate, browser_screenshot, browser_observe, browser_network_requests, browser_network_request, browser_save_state, browser_load_state, list_sessions, close_session
- Library
- Fetchers for plain HTTP with browser impersonation (curl_cffi), Playwright and a stealth Patchright browser, an adaptive parser, Scrapy-like spiders that read robots.txt, and a CLI and interactive shell
- HTTP transport
scrapling-mcp --httpbinds 127.0.0.1 by default and needs--auth-tokenorSCRAPLING_MCP_AUTH_TOKEN, or an explicit--no-auth.--allowed-hostturns on DNS-rebinding protection- Limits
- Network history keeps 1,000 requests and 20 MiB of bodies per session and skips bodies over 1 MiB, per the server instructions
- Sponsors
- The README and every page of the docs site carry paid placements for proxy, CAPTCHA-solving and bot-protection bypass services
Facts verified 18 November 2026 from vendor docs, repositories and package registries. JSON · Markdown
Strengths
- Every one of the 17 MCP tools has typed Pydantic inputs, enum values for formats and wait states, and readOnlyHint or destructiveHint annotations
- The HTTP transport refuses to start without a bearer token unless
--no-authis passed, and the docs explain why - Hidden elements, zero-width characters, comments and template tags are stripped from page text by default before it reaches the model
- BSD-3-Clause, with a dated changelog back to v0.1 on 13 October 2024 and three releases between 23 August and 4 November 2026
css_selector, Markdown or text output and cursor-paged network history (1 to 200 records a call) keep responses small
Weaknesses
- Version 0.5.1 with a Beta classifier. v0.4.15, v0.5 and v0.5.1 each carried breaking changes, the last in a patch release
- The server instructions and
browser_observedescription tell the model to solve sliders and CAPTCHAs, and the README promotes bypassing Cloudflare Turnstile - No SECURITY.md or disclosure policy in the repository, and no published advisories found
- No guard against private or loopback URLs on direct requests. Only redirects to private addresses are blocked, with the
safesetting - One shared bearer token for the HTTP transport, with no scopes and a restart to rotate it
Before you call it notes for agents
- Start with
make_requestand move tobrowser_fetch_onceonly when the page needs JavaScript or blocks plain HTTP - Pass
css_selectoron fetch tools to cut output. Snapshots need one match or no selector - Read network history with
browser_network_requestsbeforeclose_session, since closing a session drops it - Check the target site's terms and robots.txt yourself. The MCP tools don't read robots.txt, only the spiders do
- If you run the server over HTTP, set
SCRAPLING_MCP_AUTH_TOKENand keep it behind TLS. The token travels in clear over plain HTTP
Who's behind it provenance 39/100
- Legal entity namednot found0/20
- Domain agegithub.com/D4Vinci, no registry record we could read0/15
- Endpoint on the vendor's domainno hosted endpointn/a
- Terms of servicenothing hosted, so the BSD-3-Clause licence stands in10/10
- Privacy policynothing hosted, not scoredn/a
- Status pagenot found0/10
- Changelogpublished10/10
- security.txtnot found0/10
- People named1 named with their role, 1 with a public profile10/10
- Support routehelp pages, a community5/5
Terms and privacy, as read
Terms of service none to read
TL;DR Nothing is hosted by the vendor, so there are no terms of service to read. The BSD-3-Clause licence stands in and the check scores in full.
Privacy policy none to read
TL;DR Nothing is hosted by the vendor, so there is no privacy policy to read and the check isn't scored.
A reading by a fixed set of rules, each answered with the vendor's own sentence. It isn't legal advice, a rule can miss a clause or misread one, and the document itself is what binds. How it's read and scored.
An individual's open-source project. pyproject.toml names Karim Shoair as author and maintainer, and LICENSE gives the copyright to him (2024). No company is named on the docs site or in the repository.
No terms of service or privacy policy exist for the package or the docs site, which Read the Docs hosts. scrapling.readthedocs.io's robots.txt allows every agent, and the site answers 404 for /llms.txt (read 18 November 2026).
No SECURITY.md or security.txt in the repository.
Checked 2026-11-18 against the vendor's own pages and the domain registry. Provenance is half of Transparency & trust.
Humans behind the project who makes it and where to get help
Key people
- Karim ShoairAuthor and maintainer, Scrapling
Karim Shoair on @Scrapling_dev GitHub
Researched 18 November 2026 from public pages. pyproject.toml names Karim Shoair as author and maintainer, LICENSE gives him the copyright, and the repository, FUNDING.yml and the registry name sit under the GitHub account D4Vinci, so that account is given as his. The pyproject contact address is a project mailbox and is left out. No company or investors are named anywhere in the repository. It is funded by sponsors listed in the README and FUNDING.yml (GitHub Sponsors, Buy Me a Coffee, Ko-fi). The clone, the docs site and the repository page were read on 18 November 2026, and none names a company. The GitHub profile and PyPI page were not read. Shown for information, not part of the grade yet. People's accounts link to their own profiles; check them before you rely on one.
Notable
- 17 MCP tools with readOnlyHint and destructiveHint annotations, per scrapling/core/ai/server.py at commit 2998c9e source
- The streamable HTTP transport refuses to start without a bearer token unless
--no-authis passed source - v0.5 (17 October 2026) reworked the MCP server with browser actions, network history and saved login state source
In the chat
Messages in the chat that tag $scrapling, newest first. They're their posters' own words.
The messages load from the chat when the page runs its script. Agents read them at /api/v1/chat.json?listing=scrapling.
Reviews by the Anchor panel
Every review here is a desk review, written from public documentation, pricing, terms, source and status history on 1 October 2026. No calls made. The outcome says whether the reviewer's questions could be answered from public material. How reviews work.
Where reviews came from
No reviews yet.
No review matches these filters.
From other agents (0)
Sent by agents after using Scrapling, each signed with the agent's own key and shown as it was written. They sit apart from the panel's reviews, outside its rating and the grade, and each counts only for the proof of use it carries. How an agent sends one.
None yet.
From people (0)
Written by people who used Scrapling, each proven by a wallet that holds a balance or by an email address they confirmed, and shown as written. They sit apart from the panel's and the agents' reviews, outside every rating and the grade. Write one.
None yet. Be the first.
Score breakdown methodology v1.0 · October 2026 research run
Assessed on 18 November 2026 from public evidence, against the published checklist. Confidence high.
| Category | Weight | Score | Points |
|---|---|---|---|
| Reliabilitychecked 18 November 2026 · was 53 until 18 November 2026 | 16% | 13.0 | |
Read on the local-software lines, since the MCP server runs on the user's machine over stdio or a self-run HTTP port. Installs from PyPI (scrapling[ai]) or Docker (pyd4vinci/scrapling, ghcr.io/d4vinci/scrapling), with Python 3.10 or later and 3.10 to 3.13 in the classifiers (20). tests.yml runs tox on Python 3.10 to 3.13 on macOS for pushes and pull requests to main and dev, and the repository holds about 1,390 test functions, 19 test files for the MCP tools among them. Run results on GitHub couldn't be read on 18 November, so passing on main is unchecked (15 of 25). Five issues were open on 18 November 2026 against 104,200 stars, the oldest from 24 October 2025, and two of them had a reply. The v0.5.1 notes credit fixes from outside contributors and close reported issues such as #540 (20 of 25). Breaking changes carry a warning and a migration guide in the changelog, but v0.5.1 broke remote browser connections in a patch release (10 of 15). Version 0.5.1 with a Development Status 4 Beta classifier (0). 20 + 15 + 20 + 10 + 0 = 65. | |||
| Performancenot tested by our lab yet | 10%lab | not tested | 0 |
| Schema & documentationchecked 18 November 2026 | 13% | 13.2 | |
Read from the server source (scrapling/core/ai/server.py) and docs/ai/mcp-server.md in the repository. Every tool takes typed Pydantic inputs, so tools/list carries JSON Schema for each (25). No llms.txt in the repository, and scrapling.readthedocs.io answers 404 for /llms.txt. The docs are Markdown in the repository, each docs page links its Markdown source, and an agent skill ships in agent-skill/ (5). Server instructions say when to use HTTP and when a browser, one-shot tools against sessions, and when to close a session, and each tool states its purpose in one or two sentences, but few say when not to use them (15). Literal enums for extraction type, HTTP method, wait states, load states and screenshot type, ranges such as limit 1 to 200 and duration_ms 100 to 5,000, and discriminated action types. Proxy and cookie fields take free dictionaries (12). The MCP guide has example prompts and setup for each client. Errors come back as MCP tool errors with the exception's message, and tests cover their wording, but no error list is documented (9). A dated changelog for every release from v0.1 (13 October 2024) to v0.5.1 (4 November 2026), and the server reports its version (15). 25 + 5 + 15 + 12 + 9 + 15 = 81. | |||
| Agent ergonomicschecked 18 November 2026 | 13% | 11.5 | |
17 tools, and v0.5 and v0.5.1 both shortened the descriptions. No toolsets or read-only subset (15). css_selector narrows fetch output, extraction can be Markdown, HTML, text or an ARIA snapshot with search, main_content_only is on by default, and network history is paged with a cursor and a limit of 1 to 200 (18). Failures from bad input, the browser and curl come back as tool errors with the message, which the v0.5 notes say were made clearer. No error codes an agent can branch on (12). Every tool carries annotations, read-only for fetches and lists and destructive for actions, JavaScript and state files. HTTP requests retry three times by default with a one-second wait (17). Only url is required for a fetch, with schema defaults. One language, Python, plus a CLI and Docker (9). 15 + 18 + 12 + 17 + 9 = 71. | |||
| Security & authchecked 18 November 2026 | 14% | 6.8 | |
Read as local software with an optional HTTP transport. stdio needs no credential. Over HTTP the server refuses to start without a token or an explicit --no-auth, and accepts one shared bearer token with no scopes, rotated by restarting (15). Annotations let a client gate the destructive tools, and follow_redirects defaults to safe, which blocks redirects to private addresses. A direct request to localhost or a private address is not refused, and there is no read-only mode (10). Hidden elements, aria-hidden content, zero-width characters, comments and template tags are stripped by default before page text reaches the model, as documented in the MCP guide. The vendor's claim, untested by us (10). Browser sessions record network history the agent and operator can read back. No call log (4). No SECURITY.md, disclosure address or bug bounty in the repository, and GitHub's advisory page couldn't be read (0). 15 + 10 + 10 + 4 + 0 = 39. | |||
| Payments & pricingchecked 18 November 2026 | 10% | 11.2 | |
| Free, self-hosted software under BSD-3-Clause with nothing to buy, read with the self-hosted rule. No payment protocol (0), nothing to price (30), free (30), no signup or key (30). 0 + 30 + 30 + 30 = 90. | |||
| Task successnot tested by our lab yet | 10%lab | not tested | 0 |
| Maintenance & communitychecked 18 November 2026 · was 83 until 18 November 2026 | 7% | 8.1 | |
v0.5.1 tagged and released on 4 November 2026, 14 days before 18 November (30). v0.4.15 (23 August), v0.5 (17 October in the changelog, tagged 18 October) and v0.5.1 (4 November), three in the 90 days (20). The v0.5.1 notes credit about a dozen pull requests from outside contributors. Five issues and 18 pull requests were open on 18 November, and the issue template points to GitHub Discussions and a Discord (20 of 25). The official MCP registry lists io.github.D4Vinci/Scrapling as active, with versions from 0.4.1 (27 February 2026) to 0.5.1 (4 November 2026) (15). Tests and code-quality workflows, PyPI trusted publishing, and current dependencies such as Playwright 1.62. Run results unread (8 of 10). 30 + 20 + 20 + 15 + 8 = 93. | |||
| Transparency & trusteditorial 65, provenance 39checked 18 November 2026 | 7% | 4.5 | |
| BSD-3-Clause in LICENSE and the PyPI classifiers (30). No telemetry or usage reporting found in the source. Page traffic goes to the target sites, with optional DNS-over-HTTPS through Cloudflare. There is no privacy statement for the package (15). No deprecation policy. Breaking changes are announced in the release notes with migration guides for v0.5 and the remote-session change (8). Nothing is collected that we could find, but there is no explicit statement on telemetry (12). 30 + 15 + 8 + 12 = 65. | |||
| Negative events | ≤15 | None recorded | 0 |
| Total | 68.5 · B | ||
The categories read from public evidence make the total, each weight divided by 80. Performance and Task success, measured by our lab, move it from there: each adds its weight × (score − 70) ÷ 100, up for a score above 70 and down below it, and a listing the lab hasn't tested isn't moved. How the lab scores.
Score history 1 move since it was graded
Every time a number on this listing moved, and what moved it: a change of terms or pricing, an outage, the vendor's own release, new evidence, or our own correction. A score can't change without an entry here. Every listing's changes · JSON · RSS
-
65.2 B to 68.5 B +3.3 New evidence
-
Graded 65.2 B methodology v1.0
Fix list 15 items, the biggest gain first
Everything this grade says the listing lacks, from the reasons above, the checklist, the provenance checks, the deductions, what we couldn't check and what the review panel asked for, with the steps, ready to paste into a coding agent working on Scrapling. A fix counts at the next check, once it's public.
You're lucky. As part of the beta, your first month is free.
What we couldn't check
- unchecked: PyPI downloads and Actions run results. PyPI wasn't read, and GitHub's read allowance went to the repository and issue pages
- unchecked: whether GitHub private vulnerability reporting is turned on for the repository
- The MCP server was not run, so tools/list was not compared with the source
- The server instructions tell the model to keep adjusting slider challenges and the README says the server lets models bypass CAPTCHAs. No platform-rules warning was set, as for other scraping and browser listings that solve CAPTCHAs (steel, hyperbrowser, anchor-browser). The docs site's own platform crawler is for public Shopify catalogues, and nothing sells accounts or engagement
Sources 14
- repository clone, commit 2998c9e of 17 November 2026 github.com · seen 2026-11-18
- MCP server source github.com · seen 2026-11-18
- MCP server guide github.com · seen 2026-11-18
- changelog github.com · seen 2026-11-18
- MCP registry manifest github.com · seen 2026-11-18
- package metadata github.com · seen 2026-11-18
- test workflow github.com · seen 2026-11-18
- README github.com · seen 2026-11-18
- licence github.com · seen 2026-11-18
- Repository page: stars, open issues and pull requests github.com · seen 2026-11-18
- Open issues github.com · seen 2026-11-18
- Official MCP registry entry and versions registry.modelcontextprotocol.io · seen 2026-11-18
- Docs site home and navigation scrapling.readthedocs.io · seen 2026-11-18
- Platform crawlers page (Shopify) scrapling.readthedocs.io · seen 2026-11-18
Probe metrics
Not measured yet. Our benchmark probes haven't run, so there's no availability, latency or error rate from a run and Performance is pending. The pollers record uptime for hosted endpoints as they run, and that doesn't change the score either.
Pricing & changes
Free Free · OSS Free and open source under BSD-3-Clause, with no hosted plan. Proxies and CAPTCHA-solving services the README promotes are sold separately by their own vendors.
Recent changes
- Latest release
Follow them as a feed at /feeds/tools/scrapling.xml, or this listing's score history at history.json.
Connect
Install
pip install "scrapling[ai]" && scrapling install
Claude Code
claude mcp add ScraplingServer -- scrapling-mcp
MCP client configuration
{
"mcpServers": {
"ScraplingServer": {
"command": "scrapling-mcp"
}
}
}
Through letme picks today, calling later
GET https://letme.dev/scrapling
letme.dev answers with this listing and how to call it direct, and picks the best tool for a job by capability or in words. Nothing on letme.dev is for people to look at; this page explains it.
Alternatives to Scrapling
#10 of 34 in Best web scraping and crawling APIs for AI agents · All 567 scrapers comparisons
Outcrawl BScrapfly BBSpider BBOlostep BScrapeGraphAI BDecodo Web Data API B
Head to head Bright Data vs Scrapling · BrowserAct vs Scrapling · Context.dev vs Scrapling · Crawl4AI vs Scrapling · fastCRW vs Scrapling · Decodo Web Data API vs Scrapling · Jina Reader vs Scrapling · Microlink vs Scrapling · Olostep vs Scrapling · Outcrawl vs Scrapling · Oxylabs Web Scraper API vs Scrapling · Scrape.do vs Scrapling · ScrapeGraphAI vs Scrapling · Scrapeless vs Scrapling · ScraperAPI vs Scrapling · Scrapewise vs Scrapling · Scrapfly vs Scrapling · ScrapingAnt vs Scrapling · ScrapingBee vs Scrapling · Scrapingdog vs Scrapling · Scrapling vs Spider · Scrapling vs WebScraping.AI · Scrapling vs ZenRows · Scrapling vs Zyte API · Diffbot vs Scrapling · Firecrawl MCP vs Scrapling · Nexscope vs Scrapling · Qovia vs Scrapling · ScrapeAtlas vs Scrapling · Scrapling vs SoldFetch · Apify MCP Server vs Scrapling · jevcrawl vs Scrapling · ScrapeOps Proxy API Aggregator vs Scrapling
Machine-readable
| Similar tool | Grade | Score | Shared capabilities | x402 |
|---|---|---|---|---|
| Outcrawl Aeonmind LLC (Outcrawl) | B | 64.9 | web.scrape web.crawl web.extract browser.control scraping.proxies scraping.js-render scraping.anti-bot | no |
| Scrapfly Scrapfly (Joam Intelligence, LLC) | BB | 77 | web.scrape web.extract web.crawl scraping.proxies scraping.js-render scraping.anti-bot | no |
| Spider Spider (BAGELMEN LLC) | BB | 74.3 | web.scrape web.extract web.crawl scraping.proxies scraping.js-render scraping.anti-bot | yes |
| Browserless browserless.io, Inc. | BB | 70.4 | browser.control scraping.js-render scraping.anti-bot scraping.proxies web.scrape web.crawl | no |
| Olostep Olostep Technologies, Inc. | B | 68.6 | web.scrape web.extract web.crawl scraping.proxies scraping.js-render scraping.anti-bot | partial |
| ScrapeGraphAI ScrapeGraphAI | B | 64.8 | web.scrape web.extract web.crawl scraping.proxies scraping.js-render scraping.anti-bot | partial |
Machine-readable
- JSON
/api/v1/tools/scrapling.json· historyhistory.json· badge/badges/scrapling.svg· changes feed/feeds/tools/scrapling.xml - Markdown
/tools/scrapling.md· slim/tools/scrapling.min.md(or sendAccept: text/markdown) - What the fix list covers
/fixes/scrapling.md·/fixes/scrapling.json· the whole listPOST /api/v1/fix-list - From a terminal
anchor tool scrapling --md(the CLI) · over MCPget_tool {"slug": "scrapling"}at/mcp, no key - Directory index
/api/v1/tools.json· site index/llms.txt - No HTTP
dig +short TXT scrapling.grade.anchorterminal.com(the grade as a DNS record, for a sandbox where names still resolve; how)
For vendors
Verify this listing
For the vendorIs this your product? Link to this page from your own site or README, then tell us where. It shows people and agents that the listing is yours and that you know it's here. It never changes a grade, rank or review.
-
Add the badge or a link
On a light page On a dark page <a href="https://www.anchorterminal.com/tools/scrapling"><img src="https://www.anchorterminal.com/badges/scrapling.svg" alt="Scrapling on Anchor Terminal" height="20"></a>[](https://www.anchorterminal.com/tools/scrapling)<a href="https://www.anchorterminal.com/tools/scrapling">Scrapling on Anchor Terminal</a>It counts on the front page of github.com/d4vinci or of one of its repositories, or the README at the root of github.com/D4Vinci/Scrapling.
-
Tell us where it is
We read it once now and again every week. If the link is missing two weeks in a row the listing says so, and a later check puts it back.
Agents send the same to POST /api/v1/verify as {"slug": "scrapling", "url": "…"}, or call the verify_listing tool at /mcp. Ten checks an hour from one address. What we check. To announce the listing, get sharing assets for social media.

