# Read a known URL as Markdown

> Read a known URL as Markdown: 1 companies fully do it, 12 with a limit, 31 carry the tag. Every listing in Web search APIs with the reason and a source.

- Canonical: https://www.anchorterminal.com/niches/search.fetch-url/
- Markdown: https://www.anchorterminal.com/niches/search.fetch-url/index.md (~1,650 tokens)
- Slim: https://www.anchorterminal.com/niches/search.fetch-url/index.min.md (~380 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/niches/search.fetch-url/index.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (the key docs and every listing in one file, at most 16 MB, about 4 million tokens: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- MCP: https://www.anchorterminal.com/mcp (the whole catalogue as tools, no key)
- DNS: dig +short TXT <slug>.grade.anchorterminal.com (the grade as a DNS TXT record, for a sandbox with no HTTP where names still resolve; also top., best.<category>. and <a>.vs.<b>. under the zone, and the same under grade.letme.dev)
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)
- Updated: 2026-11-15

One company's docs show a full fit.

| Companies, full fit | With a limit | Carry the tag | Share of the category's work | First-hand accounts |
| --- | --- | --- | --- | --- |
| 1 | 12 | 31 | 12 | 7 |

## What counts as done

Main content of the page as Markdown with links kept, with a distinct error (not an empty body) when the page is blocked or needs JavaScript.

Measured, for our own tests: under 10 seconds.

How agents ask for it: read this page; fetch this URL and summarise it; what does this link say

## Does the job

The docs show it meets the test above, and nothing we read says otherwise.

- **Parallel Search and Task APIs (Parallel Web Systems Inc.)**: /v1/extract returns markdown with links for JavaScript-heavy pages and PDFs; fetch_policy sets max_age_seconds and disable_cache_fallback makes a failed live fetch an error.

## Does the job, with a limit

It does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.

- **DeepSeek Search and Fetch API (Hangzhou DeepSeek Artificial Intelligence Co., Ltd.)**: Fetch renders JavaScript with a Firefox user agent from Huawei Cloud Hong Kong, but one tester got text only with hyperlinks dropped.
- **Exa API + MCP (Exa Labs Inc.)**: Contents takes URLs with text, maxCharacters, maxAgeHours 0 for a live fetch and livecrawlTimeout, but the pages read do not say whether JavaScript is rendered or links are kept.
- **Fetch (MCP reference server) (Model Context Protocol, a Series of LF Projects, LLC)**: HTML to Markdown via Readability with max_length and start_index paging and isError on robots refusals and HTTP errors, but no JavaScript rendering (progressively rendered content dropped) and Readability was skipped on Windows until October 2026.
- **Kagi Search API (Kagi Inc.)**: Page Markdown comes through the extract option; the MCP kagi_extract tool returned no content for one user in October 2026 (closed 28 October), and rendering is not described.
- **Linkup (Linkup Technologies SAS)**: /fetch returns markdown with renderJs and a pro mode, and a platform runs 100-plus fetches a job on it, but the error behaviour for blocked pages was not in the pages read.
- **Perplexity Search API (Perplexity AI, Inc.)**: fetch_url exists only as an Agent API tool at $0.50 per 1,000 plus model tokens, with failure markers for robots blocks and no_result_returned; no standalone endpoint.
- **SERPHouse (Patoliya Infotech LLP)**: Scraper API /scrape/md returns Markdown from the rendered page at 1 to 10 credits by site type, but no error behaviour for blocked pages is documented.
- **SerpKite (Anastasia Klimova, trading as SerpKite)**: /v1/webpage returns clean Markdown and metadata for HTML or PDF, and /v1/extract lists failed URLs at no charge, but JavaScript rendering is not stated.
- **Tavily API + MCP (AlphaAI Technologies Inc. dba Tavily)**: /extract returns markdown with per-URL failed_results and an extract_depth, but Mintlify docs sites came back as empty results with no error and no maintainer reply.
- **TinyFish Search (Tiny Fish, Inc.)**: Fetch returns Markdown by default with per-URL errors and timeouts, but links are kept only as a separate list when links=true, and rendering is implied rather than stated.
- **Valyu (Valyu.Network Ltd)**: A Contents API extracts text from up to 50 URLs at 0.2 credits each, paying only for successes, but its guide was not opened so rendering and errors are unread.
- **You.com APIs (SuSea, Inc., d/b/a you.com)**: Contents API returns Markdown or HTML for up to 10 URLs with crawl_timeout (20 to 30 seconds suggested for JavaScript-heavy pages), but per-URL error behaviour was not in the overview read.

## Couldn't check

The docs were closed to us, or silent. These carry no mark either way.

- **SpecStream (SpecStream SAS)**: POST /v1/extract is listed at $0.80 per 1,000 pages, but its docs page was not opened.

- not this job: Web Search Tool on Amazon Bedrock AgentCore (Amazon Web Services, Inc. (regional AWS entities by account location)): Web Search Tool takes a query only; no URL fetch tool is part of this connector.
- not this job: Arcmira (Arcmira, Inc.): arcmira_youtube_transcript reads a video transcript from its link; no general URL fetch.
- not this job: Grounding with Bing Search (Microsoft Corporation): No URL fetch tool in the Bing grounding tools.
- not this job: Brave Search API + MCP (Brave Software, Inc.): No fetch endpoint; LLM Context starts from a query, not a URL.
- not this job: Cloudflare Web Search API (Cloudflare, Inc.): Search only; no fetch or extract route in the Web Search API.
- not this job: Grep AI (Parcha Labs, Inc.): No fetch endpoint.
- not this job: Liner Search MCP (Liner): No fetch endpoint.
- not this job: Mojeek Web Search API (Mojeek Limited): No fetch endpoint.
- not this job: NewsCatcher (NewsCatcher, Inc.): No fetch endpoint.
- not this job: SearchAPI.io (SearchApi, LLC): No fetch endpoint.
- not this job: SerpApi (SerpApi, LLC): No fetch endpoint.
- not this job: Serper (Serper): No fetch endpoint in the listing's capabilities or on the home page.

## What stops agents finishing

- empty body on JavaScript sites with no fallback to a browser
- robots or bot check refusal with no solver
- per-domain limits that are not published (DeepSeek Fetch)

## Around it

Before: search.ground-fact. After: document-extraction.table-from-text.

## Where this comes from

Weight 12 of 100 in Web search APIs: 7 of 44 accounts: DeepSeek fetch reviews, Kagi extract no-content issue, Tavily extract empty on SPA, Linkup fetch pricing, Firecrawl fallback, Fetch reference server issues

As data: https://www.anchorterminal.com/api/v1/use-cases/search.fetch-url.json, or the MCP tool get_use_case with id search.fetch-url. Draft, read 2026-11-12 from public docs and first-hand accounts, not yet reviewed by a person.

---

Query this catalogue directly over MCP: https://www.anchorterminal.com/mcp (Streamable HTTP, no key). How: https://www.anchorterminal.com/agents/#mcp
