{
  "data": null,
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/niches/search.fetch-url/",
    "json": "https://www.anchorterminal.com/niches/search.fetch-url/index.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/niches/search.fetch-url/index.md",
    "mcp": "https://www.anchorterminal.com/mcp",
    "slim": "https://www.anchorterminal.com/niches/search.fetch-url/index.min.md"
  },
  "markdown": "One company's docs show a full fit.\n\n| Companies, full fit | With a limit | Carry the tag | Share of the category's work | First-hand accounts |\n| --- | --- | --- | --- | --- |\n| 1 | 12 | 31 | 12 | 7 |\n\n## What counts as done\n\nMain content of the page as Markdown with links kept, with a distinct error (not an empty body) when the page is blocked or needs JavaScript.\n\nMeasured, for our own tests: under 10 seconds.\n\nHow agents ask for it: read this page; fetch this URL and summarise it; what does this link say\n\n## Does the job\n\nThe docs show it meets the test above, and nothing we read says otherwise.\n\n- **Parallel Search and Task APIs (Parallel Web Systems Inc.)**: /v1/extract returns markdown with links for JavaScript-heavy pages and PDFs; fetch_policy sets max_age_seconds and disable_cache_fallback makes a failed live fetch an error.\n\n## Does the job, with a limit\n\nIt does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.\n\n- **DeepSeek Search and Fetch API (Hangzhou DeepSeek Artificial Intelligence Co., Ltd.)**: Fetch renders JavaScript with a Firefox user agent from Huawei Cloud Hong Kong, but one tester got text only with hyperlinks dropped.\n- **Exa API + MCP (Exa Labs Inc.)**: Contents takes URLs with text, maxCharacters, maxAgeHours 0 for a live fetch and livecrawlTimeout, but the pages read do not say whether JavaScript is rendered or links are kept.\n- **Fetch (MCP reference server) (Model Context Protocol, a Series of LF Projects, LLC)**: HTML to Markdown via Readability with max_length and start_index paging and isError on robots refusals and HTTP errors, but no JavaScript rendering (progressively rendered content dropped) and Readability was skipped on Windows until October 2026.\n- **Kagi Search API (Kagi Inc.)**: Page Markdown comes through the extract option; the MCP kagi_extract tool returned no content for one user in October 2026 (closed 28 October), and rendering is not described.\n- **Linkup (Linkup Technologies SAS)**: /fetch returns markdown with renderJs and a pro mode, and a platform runs 100-plus fetches a job on it, but the error behaviour for blocked pages was not in the pages read.\n- **Perplexity Search API (Perplexity AI, Inc.)**: fetch_url exists only as an Agent API tool at $0.50 per 1,000 plus model tokens, with failure markers for robots blocks and no_result_returned; no standalone endpoint.\n- **SERPHouse (Patoliya Infotech LLP)**: Scraper API /scrape/md returns Markdown from the rendered page at 1 to 10 credits by site type, but no error behaviour for blocked pages is documented.\n- **SerpKite (Anastasia Klimova, trading as SerpKite)**: /v1/webpage returns clean Markdown and metadata for HTML or PDF, and /v1/extract lists failed URLs at no charge, but JavaScript rendering is not stated.\n- **Tavily API + MCP (AlphaAI Technologies Inc. dba Tavily)**: /extract returns markdown with per-URL failed_results and an extract_depth, but Mintlify docs sites came back as empty results with no error and no maintainer reply.\n- **TinyFish Search (Tiny Fish, Inc.)**: Fetch returns Markdown by default with per-URL errors and timeouts, but links are kept only as a separate list when links=true, and rendering is implied rather than stated.\n- **Valyu (Valyu.Network Ltd)**: A Contents API extracts text from up to 50 URLs at 0.2 credits each, paying only for successes, but its guide was not opened so rendering and errors are unread.\n- **You.com APIs (SuSea, Inc., d/b/a you.com)**: Contents API returns Markdown or HTML for up to 10 URLs with crawl_timeout (20 to 30 seconds suggested for JavaScript-heavy pages), but per-URL error behaviour was not in the overview read.\n\n## Couldn't check\n\nThe docs were closed to us, or silent. These carry no mark either way.\n\n- **SpecStream (SpecStream SAS)**: POST /v1/extract is listed at $0.80 per 1,000 pages, but its docs page was not opened.\n\n- not this job: Web Search Tool on Amazon Bedrock AgentCore (Amazon Web Services, Inc. (regional AWS entities by account location)): Web Search Tool takes a query only; no URL fetch tool is part of this connector.\n- not this job: Arcmira (Arcmira, Inc.): arcmira_youtube_transcript reads a video transcript from its link; no general URL fetch.\n- not this job: Grounding with Bing Search (Microsoft Corporation): No URL fetch tool in the Bing grounding tools.\n- not this job: Brave Search API + MCP (Brave Software, Inc.): No fetch endpoint; LLM Context starts from a query, not a URL.\n- not this job: Cloudflare Web Search API (Cloudflare, Inc.): Search only; no fetch or extract route in the Web Search API.\n- not this job: Grep AI (Parcha Labs, Inc.): No fetch endpoint.\n- not this job: Liner Search MCP (Liner): No fetch endpoint.\n- not this job: Mojeek Web Search API (Mojeek Limited): No fetch endpoint.\n- not this job: NewsCatcher (NewsCatcher, Inc.): No fetch endpoint.\n- not this job: SearchAPI.io (SearchApi, LLC): No fetch endpoint.\n- not this job: SerpApi (SerpApi, LLC): No fetch endpoint.\n- not this job: Serper (Serper): No fetch endpoint in the listing's capabilities or on the home page.\n\n## What stops agents finishing\n\n- empty body on JavaScript sites with no fallback to a browser\n- robots or bot check refusal with no solver\n- per-domain limits that are not published (DeepSeek Fetch)\n\n## Around it\n\nBefore: search.ground-fact. After: document-extraction.table-from-text.\n\n## Where this comes from\n\nWeight 12 of 100 in Web search APIs: 7 of 44 accounts: DeepSeek fetch reviews, Kagi extract no-content issue, Tavily extract empty on SPA, Linkup fetch pricing, Firecrawl fallback, Fetch reference server issues\n\nAs data: https://www.anchorterminal.com/api/v1/use-cases/search.fetch-url.json, or the MCP tool get_use_case with id search.fetch-url. Draft, read 2026-11-12 from public docs and first-hand accounts, not yet reviewed by a person.\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "attributionRequired": true,
    "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-11-16",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "0.8",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run",
    "terms": "https://www.anchorterminal.com/terms/#data"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "For agents",
        "url": "https://www.anchorterminal.com/agents/"
      },
      {
        "name": "Niches",
        "url": "https://www.anchorterminal.com/niches/"
      },
      {
        "name": "Read a known URL as Markdown",
        "url": ""
      }
    ],
    "description": "Read a known URL as Markdown: 1 companies fully do it, 12 with a limit, 31 carry the tag. Every listing in Web search APIs with the reason and a source.",
    "facts": null,
    "h1": "Read a known URL as Markdown",
    "image": "https://www.anchorterminal.com/assets/og/default.png",
    "path": "/niches/search.fetch-url/",
    "published": "",
    "section": "agents",
    "title": "Read a known URL as Markdown: who does it | Anchor Terminal",
    "toc": null,
    "updated": "2026-11-15",
    "url": "https://www.anchorterminal.com/niches/search.fetch-url/"
  },
  "tokens": {
    "markdown": 1650,
    "slim": 380
  },
  "version": 1
}
