{
  "data": null,
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/niches/inference.structured-extraction/",
    "json": "https://www.anchorterminal.com/niches/inference.structured-extraction/index.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/niches/inference.structured-extraction/index.md",
    "mcp": "https://www.anchorterminal.com/mcp",
    "slim": "https://www.anchorterminal.com/niches/inference.structured-extraction/index.min.md"
  },
  "markdown": "Four or more companies' docs show a full fit.\n\n| Companies, full fit | With a limit | Carry the tag | Share of the category's work | First-hand accounts |\n| --- | --- | --- | --- | --- |\n| 6 | 24 | 42 | 10 | 4 |\n\n## What counts as done\n\nOutput parses as JSON and validates against the schema, and refusals and truncation are signalled in a field the caller can check.\n\nMeasured, for our own tests: output parses and validates on every call in a 100-call run, and a schema that validated last week still validates this week.\n\nHow agents ask for it: extract these fields as JSON; classify each row into one of these labels; give me output my code can parse without cleaning\n\n## Does the job\n\nThe docs show it meets the test above, and nothing we read says otherwise.\n\n- **Azure OpenAI in Foundry Models (Microsoft Corporation)**: response_format json_schema with strict true and strict function tools, refusal and finish_reason fields on every response; schema limits are the OpenAI subset.\n- **Cerebras Inference (Cerebras Systems Inc.)**: response_format json_schema with strict true uses constrained decoding on the listed models, every object needing additionalProperties false; strict false is a hint only.\n- **Cohere Chat API (Command models) (Cohere Inc.)**: response_format json_object or json_schema forces the schema and strict_tools does the same for tool arguments; not available in RAG mode and json_object needs an explicit JSON instruction or the model can loop.\n- **DeepInfra (Deep Infra Inc.)**: response_format json_schema with strict constrains output to the schema on the models tagged for it; no refusal field is described.\n- **Fireworks AI Inference (Fireworks.ai, Inc.)**: response_format json_schema or a grammar constrains output, finish_reason length flags truncation, and the supported and unsupported schema keywords are listed; pattern is best effort.\n- **Meta Model API (Meta Platforms, Inc.)**: response_format json_schema constrains decoding so output always matches, recursive schemas return 400, and a 120,000-character schema limit is stated; strict false behaves as true for response_format.\n\n## Does the job, with a limit\n\nIt does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.\n\n- **Amazon Bedrock (Amazon Web Services, Inc.)**: Strict tool use and output_config.format validate against a JSON Schema 2020-12 subset server-side, but a new schema compiles for up to 90 seconds, every object needs additionalProperties false, and schemas are capped at 12 optional and 16 union-typed properties.\n- **Claude API (Anthropic, PBC)**: output_config.format json_schema and strict tools use a server grammar, with stop_reason refusal and max_tokens as signals. The docs admit an enum value differing only in case can pass with no error, so caller validation is still needed.\n- **BlockRun.AI (BlockRun, Inc.)**: response_format accepts json_object and json_schema and is forwarded to the upstream lab; the OpenAPI document has no strict field and no refusal path, so enforcement is whatever the upstream does.\n- **Cloudflare AI Gateway (Cloudflare, Inc.)**: No schema enforcement of its own; response_format passes through to the provider, so validity is the upstream's.\n- **Cloudflare Workers AI (Cloudflare, Inc.)**: JSON mode takes response_format json_schema on four listed models, one of which (llama-3.1-8b-instruct) is on the retirement list; no strict flag or refusal path is documented.\n- **DeepSeek API (Hangzhou DeepSeek Artificial Intelligence Co., Ltd.)**: response_format has json_object only, the caller must also ask for JSON in the prompt, and non-JSON output is replaced with spaces so the content comes back blank; schema enforcement exists only for tool arguments in beta strict mode.\n- **Eden AI (Eden AI SAS)**: response_format is forwarded and a json_heal hook can repair output against a json_schema after the call, but no strict flag or refusal field is documented.\n- **Glimpse (Elorian AI, Inc.)**: response_format and structured_outputs are in the endpoint's supported parameters and OpenRouter forwards strict json_schema, but enforcement is Together's and no refusal path is documented.\n- **Gemini Developer API (Google LLC)**: response_format json_schema constrains decoding, but several keywords (minimum, maxContains and others) are ignored and left to the client, and acc-06 saw one model wrap JSON in Markdown fences while Flash behaved.\n- **GroqCloud (Groq LLC)**: strict true uses constrained decoding and guarantees the schema, but only on select models; best-effort mode can return malformed JSON or 400 with failed_generation.\n- **Hugging Face Inference Providers (Hugging Face, Inc.)**: response_format json_schema is forwarded and the guide promises schema compliance, but supports_structured_output is true on only 102 of 247 provider endpoints and no refusal path is documented.\n- **LiteLLM (Berrie AI Incorporated)**: response_format json_schema is forwarded and get_supported_openai_params says whether a model takes it; enforcement is the provider's.\n- **Mistral AI API (Mistral AI (RCS Paris 952 418 325))**: response_format json_schema with strict true on all models except codestral-mamba; no refusal field is documented and the known-limitations page says JSON mode alone doesn't follow a schema.\n- **Muse Spark Open (Meta Platforms, Inc.)**: Meta's examples use response_format json_object on a hosted provider; schema enforcement depends on the serving stack and no strict flag or refusal path is documented.\n- **Nemotron 3.5 Super VL (NVIDIA Corporation)**: response_format accepts json_object and json_schema; no strict flag, refusal field or validation statement in the reference.\n- **Novita AI (Novita AI)**: json_schema response_format 'ensures the model will match your supplied JSON schema' on listed models; no strict flag or refusal field, and the listing's open question notes a FAQ that calls json_schema unsupported.\n- **OpenAI API (OpenAI OpCo, LLC)**: strict json_schema with a refusal content type and an incomplete status reason of max_output_tokens; acc-05 reports a schema that validated for weeks failing on 18 June 2026 with no changelog.\n- **OpenRouter (OpenRouter, Inc.)**: json_schema with strict true, but enforcement varies by provider; without require_parameters a request may land on a host that ignores it or fail for lack of support.\n- **Prism Inference (Prism Technologies Inc)**: JSON mode and strict JSON Schema on Chat Completions, with strict in the OpenAPI; no refusal field or validation statement, and no first-hand account.\n- **Router.com (Ramp Router) (Ramp Business Corporation)**: response_format json_object is translated natively; a strict json_schema path isn't shown in the pages read, and model refusals end the request without fallback.\n- **Beam 1.0 (Reflection AI)**: json_schema response_format with a strict mode, a refusal field and finish_reason length documented; there is no changelog, so schema stability over time can't be checked.\n- **RouterPlus (EVO HQ Inc)**: response_format works for GPT ids and open models, not Claude; on /v1/messages output_config.format maps to a strict json_schema for open models; no refusal path documented.\n- **SambaCloud (SambaNova Systems, Inc.)**: json_schema response_format on supported models, but strict is accepted for true and false and only enforced 'when strict enforcement is available', so validation stays with the caller.\n- **SiliconFlow (SiliconFlow Labs Pte. Ltd.)**: JSON Mode (json_object) only, on most models except DeepSeek R1 and V3; the guide says the app must handle incomplete JSON, and there is no json_schema or strict.\n- **Together AI Inference (Together Computer, Inc.)**: json_schema response_format on supported models, but the guide pairs it with prompt instructions and documents no strict flag or refusal field.\n- **xAI API (Grok) (SpaceXSI (xAI))**: json_schema response_format with strict true; structured outputs with tools only on supported Grok 4 models, and no refusal field in the pages read.\n\n## Couldn't check\n\nThe docs were closed to us, or silent. These carry no mark either way.\n\n- **Antseed (Antseed Foundation)**: No response_format or schema enforcement appears in the API or routing pages read.\n- **Jais 3 (Mohamed bin Zayed University of Artificial Intelligence (Institute of Foundation Models), with Inception42 (a G42 company))**: Schema enforcement would come from vLLM or SGLang guided decoding; the cards are silent.\n- **StepFun API (STEPFUN TECHNOLOGY (HK) LIMITED)**: The host platform.stepfun.ai closed the connection on every attempt (curl exit 56, no HTTP status) from this session, so no page was read.\n- **Tencent Cloud TokenHub (Tencent Cloud Computing (Beijing) Co., Ltd. (腾讯云计算（北京）有限责任公司))**: The host cloud.tencent.com closed the connection on every attempt (curl exit 56, no HTTP status) from this session, so no page was read.\n- **Vercel AI Gateway (Vercel Inc.)**: The structured output pages weren't opened; response_format passes through the OpenAI-compatible endpoint but strictness is the provider's.\n- **Vertex AI (Gemini Enterprise Agent Platform) (Google LLC)**: The structured output page returned 404 at the paths tried, so response_schema wasn't verified here.\n\n- not this job: MiniMax API (Nanonoble Pte. Ltd.): Neither OpenAPI file has response_format or a JSON schema mode, and the OpenAI-format schema also lacks tool_choice, so schema enforcement is the caller's job.\n- not this job: Simplismart (Verute Technologies Private Limited): No response_format or JSON mode in the OpenAPI file.\n- not this job: SWE-2 Flash (Cognition AI, Inc.): No API and no schema mode.\n\n6 listings in the category were added after this reading and aren't marked yet.\n\n## What stops agents finishing\n\n- server-side schema validator changes with no changelog, rejecting schemas that passed\n- model wraps JSON in Markdown fences on one model while siblings behave\n- strict flag accepted but ignored, so validation is the caller's job\n- stop sequences ignored, breaking the parser\n\n## Around it\n\nBefore: web-scrapers.page-to-markdown, document-extraction.pdf-to-text. After: vector-db.store, document-extraction.table-from-text.\n\n## Where this comes from\n\nWeight 10 of 100 in Model APIs \u0026 inference: 4 of 28 accounts; two are forum threads with a dozen users each reporting valid schemas that stopped validating\n\nAs data: https://www.anchorterminal.com/api/v1/use-cases/inference.structured-extraction.json, or the MCP tool get_use_case with id inference.structured-extraction. Draft, read 2026-11-12 from public docs and first-hand accounts, not yet reviewed by a person.\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "attributionRequired": true,
    "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-11-16",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "0.8",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run",
    "terms": "https://www.anchorterminal.com/terms/#data"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "For agents",
        "url": "https://www.anchorterminal.com/agents/"
      },
      {
        "name": "Niches",
        "url": "https://www.anchorterminal.com/niches/"
      },
      {
        "name": "Return JSON that matches a schema",
        "url": ""
      }
    ],
    "description": "Return JSON that matches a schema: 6 companies fully do it, 24 with a limit, 42 carry the tag. Every listing in Model APIs \u0026 inference with the reason and a source.",
    "facts": null,
    "h1": "Return JSON that matches a schema",
    "image": "https://www.anchorterminal.com/assets/og/default.png",
    "path": "/niches/inference.structured-extraction/",
    "published": "",
    "section": "agents",
    "title": "Return JSON that matches a schema: who does it | Anchor Terminal",
    "toc": null,
    "updated": "2026-11-15",
    "url": "https://www.anchorterminal.com/niches/inference.structured-extraction/"
  },
  "tokens": {
    "markdown": 2850,
    "slim": 630
  },
  "version": 1
}
