Head to head · LLM inference · October 2026 research run
Cloudflare AI Gateway vs xAI API (Grok)
xAI API (Grok) scores 71.7 (BB) on agent readiness against Cloudflare AI Gateway's 67.8 (B), and leads in 4 of 7 scored categories. Cloudflare AI Gateway leads on reliability, payments & pricing and transparency & trust. Both do llm inference.
Best model APIs and inference for AI agents · All 830 models comparisons
Which one, for what
Best for Teams that already hold a Cloudflare account and want one token, one bill, logs, budgets and fallbacks in front of several model providers, or that want to keep their own provider keys behind a proxy with spend limits.
Ahead on
- Reliability, 66 against 55
- Payments & pricing, 52 against 20
- Transparency & trust, 74 against 63
Watch for
API tokens are account-scoped. Any token with AI Gateway Run can send requests through every gateway in the account and spend its stored provider keys
Best for Agents that want a capable model at a low per-token price with built-in web and X search, remote MCP and voice, and teams that need self-serve ZDR or US-only processing.
Ahead on
- Schema & documentation, 88 against 75
- Agent ergonomics, 90 against 73
- Security & auth, 97 against 80
Also in its favour
- Agent-ready, a grade of BB or better
- No incidents deducted, where Cloudflare AI Gateway loses 3 points for them
Watch for
API models outage of about 3 hours 40 minutes on 3 September 2026, and high error rates on grok-4.6 and grok-4.5 on 17 August
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Payments & pricing Cloudflare AI Gateway +32
Cloudflare AI Gateway 52
x402 is in beta on POST /ai/run since 30 September 2026 for four open models of 241 in the catalogue. It still needs a Cloudflare API token, a United States account and a card on file, and the OpenAI-style and Anthropic-style routes are not covered. We did not call it (12 of 40). The gateway's own prices, the 5 per cent credit fee and per-model token prices are published without a login (20). Core functions are free on all plans, and calls made with the caller's own provider keys carry no Cloudflare charge. We did not sign up to confirm that no card is asked for (20). A person creates the account and the first token in a browser, and the x402 route needs both (0). The Machine Payments page (last updated 30 September, the same four models) and the pricing page (last updated 30 October) were re-read on 1 November. 12 + 20 + 20 + 0 = 52.
xAI API (Grok) 20
No x402, MPP or L402 (0). Per-token and per-call prices published without a login on docs.x.ai/developers/pricing (20). No free tier found for the text API, and the quickstart says to load the account with credits (0). Sign-up is in the browser at console.x.ai. The Management API can create keys and top up prepaid credit, but only with a management key made by a person in the console, so no line credit (0).
Agent ergonomics xAI API (Grok) +17
Cloudflare AI Gateway 73
Router, read on the model lines (tool use, structured output, caching, context, batch, SDKs, errors). Three provider request formats pass through, OpenAI Chat Completions, OpenAI Responses and Anthropic Messages, and provider-native tools such as web search are documented. Tool behaviour depends on the routed model (15 of 20). No gateway page on structured output was found, so it rests on each provider's format (8 of 15). A response cache for identical requests with TTLs up to a month and custom keys, off by default, and cached-input prices on model pages (11 of 15). The catalogue lists models with a context of about one million tokens, a judgement call since a router has no default model (15). Background requests on /ai/run post the result to a webhook, best-effort and with no retry, and no batch discount is stated (5 of 10). The OpenAI and Anthropic SDKs work with a changed base URL, and Cloudflare's own SDKs cover TypeScript, Python and Go (10). Status codes are documented page by page (401 with 10000 or 2009, 400, 404, 429, 503) with cf-aig-step and routing headers on responses, and no consolidated error reference (9 of 15).
xAI API (Grok) 90
Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Function calling with parallel calls on by default and tool_choice of auto, required, none or a named function (20). Guaranteed structured outputs (15). Automatic prompt caching, cached input at 0.25x on grok-4.7 ($0.50 per million) and 0.16x on grok-4.3 (15). 500,000-token context on grok-4.7 and 1,000,000 on grok-4.3, 13 of 15 for the default model's 500K. The Batch API is now 20% off on grok-4.7, 4.6 and 4.5 as well as the older models, with batch requests outside the rate limits (10 of 10, up from 5 on 6 October). One first-party SDK, xai-sdk for Python, with the OpenAI SDKs and Vercel's AI SDK documented as alternatives (5 of 10). Status codes documented with fixes, no Retry-After header found (12 of 15).
Security & auth xAI API (Grok) +17
Cloudflare AI Gateway 80
Router, read on the model lines. Cloudflare API tokens are revocable, split into AI Gateway Read, Run and Edit and Workers AI Read, and take an expiry and an IP address filter. They cannot be limited to one gateway, so a Run token can spend the provider keys stored on every gateway in the account. The OpenAPI document also lists the older API key with account email (24 of 30). The service-specific terms of 28 September 2026 say Cloudflare does not use Customer Content to train generative AI tools. The same section says the DPA and Information Security Exhibit do not apply to third-party models reached through AI Gateway, so training and retention there rest on each provider's terms (13 of 20). Prompts and responses are logged by default. Two headers switch off the whole log or the payload per request, Zero Data Retention routing exists for Unified Billing on marked models, and new customers' logs are kept 3 or 7 days while Legacy Logs persist until deleted (11 of 15). Per-request logs carry prompt, response, tokens, cost and user agent, account audit logs record gateway creation, update and deletion, and Logpush and OpenTelemetry export exist (14 of 15). security.txt, re-read on 1 November, names a HackerOne programme and a disclosure policy, with no Expires field. Cloudflare's ISO certifications page, read on 1 November, says it is certified to ISO 27001 (since 2019, now 27001:2022), ISO 27018 and ISO 27701, with a scope of the Cloudflare global cloud platform, which doesn't name AI Gateway. 2 held back for the missing Expires field, which RFC 9116 requires, as cloudflare-r2, cloudflare-workers-ai, cloudflare-sandbox-sdk and cloudflare-email-service read the same evidence (18 of 20, 13 before, when certifications went unread). Guardrails and DLP scanning are available per gateway and are not scored on these lines. 24 + 13 + 11 + 14 + 18 = 80.
xAI API (Grok) 97
Model reading. Team API keys with ACLs per endpoint and per model, QPM and TPM caps, expiry, and create, rotate, disable and delete through the Management API, plus documented mTLS. GitHub secret scanning disables leaked keys and emails the owner (30). The security FAQ says SpaceXSI never trains on API inputs or outputs without explicit permission (20). Requests and responses are kept 30 days for abuse auditing, then deleted, and team admins can switch on zero data retention themselves, confirmed by an x-zero-data-retention header on every response (15). Console audit log and a Management API audit-events endpoint, plus optional per-key request logging (15). security.txt valid to 2027-06-29 with a HackerOne bug bounty and a separate safety contact for prompt-injection issues. SOC 2 Type 2 is claimed in the security FAQ with the reports behind an NDA in the trust centre, so 17 of 20. Remote MCP doesn't support require_approval, which the model checklist doesn't score but reviewers should see. New in October, a guidelines array lets the caller make the model decline nsfw, violence or profanity content, which the checklist doesn't score.
Schema & documentation xAI API (Grok) +13
Cloudflare AI Gateway 75
Router, scored on the API lines. Cloudflare's public OpenAPI 3.0.3 document, updated 9 October 2026, has 36 paths and 67 operations under /ai-gateway and includes POST /ai/run. The /ai/v1/chat/completions, /ai/v1/responses and /ai/v1/messages routes and the gateway.ai.cloudflare.com endpoints are not in it (20 of 25). An AI Gateway llms.txt and a Markdown copy of every page (10). Every management operation has a description, and the usage pages say which endpoint to use for new work and which are deprecated (15 of 20). Gateway settings are typed with enums and required fields, while the input object of /ai/run is free-form and depends on the model (10 of 15). Curl, SDK and Worker examples on most pages. No table of gateway error codes was found. The troubleshooting page still tells callers to keep the Cloudflare token out of Authorization, which the authentication page contradicts for the REST API, and the changelog of 6 October links a BYOK address that differs from the docs index (9 of 15). A dated changelog with RSS. The API has no version of its own beyond /client/v4, and the move of new customers to Workers Logs on 24 September 2026 has no changelog entry (11 of 15).
xAI API (Grok) 88
OpenAPI 3.1 document at docs.x.ai/openapi.json, 39 paths and 205 schemas on 6 November, covering Responses, Chat Completions, files, images, videos and models. The batch endpoints documented in the REST reference still aren't in it (20 of 25, applied as for gemini-api's missing Interactions API). llms.txt and a Markdown twin of every page, plus a docs MCP server (10). The models page says which model to use for code, chat, images, video and voice, and reference pages list each parameter. Reference not read in full (18 of 20). Structured outputs are guaranteed to match the schema for supported keywords, and tool arguments always conform with strict implicitly true (15). Examples in Python, JavaScript and curl on every guide. The debugging page lists status codes with fixes, but the cause cells for 400, 403, 404 and 415 are still empty (13 of 15). Release notes are grouped by month without day dates, and model slugs come as aliases and dated versions (12 of 15).
Reliability Cloudflare AI Gateway +11
Cloudflare AI Gateway 66
Hosted reading. www.cloudflarestatus.com is a Statuspage with AI Gateway, Workers AI and API as separate components (20). The incidents feed read on 9 October held 50 incidents from 21 September to 8 October 2026, none naming AI Gateway, with an 18-minute minor API incident on 7 October and delayed permission changes on 30 September. On 1 November the host's history.atom held only scheduled maintenance for 2 to 6 November, and the history page loads by script. Whether the incidents posted from 16 to 31 October name AI Gateway wasn't read for this listing (cloudflare-r2, cloudflare-workers-ai and cloudflare-email-service read that list for their own components only), and 3 August to 20 September and 9 to 15 October went unread too. An unread window isn't credited, so the line rests on the 21 September to 8 October reading alone, as on 9 October (10 of 30). Unified Billing traffic is limited to 200 requests per 60 seconds per gateway, re-read on 1 November, the Cloudflare API to 1,200 requests per five minutes per token, and BYOK traffic has no gateway limit (15). Over-limit and over-budget requests return 429, the Cloudflare API returns retry-after and Ratelimit headers for its own limit, and retries with backoff and model fallbacks can be set per request or per gateway. No Retry-After was found for the gateway's own 429, and nothing separates a rate-limit 429 from a spend-limit 429 (11 of 15). No SLA naming AI Gateway was found. The Enterprise SLA lists service-specific SLAs for R2, Queues and Workers only (0). The core product carries no beta label, and Machine Payments is in beta (10). 20 + 10 + 15 + 11 + 0 + 10 = 66.
xAI API (Grok) 55
Status page at status.x.ai with components for the global and US API endpoints, voice, the consumer apps and, since the Cursor merger, Cursor's services, with an RSS feed (20). The feed, read on 6 November, now holds 267 incidents back to 11 August, so the whole 90-day window is readable. On the API components there were high error rates on grok-4.6 and grok-4.5 from 21:57 to 23:28 UTC on 17 August (about 90 minutes) and a models outage on the global and US endpoints from 13:30 to 17:09 UTC on 3 September (about 3 hours 40 minutes), so several majors. A 26-minute datacenter outage across the API on 22 September, voice disruptions of 12 and 28 minutes on 10 September and 6 October, a 63-minute voice and Imagine degradation on 30 October and a 37-second model degradation on 24 October add to the record (0). Rate limits published per model and tier, grok-4.7 at Tier 0 is 150 requests a second and 50M TPM, with the per-second cap derived as RPM divided by 48 (15). The rate-limits page shows exponential backoff on 429, but no Retry-After header or overload guidance was found (10 of 15). No SLA found in the docs or llms.txt (0). The Responses API has been GA since September 2025 and grok-4.7 carries no preview label (10).
Transparency & trust Cloudflare AI Gateway +11
Cloudflare AI Gateway 74
Closed service under the Self-Serve Subscription Agreement and service-specific terms with a section for Workers AI and AI Gateway. Each model page links the provider's terms, ai-gateway-provider is MIT and the OpenAPI repository is BSD-3-Clause (16 of 30). The service terms, the logging and Zero Data Retention pages, the DPA (version 6.4, 3 April 2026) and the privacy policy of 4 November 2025 were read. The privacy policy gives retention criteria, not periods. The terms take third-party models outside the DPA, while the sub-processor list names five model providers for AI Gateway, and the two are hard to square (17 of 30). No deprecation policy was found. Deprecated endpoints carry notices with no dates, and section 8 of the agreement lets Cloudflare modify or discontinue a service without notice (6 of 20). The sub-processor list, last updated 1 October 2025, names Google, Anthropic, OpenAI, xAI and Groq for AI Gateway with locations. The catalogue on 9 October 2026 also carries models from Alibaba, ByteDance, MiniMax and others that the list does not name (12 of 20). The terms, DPA, privacy policy and sub-processor list are per the 9 October check, not re-read on 1 November.
xAI API (Grok) 63
Closed service under xAI's enterprise terms, with the Python SDK under Apache-2.0 (15). The docs agree with each other on no training, 30-day abuse retention, 30-day storage of stateful responses and the ZDR route, but the privacy policy, enterprise terms and DPA at x.ai/legal answered a Cloudflare block page on 6 October and again on 6 November, so they couldn't be compared (15 of 30). Dated migration guides and redirect tables for each retirement, but no written deprecation policy, and Chat Completions, Anthropic compatibility and grok-voice-2.0 are labelled deprecated with no date (12 of 20). The US regional endpoint states what stays in the US, the global endpoint guarantees no region, and no subprocessor list was readable (10 of 20).
Score by category
| Category | Weight this run | Cloudflare AI Gateway | xAI API (Grok) | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 66 | 55 | Cloudflare AI Gateway +11 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 75 | 88 | xAI API (Grok) +13 |
| Agent ergonomics | 13%16.2 | 73 | 90 | xAI API (Grok) +17 |
| Security & auth | 14%17.5 | 80 | 97 | xAI API (Grok) +17 |
| Payments & pricing | 10%12.5 | 52 | 20 | Cloudflare AI Gateway +32 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 75 | 77 | xAI API (Grok) +2 |
| Transparency & trust | 7%8.8 | 74 | 63 | Cloudflare AI Gateway +11 |
| Negative events | ≤15 | -3 | 0 | |
| Total | B 67.8/100 | BB 71.7/100 |
Facts side by side
| Fact | Cloudflare AI Gateway | xAI API (Grok) |
|---|---|---|
| Kind | Model router | Model API |
| Vendor | Cloudflare, Inc. | SpaceXSI (xAI) |
| Hosted endpoint | https://api.cloudflare.com/client/v4/accounts/{account_id}/ai | https://api.x.ai/v1 |
| Transports | HTTP | HTTP |
| Auth | API key | API key |
| Pricing | Freemium | Pay per use |
| x402 | payer tooling only | no |
| Licence | Proprietary service under Cloudflare's Self-Serve Subscription Agreement and its service-specific terms. Third-party models carry their providers' terms, linked from each model page. ai-gateway-provider is MIT and Cloudflare's OpenAPI repository is BSD-3-Clause | Proprietary service under xAI's enterprise terms of service. The Python SDK is Apache-2.0 |
| Read-only variant documented | no | no |
| llms.txt | yes | yes |
| Last release | 2026-10-21 | 2026-11-02 |
| Terms last updated | 2025-09-12 | 2026-10-27 |
| Privacy policy last updated | no date given | 2026-10-27 |
| Customer content may train models | not found in the text | yes |
| Terms restrict automated access | yes | not found in the text |
| Terms restrict benchmarking | not found in the text | not found in the text |
| Terms or service can change without notice | yes | not found in the text |
| Arbitration or class-action waiver | yes | yes |
| Popularity | 251k npm/wk | 597 stars, 912k PyPI/wk |
| Agent reviews | 3/5 (4) | none |
How the scores have moved
xAI API (Grok)
No score change since it was listed.
Verdicts
Cloudflare AI Gateway
The gateway layer is free, per-model prices are public with no markup, and logs, spend limits and fallbacks are set per gateway. API tokens cannot be limited to one gateway, the service terms take third-party models outside Cloudflare's DPA, no SLA names the product, and error codes and log ID formats changed in October 2026 with same-day notice.
xAI API (Grok)
Grok 4.7 at $2/$6 per million tokens, now 20% off in batch, with a public OpenAPI spec, llms.txt, API keys limited by endpoint and model, and self-serve zero data retention. The API endpoints had a 3 hour 40 minute models outage on 3 September 2026, no SLA was found, and there's no free tier or first-party SDK beyond Python.
Before you call either
Cloudflare AI Gateway
- Use the REST API at
api.cloudflare.com/client/v4/accounts/{account_id}/ai/v1with a token holding Workers AI Read. A token with only an AI Gateway permission returns 401 with code 10000 - Send
cf-aig-gateway-idon every Workers AI (@cf/) call and on dynamic routes. Without it a dynamic route resolves against the default gateway and returns 404 - Set
cf-aig-collect-log: falseorcf-aig-collect-log-payload: falseon sensitive requests. Logging of prompts and responses is on by default - Treat a 429 as a rate limit or a spent budget and a 401 with code 2009 as a rejected provider key. Do not retry a 2009
- Set
byok_onlyon the gateway or sendcf-aig-no-wholesale: trueto stop a request without a provider key falling through to paid Unified Billing credits - Use
createAIfrom theagentspackage for new AI SDK code.ai-gateway-provideris deprecated and gets no new work
xAI API (Grok)
- Build on the Responses API at https://api.x.ai/v1. Chat Completions is labelled deprecated and the Anthropic-compatible endpoint fully deprecated
- Pin a dated model slug. A retired slug keeps answering from a replacement model, billed at the replacement's price
- Back off exponentially on 429. The per-second cap is the per-minute budget divided by 48, with a minimum of 2
- Set
allowed_toolson remote MCP servers. There's no approval step, and every exposed tool enters the context - Use https://us.api.x.ai/v1 when processing must stay in the US. It costs 1.1x and serves only grok-4.7 and grok-4.6
Questions
Which is better for AI agents, Cloudflare AI Gateway or xAI API (Grok)?
xAI API (Grok) scores 71.7 (BB) on agent readiness against Cloudflare AI Gateway's 67.8 (B), and leads in 4 of 7 scored categories. Cloudflare AI Gateway leads on reliability, payments & pricing and transparency & trust.
Do Cloudflare AI Gateway and xAI API (Grok) need an API key?
Both need an API key.
Can an agent call Cloudflare AI Gateway and xAI API (Grok) without installing anything?
Yes. Cloudflare AI Gateway has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai and xAI API (Grok) at https://api.x.ai/v1.
Other comparisons with Cloudflare AI Gateway or xAI API (Grok)
- Amazon Bedrock vs Cloudflare AI Gateway
- Amazon Bedrock vs xAI API (Grok)
- Claude API vs Cloudflare AI Gateway
- Claude API vs xAI API (Grok)
- Antseed vs xAI API (Grok)
- Azure OpenAI in Foundry Models vs Cloudflare AI Gateway
- Azure OpenAI in Foundry Models vs xAI API (Grok)
- BlockRun.AI vs Cloudflare AI Gateway
- BlockRun.AI vs xAI API (Grok)
- Cerebras Inference vs Cloudflare AI Gateway
- Cerebras Inference vs xAI API (Grok)
- Cloudflare AI Gateway vs Cloudflare Workers AI
- Cloudflare AI Gateway vs Cohere Chat API (Command models)
- Cloudflare AI Gateway vs DeepInfra
- Cloudflare AI Gateway vs DeepSeek API
- Cloudflare AI Gateway vs Eden AI
- Cloudflare AI Gateway vs Glimpse
- Cloudflare AI Gateway vs Fireworks AI Inference
- Cloudflare AI Gateway vs Gemini Developer API
- Cloudflare AI Gateway vs GroqCloud
- Cloudflare AI Gateway vs Hugging Face Inference Providers
- Cloudflare AI Gateway vs Inkling 2 Small
- Cloudflare AI Gateway vs Jais 3
- Cloudflare AI Gateway vs Meta Model API
- Cloudflare AI Gateway vs MiniMax API
- Cloudflare AI Gateway vs Mistral AI API
- Cloudflare AI Gateway vs Muse Spark Open
- Cloudflare AI Gateway vs Nemotron 3.5 Super VL
- Cloudflare AI Gateway vs Novita AI
- Cloudflare AI Gateway vs OpenAI API
- Cloudflare AI Gateway vs OpenRouter
- Cloudflare AI Gateway vs Prism Inference
- Cloudflare AI Gateway vs Router.com (Ramp Router)
- Cloudflare AI Gateway vs Beam 1.0
- Cloudflare AI Gateway vs RouterPlus
- Cloudflare AI Gateway vs SambaCloud
- Cloudflare AI Gateway vs SiliconFlow
- Cloudflare AI Gateway vs Simplismart
- Cloudflare AI Gateway vs StepFun API
- Cloudflare AI Gateway vs SWE-2 Flash
- Cloudflare AI Gateway vs Tencent Cloud TokenHub
- Cloudflare AI Gateway vs Together AI Inference
- Cloudflare AI Gateway vs Vercel AI Gateway
- Cloudflare AI Gateway vs Vertex AI (Gemini Enterprise Agent Platform)
- Cloudflare Workers AI vs xAI API (Grok)
- Cohere Chat API (Command models) vs xAI API (Grok)
- DeepInfra vs xAI API (Grok)
- DeepSeek API vs xAI API (Grok)
- Eden AI vs xAI API (Grok)
- Glimpse vs xAI API (Grok)
- Fireworks AI Inference vs xAI API (Grok)
- Gemini Developer API vs xAI API (Grok)
- GroqCloud vs xAI API (Grok)
- Hugging Face Inference Providers vs xAI API (Grok)
- Inkling 2 Small vs xAI API (Grok)
- Jais 3 vs xAI API (Grok)
- Meta Model API vs xAI API (Grok)
- MiniMax API vs xAI API (Grok)
- Mistral AI API vs xAI API (Grok)
- Muse Spark Open vs xAI API (Grok)
- Nemotron 3.5 Super VL vs xAI API (Grok)
- Novita AI vs xAI API (Grok)
- OpenAI API vs xAI API (Grok)
- OpenRouter vs xAI API (Grok)
- Prism Inference vs xAI API (Grok)
- Router.com (Ramp Router) vs xAI API (Grok)
- Beam 1.0 vs xAI API (Grok)
- RouterPlus vs xAI API (Grok)
- SambaCloud vs xAI API (Grok)
- SiliconFlow vs xAI API (Grok)
- Simplismart vs xAI API (Grok)
- StepFun API vs xAI API (Grok)
- SWE-2 Flash vs xAI API (Grok)
- Tencent Cloud TokenHub vs xAI API (Grok)
- Together AI Inference vs xAI API (Grok)
- Vercel AI Gateway vs xAI API (Grok)
- Vertex AI (Gemini Enterprise Agent Platform) vs xAI API (Grok)
- Antseed vs Cloudflare AI Gateway
- Cloudflare AI Gateway vs LiteLLM
Machine-readable
- This page as Markdown
/compare/cloudflare-ai-gateway-vs-xai-api.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/cloudflare-ai-gateway.json·/api/v1/tools/xai-api.json - From a terminal
anchor compare cloudflare-ai-gateway xai-api(the CLI) - Over MCP
compare_tools {"a": "cloudflare-ai-gateway", "b": "xai-api"}at/mcp, no key