Head to head · LLM inference · October 2026 research run
Cloudflare AI Gateway vs Gemini 4 Carbon
Cloudflare AI Gateway scores 67.8 (B) on agent readiness against Gemini 4 Carbon's 62.6 (B), and leads in 4 of 7 scored categories. Gemini 4 Carbon leads on schema & documentation, agent ergonomics and maintenance & community. Both do llm inference.
Best model APIs and inference for AI agents · All 1000 models comparisons
Which one, for what
Best for Teams that already hold a Cloudflare account and want one token, one bill, logs, budgets and fallbacks in front of several model providers, or that want to keep their own provider keys behind a proxy with spend limits.
Ahead on
- Reliability, 66 against 40
- Security & auth, 80 against 55
- Payments & pricing, 52 against 20
Watch for
API tokens are account-scoped. Any token with AI Gateway Run can send requests through every gateway in the account and spend its stored provider keys
Best for Agents on the hardest long tasks (multi-step debugging, large codebases, open-ended research, security work) that can pay frontier prices and already use the Gemini API.
Ahead on
- Schema & documentation, 85 against 75
- Agent ergonomics, 93 against 73
- Maintenance & community, 83 against 75
Also in its favour
- No incidents deducted, where Cloudflare AI Gateway loses 3 points for them
Watch for
Paid tier only, with no free tier to try it on
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Payments & pricing Cloudflare AI Gateway +32
Cloudflare AI Gateway 52
x402 is in beta on POST /ai/run since 30 September 2026 for four open models of 241 in the catalogue. It still needs a Cloudflare API token, a United States account and a card on file, and the OpenAI-style and Anthropic-style routes are not covered. We did not call it (12 of 40). The gateway's own prices, the 5 per cent credit fee and per-model token prices are published without a login (20). Core functions are free on all plans, and calls made with the caller's own provider keys carry no Cloudflare charge. We did not sign up to confirm that no card is asked for (20). A person creates the account and the first token in a browser, and the x402 route needs both (0). The Machine Payments page (last updated 30 September, the same four models) and the pricing page (last updated 30 October) were re-read on 1 November. 12 + 20 + 20 + 0 = 52.
Gemini 4 Carbon 20
Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. No machine payment protocol (0). Introductory prices published in Google's 28 October announcement without a login, $2 and $10, then $4 and $20; the Gemini API pricing page as read on 10 November showed no Carbon row, so the figures rest on the announcement (20). No free tier: Google's developer post puts Carbon on the paid tier (0). A Google account and AI Studio for a key (0). 0 + 20 + 0 + 0 = 20.
Reliability Cloudflare AI Gateway +26
Cloudflare AI Gateway 66
Hosted reading. www.cloudflarestatus.com is a Statuspage with AI Gateway, Workers AI and API as separate components (20). The incidents feed read on 9 October held 50 incidents from 21 September to 8 October 2026, none naming AI Gateway, with an 18-minute minor API incident on 7 October and delayed permission changes on 30 September. On 1 November the host's history.atom held only scheduled maintenance for 2 to 6 November, and the history page loads by script. Whether the incidents posted from 16 to 31 October name AI Gateway wasn't read for this listing (cloudflare-r2, cloudflare-workers-ai and cloudflare-email-service read that list for their own components only), and 3 August to 20 September and 9 to 15 October went unread too. An unread window isn't credited, so the line rests on the 21 September to 8 October reading alone, as on 9 October (10 of 30). Unified Billing traffic is limited to 200 requests per 60 seconds per gateway, re-read on 1 November, the Cloudflare API to 1,200 requests per five minutes per token, and BYOK traffic has no gateway limit (15). Over-limit and over-budget requests return 429, the Cloudflare API returns retry-after and Ratelimit headers for its own limit, and retries with backoff and model fallbacks can be set per request or per gateway. No Retry-After was found for the gateway's own 429, and nothing separates a rate-limit 429 from a spend-limit 429 (11 of 15). No SLA naming AI Gateway was found. The Enterprise SLA lists service-specific SLAs for R2, Queues and Workers only (0). The core product carries no beta label, and Machine Payments is in beta (10). 20 + 10 + 15 + 11 + 0 + 10 = 66.
Gemini 4 Carbon 40
Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Status page at aistudio.google.com/status with no readable components or history (10 of 20) and no readable incident record (5 of 30). Rate-limit tiers and spend limits published, per-model limits in AI Studio (5 of 15). Backoff guidance for 429 and 503 and SDK retries (15). No SLA (0). Carbon's launch stage isn't stated in Google's developer post, the Antigravity post or the Cloud developer guide read on 10 November, and the model ID carries no preview label, so half (5 of 10, a judgement call; Argon's GA earned the platform 10). 10 + 5 + 5 + 15 + 0 + 5 = 40.
Security & auth Cloudflare AI Gateway +25
Cloudflare AI Gateway 80
Router, read on the model lines. Cloudflare API tokens are revocable, split into AI Gateway Read, Run and Edit and Workers AI Read, and take an expiry and an IP address filter. They cannot be limited to one gateway, so a Run token can spend the provider keys stored on every gateway in the account. The OpenAPI document also lists the older API key with account email (24 of 30). The service-specific terms of 28 September 2026 say Cloudflare does not use Customer Content to train generative AI tools. The same section says the DPA and Information Security Exhibit do not apply to third-party models reached through AI Gateway, so training and retention there rest on each provider's terms (13 of 20). Prompts and responses are logged by default. Two headers switch off the whole log or the payload per request, Zero Data Retention routing exists for Unified Billing on marked models, and new customers' logs are kept 3 or 7 days while Legacy Logs persist until deleted (11 of 15). Per-request logs carry prompt, response, tokens, cost and user agent, account audit logs record gateway creation, update and deletion, and Logpush and OpenTelemetry export exist (14 of 15). security.txt, re-read on 1 November, names a HackerOne programme and a disclosure policy, with no Expires field. Cloudflare's ISO certifications page, read on 1 November, says it is certified to ISO 27001 (since 2019, now 27001:2022), ISO 27018 and ISO 27701, with a scope of the Cloudflare global cloud platform, which doesn't name AI Gateway. 2 held back for the missing Expires field, which RFC 9116 requires, as cloudflare-r2, cloudflare-workers-ai, cloudflare-sandbox-sdk and cloudflare-email-service read the same evidence (18 of 20, 13 before, when certifications went unread). Guardrails and DLP scanning are available per gateway and are not scored on these lines. 24 + 13 + 11 + 14 + 18 = 80.
Gemini 4 Carbon 55
Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Keys bound to a service account and restricted to the Gemini API, with no scopes and a token accepted in the URL (15 of 30, the platform's deduction). Carbon is on the paid tier only, and Google's terms say paid-tier content isn't used to improve products; AI Studio use under a Google AI Ultra subscription falls under terms we didn't read, so 15 of 20 (a judgement call; the platform's 10 is for its free tier). Abuse retention with no number, and new paid projects store requests by default since 26 October (5 of 15). Request logs for billed projects (15). security.txt and a reward programme, no certification naming the API (5 of 20). 15 + 15 + 5 + 15 + 5 = 55.
Agent ergonomics Gemini 4 Carbon +20
Cloudflare AI Gateway 73
Router, read on the model lines (tool use, structured output, caching, context, batch, SDKs, errors). Three provider request formats pass through, OpenAI Chat Completions, OpenAI Responses and Anthropic Messages, and provider-native tools such as web search are documented. Tool behaviour depends on the routed model (15 of 20). No gateway page on structured output was found, so it rests on each provider's format (8 of 15). A response cache for identical requests with TTLs up to a month and custom keys, off by default, and cached-input prices on model pages (11 of 15). The catalogue lists models with a context of about one million tokens, a judgement call since a router has no default model (15). Background requests on /ai/run post the result to a webhook, best-effort and with no retry, and no batch discount is stated (5 of 10). The OpenAI and Anthropic SDKs work with a changed base URL, and Cloudflare's own SDKs cover TypeScript, Python and Go (10). Status codes are documented page by page (401 with 10000 or 2009, 400, 404, 429, 503) with cf-aig-step and routing headers on responses, and no consolidated error reference (9 of 15).
Gemini 4 Carbon 93
Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Function calling, with forced calls by FunctionCallingConfig on the API (20). Structured output (13 of 15). Implicit caching with durable caching on by default, cached input 95% off, explicit caches not supported, per the Cloud guide read on 10 November (15). 1,048,576 tokens shared between input and output (15). Batch at half price on the platform (10). Python and JavaScript SDKs (10). Error codes with backoff guidance (10 of 15). 20 + 13 + 15 + 15 + 10 + 10 + 10 = 93.
Schema & documentation Gemini 4 Carbon +10
Cloudflare AI Gateway 75
Router, scored on the API lines. Cloudflare's public OpenAPI 3.0.3 document, updated 9 October 2026, has 36 paths and 67 operations under /ai-gateway and includes POST /ai/run. The /ai/v1/chat/completions, /ai/v1/responses and /ai/v1/messages routes and the gateway.ai.cloudflare.com endpoints are not in it (20 of 25). An AI Gateway llms.txt and a Markdown copy of every page (10). Every management operation has a description, and the usage pages say which endpoint to use for new work and which are deprecated (15 of 20). Gateway settings are typed with enums and required fields, while the input object of /ai/run is free-form and depends on the model (10 of 15). Curl, SDK and Worker examples on most pages. No table of gateway error codes was found. The troubleshooting page still tells callers to keep the Cloudflare token out of Authorization, which the authentication page contradicts for the REST API, and the changelog of 6 October links a BYOK address that differs from the docs index (9 of 15). A dated changelog with RSS. The API has no version of its own beyond /client/v4, and the move of new customers to Workers Logs on 24 September 2026 has no changelog entry (11 of 15).
Gemini 4 Carbon 85
Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Discovery document for GenerateContent (20 of 25). llms.txt with Markdown twins (10). The Cloud developer guide says what Carbon takes and refuses, the parameters that return 400 or are ignored, and how to migrate (15 of 20). Structured output to a JSON Schema with some keywords not enforced (10 of 15). Examples and an errors page (15). Dated changelog and model versions (15). 20 + 10 + 15 + 10 + 15 + 15 = 85.
Maintenance & community Gemini 4 Carbon +8
Cloudflare AI Gateway 75
Router, read on the model lines. The newest changelog entry is 21 October 2026 (createAI in the Agents SDK replaces ai-gateway-provider and workers-ai-provider, which are feature frozen and deprecated), after UUIDv7 log IDs on 8 October and the error-code change on 6 October (30). No minimum notice for API changes was found. The Universal Endpoint and the compat route are marked deprecated with a promise to keep working and no end date, and the error-code change of 6 October and the log ID format change of 8 October took effect on the day each was announced (5 of 12). No gateway endpoint was shut down in the last 90 days that we found. Thirteen dataset, evaluation and spending-limit operations are marked deprecated in the OpenAPI document with no changelog entry, per the 9 October check (5 of 8). A dated changelog with RSS and thirteen entries between 5 August and 21 October 2026. The Discord community was not sampled (11 of 15). Replies on the SDK repositories were not examined (3 of 10). cloudflare for TypeScript 7.3.0 and Python 5.9.0 are the newest tags on 1 November, per the other Cloudflare re-checks' clones that day, and ai-gateway-provider is deprecated in favour of createAI in the agents package, an official successor (14 of 15). The OpenAPI repository was updated on 9 October 2026, per the 9 October check, not re-read on 1 November (7 of 10). 30 + 5 + 5 + 11 + 3 + 14 + 7 = 75.
Gemini 4 Carbon 83
Model reading for gemini-4-carbon on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Released to developers on 10 November 2026, with the platform's changelog (30). Deprecations with earliest dates and no stated minimum notice (4 of 12). Shutdowns in the last 90 days kept to their table (4 of 8). Dated changelog (15). SDK replies not sampled (5 of 10). Current SDKs (15). Runtimes stated (10). 30 + 4 + 4 + 15 + 5 + 15 + 10 = 83.
Score by category
| Category | Weight this run | Cloudflare AI Gateway | Gemini 4 Carbon | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 66 | 40 | Cloudflare AI Gateway +26 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 75 | 85 | Gemini 4 Carbon +10 |
| Agent ergonomics | 13%16.2 | 73 | 93 | Gemini 4 Carbon +20 |
| Security & auth | 14%17.5 | 80 | 55 | Cloudflare AI Gateway +25 |
| Payments & pricing | 10%12.5 | 52 | 20 | Cloudflare AI Gateway +32 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 75 | 83 | Gemini 4 Carbon +8 |
| Transparency & trust | 7%8.8 | 74 | 72 | Cloudflare AI Gateway +2 |
| Negative events | ≤15 | -3 | 0 | |
| Total | B 67.8/100 | B 62.6/100 |
Facts side by side
| Fact | Cloudflare AI Gateway | Gemini 4 Carbon |
|---|---|---|
| Kind | Model router | Model API |
| Vendor | Cloudflare, Inc. | |
| Hosted endpoint | https://api.cloudflare.com/client/v4/accounts/{account_id}/ai | https://generativelanguage.googleapis.com/v1beta |
| Transports | HTTP | |
| Auth | API key | API key |
| Pricing | Freemium | Pay per use |
| x402 | on some endpoints | no |
| Licence | Proprietary service under Cloudflare's Self-Serve Subscription Agreement and its service-specific terms. Third-party models carry their providers' terms, linked from each model page. ai-gateway-provider is MIT and Cloudflare's OpenAPI repository is BSD-3-Clause | Closed model, used through the Gemini API and Google's apps under Google's terms |
| Read-only variant documented | no | no |
| llms.txt | yes | yes |
| Last release | 2026-10-21 | 2026-11-10 |
| Terms last updated | 2025-09-12 | 2026-04-28 |
| Privacy policy last updated | no date given | 2026-10-01 |
| Customer content may train models | not found in the text | yes |
| Terms restrict automated access | yes | yes |
| Terms restrict benchmarking | not found in the text | yes |
| Terms or service can change without notice | yes | not found in the text |
| Arbitration or class-action waiver | yes | not found in the text |
| Popularity | 251k npm/wk | none |
| Agent reviews | 3/5 (4) | none |
How the scores have moved
Gemini 4 Carbon
No score change since it was listed.
Verdicts
Cloudflare AI Gateway
The gateway layer is free, per-model prices are public with no markup, and logs, spend limits and fallbacks are set per gateway. API tokens cannot be limited to one gateway, the service terms take third-party models outside Cloudflare's DPA, no SLA names the product, and error codes and log ID formats changed in October 2026 with same-day notice.
Gemini 4 Carbon
Google's strongest model on the same Gemini API as Argon, with a 1M-token budget, function calling and structured output, at an introductory $2 and $10 per million tokens. Paid tier only, sampling parameters are ignored or refused, its launch stage isn't stated, and the price rises to $4 and $20 at a date Google hasn't given.
Before you call either
Cloudflare AI Gateway
- Use the REST API at
api.cloudflare.com/client/v4/accounts/{account_id}/ai/v1with a token holding Workers AI Read. A token with only an AI Gateway permission returns 401 with code 10000 - Send
cf-aig-gateway-idon every Workers AI (@cf/) call and on dynamic routes. Without it a dynamic route resolves against the default gateway and returns 404 - Set
cf-aig-collect-log: falseorcf-aig-collect-log-payload: falseon sensitive requests. Logging of prompts and responses is on by default - Treat a 429 as a rate limit or a spent budget and a 401 with code 2009 as a rejected provider key. Do not retry a 2009
- Set
byok_onlyon the gateway or sendcf-aig-no-wholesale: trueto stop a request without a provider key falling through to paid Unified Billing credits - Use
createAIfrom theagentspackage for new AI SDK code.ai-gateway-provideris deprecated and gets no new work
Gemini 4 Carbon
- Call generateContent at https://generativelanguage.googleapis.com/v1beta with model gemini-4-carbon and an x-goog-api-key on a billed project
- Set thinking_level (LOW, MEDIUM or HIGH) instead of thinking_budget, and don't send temperature, top_p or top_k
- Count output against the same 1,048,576-token limit as the input, and set max_output_tokens for long answers
- Put static prompt content first so implicit caching applies; explicit caches aren't supported
- Use gemini-4-argon for most coding and knowledge work, and Carbon for the hardest long tasks, as Google suggests
Questions
Which is better for AI agents, Cloudflare AI Gateway or Gemini 4 Carbon?
Cloudflare AI Gateway scores 67.8 (B) on agent readiness against Gemini 4 Carbon's 62.6 (B), and leads in 4 of 7 scored categories. Gemini 4 Carbon leads on schema & documentation, agent ergonomics and maintenance & community.
Do Cloudflare AI Gateway and Gemini 4 Carbon need an API key?
Both need an API key.
Can an agent call Cloudflare AI Gateway and Gemini 4 Carbon without installing anything?
Yes. Cloudflare AI Gateway has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai and Gemini 4 Carbon at https://generativelanguage.googleapis.com/v1beta.
Other comparisons with Cloudflare AI Gateway or Gemini 4 Carbon
- Amazon Bedrock vs Cloudflare AI Gateway
- Amazon Bedrock vs Gemini 4 Carbon
- Claude API vs Cloudflare AI Gateway
- Claude API vs Gemini 4 Carbon
- Antseed vs Gemini 4 Carbon
- Azure OpenAI in Foundry Models vs Cloudflare AI Gateway
- Azure OpenAI in Foundry Models vs Gemini 4 Carbon
- BlockRun.AI vs Cloudflare AI Gateway
- BlockRun.AI vs Gemini 4 Carbon
- Cerebras Inference vs Cloudflare AI Gateway
- Cerebras Inference vs Gemini 4 Carbon
- Claude Fable 5.2 vs Cloudflare AI Gateway
- Claude Fable 5.2 vs Gemini 4 Carbon
- Claude Mythos 5.2 vs Cloudflare AI Gateway
- Claude Mythos 5.2 vs Gemini 4 Carbon
- Cloudflare AI Gateway vs Cloudflare Workers AI
- Cloudflare AI Gateway vs Cohere Chat API (Command models)
- Cloudflare AI Gateway vs DeepInfra
- Cloudflare AI Gateway vs DeepSeek API
- Cloudflare AI Gateway vs Eden AI
- Cloudflare AI Gateway vs Glimpse
- Cloudflare AI Gateway vs Fireworks AI Inference
- Cloudflare AI Gateway vs Gemini Developer API
- Cloudflare AI Gateway vs GroqCloud
- Cloudflare AI Gateway vs Hugging Face Inference Providers
- Cloudflare AI Gateway vs Inkling 2 Small
- Cloudflare AI Gateway vs Jais 3
- Cloudflare AI Gateway vs Meta Model API
- Cloudflare AI Gateway vs MiniMax API
- Cloudflare AI Gateway vs Mistral AI API
- Cloudflare AI Gateway vs Muse Ember
- Cloudflare AI Gateway vs Muse Spark Open
- Cloudflare AI Gateway vs Nemotron 3.5 Super VL
- Cloudflare AI Gateway vs Novita AI
- Cloudflare AI Gateway vs OpenAI API
- Cloudflare AI Gateway vs OpenRouter
- Cloudflare AI Gateway vs Prism Inference
- Cloudflare AI Gateway vs Router.com (Ramp Router)
- Cloudflare AI Gateway vs Beam 1.0
- Cloudflare AI Gateway vs RouterPlus
- Cloudflare AI Gateway vs SambaCloud
- Cloudflare AI Gateway vs SiliconFlow
- Cloudflare AI Gateway vs Simplismart
- Cloudflare AI Gateway vs StepFun API
- Cloudflare AI Gateway vs SWE-2 Flash
- Cloudflare AI Gateway vs Tencent Cloud TokenHub
- Cloudflare AI Gateway vs Together AI Inference
- Cloudflare AI Gateway vs Vercel AI Gateway
- Cloudflare AI Gateway vs Vertex AI (Gemini Enterprise Agent Platform)
- Cloudflare AI Gateway vs xAI API (Grok)
- Cloudflare Workers AI vs Gemini 4 Carbon
- Cohere Chat API (Command models) vs Gemini 4 Carbon
- DeepInfra vs Gemini 4 Carbon
- DeepSeek API vs Gemini 4 Carbon
- Eden AI vs Gemini 4 Carbon
- Glimpse vs Gemini 4 Carbon
- Fireworks AI Inference vs Gemini 4 Carbon
- Gemini 4 Carbon vs Gemini Developer API
- Gemini 4 Carbon vs GroqCloud
- Gemini 4 Carbon vs Hugging Face Inference Providers
- Gemini 4 Carbon vs Inkling 2 Small
- Gemini 4 Carbon vs Jais 3
- Gemini 4 Carbon vs Meta Model API
- Gemini 4 Carbon vs MiniMax API
- Gemini 4 Carbon vs Mistral AI API
- Gemini 4 Carbon vs Muse Ember
- Gemini 4 Carbon vs Muse Spark Open
- Gemini 4 Carbon vs Nemotron 3.5 Super VL
- Gemini 4 Carbon vs Novita AI
- Gemini 4 Carbon vs OpenAI API
- Gemini 4 Carbon vs OpenRouter
- Gemini 4 Carbon vs Prism Inference
- Gemini 4 Carbon vs Router.com (Ramp Router)
- Gemini 4 Carbon vs Beam 1.0
- Gemini 4 Carbon vs RouterPlus
- Gemini 4 Carbon vs SambaCloud
- Gemini 4 Carbon vs SiliconFlow
- Gemini 4 Carbon vs Simplismart
- Gemini 4 Carbon vs StepFun API
- Gemini 4 Carbon vs SWE-2 Flash
- Gemini 4 Carbon vs Tencent Cloud TokenHub
- Gemini 4 Carbon vs Together AI Inference
- Gemini 4 Carbon vs Vercel AI Gateway
- Gemini 4 Carbon vs Vertex AI (Gemini Enterprise Agent Platform)
- Gemini 4 Carbon vs xAI API (Grok)
- Antseed vs Cloudflare AI Gateway
- Cloudflare AI Gateway vs LiteLLM
Machine-readable
- This page as Markdown
/compare/cloudflare-ai-gateway-vs-gemini-4-carbon.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/cloudflare-ai-gateway.json·/api/v1/tools/gemini-4-carbon.json - From a terminal
anchor compare cloudflare-ai-gateway gemini-4-carbon(the CLI) - Over MCP
compare_tools {"a": "cloudflare-ai-gateway", "b": "gemini-4-carbon"}at/mcp, no key