Head to head · LLM inference · October 2026 research run

Cloudflare Workers AI vs Gemini 4 Hydrogen

Cloudflare Workers AI scores 70.6 (BB) on agent readiness against Gemini 4 Hydrogen's 64.9 (B), and leads in 4 of 7 scored categories. Gemini 4 Hydrogen leads on schema & documentation, agent ergonomics and maintenance & community. Both do llm inference.

Best model APIs and inference for AI agents · All 1044 models comparisons

Which one, for what

Cloudflare Workers AI BB

Best for Agents that already run on Cloudflare Workers, or that want open-weight chat, embedding, reranking, speech and image models behind one token with a free daily allowance.

Ahead on

  • Reliability, 68 against 45
  • Security & auth, 80 against 50
  • Payments & pricing, 63 against 40

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

No SLA for Workers AI was found in the docs or the agreements read

Gemini 4 Hydrogen B

Best for Agents doing everyday coding, tool calls and document work at volume on the Gemini API, including ones that need to start on a free key, or as the executor beside Carbon or Argon.

Ahead on

  • Schema & documentation, 85 against 80
  • Agent ergonomics, 90 against 75
  • Maintenance & community, 85 against 72

Also in its favour

  • No incidents deducted, where Cloudflare Workers AI loses 3 points for them

Watch for

temperature, top_p and top_k are ignored, and thinking_budget, MINIMAL, penalties and extra candidates return a 400

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Security & auth Cloudflare Workers AI +30

Cloudflare Workers AI 80

Model reading. Cloudflare API tokens are revocable, limited to Workers AI Read or Edit on chosen accounts, and take an expiry and an IP address filter. Permission is per account, not per model, and the API reference also accepts the older global API key (27 of 30). The data usage page and the service-specific terms of 28 September 2026 say Customer Content is not used to train models without consent. The data page adds that it is not used to improve services, while clause 9 of the same terms section allows use as needed to provide and improve the Services (17 of 20). The data page says content may be stored if a storage service is used with Workers AI. It gives no retention period for inference inputs and no explicit zero-retention statement, and AI Gateway logs prompts and responses by default when a call is routed through a gateway (9 of 15). Gateway logs record prompt, response, tokens and cost per request, and the dashboard shows neuron usage. Direct calls have no per-request log that we found, and account audit logs were not read this run (9 of 15). security.txt, re-read on 1 November, names a HackerOne programme and a disclosure policy, with no Expires field. Cloudflare's ISO certifications page, read on 1 November, says Cloudflare is certified to ISO 27001 (since 2019, now to its 2022 edition), ISO 27018 and ISO 27701, with a scope of the Cloudflare global cloud platform, which doesn't name Workers AI. 2 held back for the missing Expires field, which RFC 9116 requires, the reading cloudflare-r2 gave the same evidence on 1 November (18 of 20, 15 before, when certifications went unread). 27 + 17 + 9 + 9 + 18 = 80.

Gemini 4 Hydrogen 50

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Keys bound to a service account and restricted to the Gemini API, with no scopes and a token accepted in the URL (15 of 30, the platform's deduction). Hydrogen is on the free tier, where Google's terms say content is used to improve products and may be read by humans; paid-tier content isn't (10 of 20, the platform's reading; Carbon, paid tier only, got 15). Abuse retention has no number and new paid projects store requests by default since 26 October; Google's prompt-injection figure (2.3 times more resilient on Gray Swan's benchmark) is its own, and the model card says jailbreak resistance is still being improved (5 of 15). Request logs for billed projects (15). security.txt and a reward programme, no certification naming the API (5 of 20). 15 + 10 + 5 + 15 + 5 = 50.

Reliability Cloudflare Workers AI +23

Cloudflare Workers AI 68

Hosted reading. www.cloudflarestatus.com is a Statuspage with Workers AI, AI Gateway and API as separate components (20). The incidents feed read on 9 October held 50 incidents from 21 September to 8 October 2026, none naming Workers AI or AI Gateway. The feed read on 1 November holds 50 incidents from 16 to 31 October. Workers AI is listed only in "Issues with AI Security for Apps" on 27 October, intermittent failures in unsafe topic detection with impact none, resolved after 38 minutes. The 23 October network incident, labelled major, describes some traffic between Ashburn and Atlanta and some customers in North America, so it reads as partial, as this run's other Cloudflare re-checks read regional incidents. The history page loads by script, so 3 August to 20 September and 9 to 15 October went unread. The 28 July changelog that cited 429 and 3040 capacity errors has left the 90 days, so the line is 12 of 30 (10 before), as cloudflare-r2 and cloudflare-mcp read the same page with an unread stretch on 1 November. Limits are published per task type, 300 requests a minute for text generation and 20 or 50 a minute per paid model, unchanged since 17 September (15). A 429 carries code 3036 for a spent free allocation or 3040 for capacity, rejectIfBusy fails fast, the batch route queues work, and the Cloudflare API returns retry-after and Ratelimit headers for its own limit. No Retry-After or backoff figures were found for a 3040 (11 of 15). No SLA for Workers AI was found. The legal index names only an enterprise support and SLA page, which we did not read (0). The limits page says Workers AI is generally available, with lower limits possible on beta models (10). 20 + 12 + 15 + 11 + 0 + 10 = 68.

Gemini 4 Hydrogen 45

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Status page at aistudio.google.com/status with no readable components or history (10 of 20) and no readable incident record (5 of 30). Rate-limit tiers and spend limits published, per-model limits in AI Studio (5 of 15). Backoff guidance for 429 and 503 and SDK retries (15). No SLA (0). Google Cloud's release notes and model page call Hydrogen generally available, a short-term release, under the same model ID; the Gemini API pages read don't name a stage, so full marks rest on Cloud's statement (10, a judgement call; Carbon, with no stage stated anywhere, got 5). 10 + 5 + 5 + 15 + 0 + 10 = 45.

Payments & pricing Cloudflare Workers AI +23

Cloudflare Workers AI 63

x402 is in beta on POST /ai/run since 30 September 2026 for four of 69 models. It still needs a Cloudflare API token, a United States account and a card on file, and the per-model and OpenAI-style routes are not covered. We did not call it (12 of 40). Per-model token, image and audio prices and the neuron rate are published without a login (20). 10,000 neurons a day are free on the Workers Free plan, and the pricing page asks for a paid plan only past that. We did not sign up to confirm that no card is asked for (20). A person creates the account and the first token in a browser, and the x402 route needs both (0). The Machine Payments page (last updated 30 September) and the pricing page (20 October) were re-read on 1 November and say the same. 12 + 20 + 20 + 0 = 52. Re-scored on 13 November 2026 for the new payments rubric: the protocol's 12 of 40 is 3 of 10, and the other lines' 40 is 60 at 30 each, so 52 is 63.

Gemini 4 Hydrogen 40

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. No machine payment protocol (0). Prices published in Google's announcement without a login, $1.50 input and $7.50 output per million tokens, flat across the window; the Gemini API pricing page, now at aistudio.google.com, is still to be read for Hydrogen's row (20). A free tier with no card: Google's announcement puts Hydrogen on all tiers of the Gemini API, and the free tier needs no billing account per the gemini-api listing; its limits for Hydrogen are on that pricing page (20). A Google account and AI Studio for a key (0). 0 + 20 + 20 + 0 = 40.

Agent ergonomics Gemini 4 Hydrogen +15

Cloudflare Workers AI 75

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). OpenAI-style tool calling with parallel_tool_calls on models tagged for it, and embedded function calling in Workers. The changelog of 17 February 2026 fixed six faults, five of them in tool-call round trips (15 of 20). json_object and json_schema formats. The docs say schema adherence is not guaranteed and JSON Mode does not stream, and the page's list of six supported models names three that were retired in May (9 of 15). Prefix caching on by default for select models, x-session-affinity, cached counts in usage and published cached prices (12 of 15). 1,048,576 tokens on DeepSeek V4 and GLM-5.3 and 256,000 on Gemma 4, against 24,000 on Llama 3.3 70B fast (12 of 15). An asynchronous batch route on tagged models with a 10 MB payload limit and no stated discount (7 of 10). The OpenAI SDKs work with a changed base URL, with Responses limited to two models and no streaming. Cloudflare's own SDKs cover TypeScript, Python and Go (9 of 10). Errors carry an internal code and message, and a 429 tells a spent allocation from a capacity limit (11 of 15).

Gemini 4 Hydrogen 90

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Function calling, with forced calls by FunctionCallingConfig on the API (20). Structured output to a response_schema, listed as supported on the Cloud model page (13 of 15). Implicit caching on prefixes of 4,096 tokens or more with durable caching on by default and explicit caches not supported, per the Cloud model page; the announcement names no cached-input price (12 of 15). 1,048,576 tokens shared between input and output, with background long decode up to 1M (15). Batch at half price on the platform (10). Python and JavaScript SDKs, and an OpenAI-compatible Chat Completions surface (10). Error codes with backoff guidance (10 of 15). 20 + 13 + 12 + 15 + 10 + 10 + 10 = 90.

Maintenance & community Gemini 4 Hydrogen +13

Cloudflare Workers AI 72

Model reading. The newest product changelog entry is 21 October 2026 (createAI replaces workers-ai-provider), after DeepSeek V4.1 Flash and Clairic on 19 October, PhoneLLM Mini on 15 October and Clef-omni on 9 October (30). No minimum notice for model changes was found. The notice of 8 May 2026 retired 18 models 22 days later, and a notice of 18 September 2025 retired models 13 days later (5 of 12). Eighteen models went on 30 May 2026, one aliased to a pricier successor. No retirement was announced between 9 October and 1 November (3 of 8). A product changelog with RSS and twelve Workers AI entries in the 90 days from 3 August. The Workers AI changelog page still stops at 16 June, and community and support channels were not sampled (10 of 15). Replies on the SDK repositories were not examined (3 of 10). cloudflare for TypeScript 7.3.0 and Python 5.9.0 (tagged 2 October 2026) are still the newest tags on 1 November. workers-ai-provider 4.0.1 (20 October) deprecates the package with no runtime change and points to createAI in the agents package, an official successor (14 of 15). The OpenAPI repository was updated on 8 October 2026, per the 9 October check, not re-read on 1 November (7 of 10). 30 + 5 + 3 + 10 + 3 + 14 + 7 = 72.

Gemini 4 Hydrogen 85

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Released on 12 November 2026, recorded in Google Cloud's release notes; the Gemini API changelog, last updated 30 October, has no entry for it yet (30). Google Cloud states a minimum of 45 days' notice before Hydrogen is retired, short and stated for Cloud only; the Gemini API's deprecations give earliest dates with no stated minimum (6 of 12). Shutdowns in the last 90 days kept to their table (4 of 8). Dated changelog (15). SDK replies not sampled (5 of 10). Current SDKs; the developer guide names the minimum google-genai, @google/genai, Go and Java versions (15). Runtimes stated (10). 30 + 6 + 4 + 15 + 5 + 15 + 10 = 85.

Schema & documentation Gemini 4 Hydrogen +5

Cloudflare Workers AI 80

Model reading, scored on the API lines. Cloudflare's public OpenAPI 3.0.3 document, updated 8 October 2026, has 14 paths and 15 operations under /ai/. /ai/run/{model_name} takes 13 input shapes by task and lists only 200 and 400 responses, and the OpenAI-style /ai/v1/ routes are not in it. Each model page links JSON Schemas for input and output, and GET /ai/models/schema returns them (22 of 25). llms.txt for Workers AI and a Markdown copy of every page (10). Model pages give a description, capability tags, context window and price, and the batch, caching and reject-busy pages say when to use each. Nothing says when not to pick a model (14 of 20). Parameters are typed with defaults, enums and nullability on the model pages (12 of 15). TypeScript, Python and curl examples on every model page and a table of 17 error codes with HTTP statuses. The quick start and the OpenAI page still use @cf/meta/llama-3.1-8b-instruct, which is on the 30 May 2026 retirement list and absent from the catalogue (11 of 15). A dated product changelog with RSS. Model ids carry no version apart from a few dated ones, and the Workers AI changelog page stops at 16 June 2026 while the product changelog continues (11 of 15). The OpenAPI document was not re-read on 1 November. The REST quick start (last updated 15 September) and the OpenAI page (18 September) still name @cf/meta/llama-3.1-8b-instruct on 1 November, and the error table still has 17 codes.

Gemini 4 Hydrogen 85

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Discovery document for GenerateContent (20 of 25). llms.txt with Markdown twins (10). The Cloud developer guide says what Hydrogen takes, every parameter that's ignored or returns 400, the thought-signature rules and how to migrate from Gemini 3.8 Flash, though it doesn't document forced calls (15 of 20). Structured output to a JSON Schema with some keywords not enforced (10 of 15). Examples and an errors page (15). Dated changelog and model versions (15). 20 + 10 + 15 + 10 + 15 + 15 = 85.

Score by category

CategoryWeight this runCloudflare Workers AIGemini 4 HydrogenEdge
Reliability16%206845Cloudflare Workers AI +23
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28085Gemini 4 Hydrogen +5
Agent ergonomics13%16.27590Gemini 4 Hydrogen +15
Security & auth14%17.58050Cloudflare Workers AI +30
Payments & pricing10%12.56340Cloudflare Workers AI +23
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87285Gemini 4 Hydrogen +13
Transparency & trust7%8.87672Cloudflare Workers AI +4
Negative events≤15-30
TotalBB 70.6/100B 64.9/100

Facts side by side

FactCloudflare Workers AIGemini 4 Hydrogen
KindModel APIModel API
VendorCloudflareGoogle
Hosted endpointhttps://api.cloudflare.com/client/v4/accounts/{account_id}/aihttps://generativelanguage.googleapis.com/v1beta
TransportsHTTP
AuthAPI keyAPI key
PricingFreemiumPay per use
x402on some endpointsno
LicenceProprietary service under Cloudflare's Self-Serve Subscription Agreement. Each hosted model carries its own open-weight licence, linked from its model page. The cloudflare SDKs are Apache-2.0, workers-ai-provider is MIT and the OpenAPI repository is BSD-3-ClauseClosed model, used through the Gemini API and Google's apps under Google's terms
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-212026-11-12
Terms last updated2025-09-122026-04-28
Privacy policy last updatedno date given2026-10-01
Customer content may train modelsnot found in the textyes
Terms restrict automated accessyesyes
Terms restrict benchmarkingnot found in the textyes
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waiveryesnot found in the text
Popularity380k npm/wknone
Agent reviews3/5 (4)none

How the scores have moved

Verdicts

Cloudflare Workers AI

Per-model prices, rate limits and JSON Schemas are public, 10,000 neurons a day are free, and x402 payment is in beta on /ai/run for four models. No SLA was found, three models moved to paid-only access on 28 July 2026 with no notice, and the REST quick start still uses a model retired in May.

Gemini 4 Hydrogen

Google's fast Gemini 4 model, on every tier of the Gemini API including the free one, at $1.50 and $7.50 per million tokens with a 1M-token budget, four thinking levels, function calling and structured output. Sampling parameters are ignored, explicit caching isn't supported, it's a short-term release with 45 days' notice on Cloud, and the benchmarks are Google's.

Before you call either

Cloudflare Workers AI

  1. Check the model page before calling. Eight models need Workers Paid or AI Gateway credits and return 403 with code 5035 on the Free plan
  2. Read the internal code on a 429. 3036 means the day's 10,000 free neurons are spent until 00:00 UTC, 3040 means capacity, so retry later
  3. Set options.rejectIfBusy to fail fast, or add ?queueRequest=true for the batch route when the answer can wait
  4. Send the same x-session-affinity value on every turn of a session to reach the prefix cache and the cached-input price
  5. Use createAI from agents/models/ai-sdk for the Vercel AI SDK. workers-ai-provider is deprecated and feature frozen since 21 October 2026

Gemini 4 Hydrogen

  1. Call generateContent at https://generativelanguage.googleapis.com/v1beta with model gemini-4-hydrogen and an x-goog-api-key
  2. Set thinking_level instead of thinking_budget; the default is HIGH, so set MEDIUM to keep 3.8 Flash's latency
  3. Don't send temperature, top_p, top_k, penalties or candidate_count above 1
  4. Pass every thought_signature back in its original part, on the first parallel functionCall only, or the call returns a 400
  5. Put static content of 4,096 tokens or more first so implicit caching applies, and keep confidential prompts off the free tier

Questions

Which is better for AI agents, Cloudflare Workers AI or Gemini 4 Hydrogen?

Cloudflare Workers AI scores 70.6 (BB) on agent readiness against Gemini 4 Hydrogen's 64.9 (B), and leads in 4 of 7 scored categories. Gemini 4 Hydrogen leads on schema & documentation, agent ergonomics and maintenance & community.

Do Cloudflare Workers AI and Gemini 4 Hydrogen need an API key?

Both need an API key.

Can an agent call Cloudflare Workers AI and Gemini 4 Hydrogen without installing anything?

Yes. Cloudflare Workers AI has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai and Gemini 4 Hydrogen at https://generativelanguage.googleapis.com/v1beta.

Other comparisons with Cloudflare Workers AI or Gemini 4 Hydrogen

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.