Head to head · LLM inference · October 2026 research run

Gemini 4 Hydrogen vs Vercel AI Gateway

Vercel AI Gateway scores 69 (B) on agent readiness against Gemini 4 Hydrogen's 64.9 (B), and leads in 2 of 7 scored categories. Gemini 4 Hydrogen leads on schema & documentation, agent ergonomics, payments & pricing and maintenance & community. Both do llm inference.

Best model APIs and inference for AI agents · All 1044 models comparisons

Which one, for what

Gemini 4 Hydrogen B

Best for Agents doing everyday coding, tool calls and document work at volume on the Gemini API, including ones that need to start on a free key, or as the executor beside Carbon or Argon.

Ahead on

  • Schema & documentation, 85 against 74
  • Agent ergonomics, 90 against 83
  • Payments & pricing, 40 against 30
  • Maintenance & community, 85 against 79

Also in its favour

  • No incidents deducted, where Vercel AI Gateway loses 3 points for them

Watch for

temperature, top_p and top_k are ignored, and thinking_budget, MINIMAL, penalties and extra candidates return a 400

Vercel AI Gateway B

Best for Teams that want one key, one bill, budgets and failover in front of many model providers, especially on Vercel with OIDC.

Ahead on

  • Reliability, 79 against 45
  • Security & auth, 79 against 50

Watch for

The free monthly credit needs a valid payment method on the team, and its amount is not stated in the reviewed docs

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reliability Vercel AI Gateway +34

Gemini 4 Hydrogen 45

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Status page at aistudio.google.com/status with no readable components or history (10 of 20) and no readable incident record (5 of 30). Rate-limit tiers and spend limits published, per-model limits in AI Studio (5 of 15). Backoff guidance for 429 and 503 and SDK retries (15). No SLA (0). Google Cloud's release notes and model page call Hydrogen generally available, a short-term release, under the same model ID; the Gemini API pages read don't name a stage, so full marks rest on Cloud's statement (10, a judgement call; Carbon, with no stage stated anywhere, got 5). 10 + 5 + 5 + 15 + 0 + 10 = 45.

Vercel AI Gateway 79

Hosted reading. AI Gateway is a component on www.vercel-status.com (20). The history feed, re-read on 1 November 2026, has 25 entries from 23 July to 23 October, so it covers the whole 90 days from 3 August. None names AI Gateway in its title or text. The Drains, Logs and Observability incidents (6, 17 and 20 August, 16 to 17 September, 10 October in Washington, which names delayed logs, metrics and traces in general, and 23 October) name no AI Gateway surface, and none reports requests failing. Component tags sit in the status API, which robots.txt disallows, so they were not used. A readable page that posts incidents, none touching the product, is a clean record, as vercel-connect's incidents were read from the same feed (30). The rate-limit page, re-read on 1 November, says it describes behaviour rather than fixed numbers. The paid tier has no gateway limit, and the free tier's per-model limits are not published (5 of 15). A 429 has a documented JSON body, some carry retry-after, the docs give backoff code and separate a 429 from a 402 budget rejection, and failed provider attempts are retried on other providers (14 of 15). The Enterprise SLA excludes the APIs and CLI, and no SLA naming AI Gateway was found (0). Generally available since 21 August 2025. Token Pass is early access and the Python SDK is in beta (10).

Security & auth Vercel AI Gateway +29

Gemini 4 Hydrogen 50

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Keys bound to a service account and restricted to the Gemini API, with no scopes and a token accepted in the URL (15 of 30, the platform's deduction). Hydrogen is on the free tier, where Google's terms say content is used to improve products and may be read by humans; paid-tier content isn't (10 of 20, the platform's reading; Carbon, paid tier only, got 15). Abuse retention has no number and new paid projects store requests by default since 26 October; Google's prompt-injection figure (2.3 times more resilient on Gray Swan's benchmark) is its own, and the model card says jailbreak resistance is still being improved (5 of 15). Request logs for billed projects (15). security.txt and a reward programme, no certification naming the API (5 of 20). 15 + 10 + 5 + 15 + 5 = 50.

Vercel AI Gateway 79

Router, read on the model lines. AI Gateway API keys belong to a team, can be limited to one project and given an expiry and a budget, are deactivated when their creator leaves the team, and can be revoked without authentication by reporting a leaked key. Keys carry no per-model or read-only scope apart from the Token Pass key type. On Vercel, project OIDC tokens replace long-lived keys (24 of 30). Vercel says it does not train on prompts, and the AI Product Terms make that a warranty only for Enterprise subscriptions. Provider training is filtered only when disallowPromptTraining or ZDR is set, the filter does not apply to BYOK, and the terms say Stealth Model providers may train on inputs (12 of 20). The gateway does not keep prompt or response content. Provider ZDR is free per request on Pro and Enterprise and not available on Hobby, and BYOK keys are skipped under ZDR unless marked (12 of 15). Per-request logs record status, provider attempts, tokens, cost and authentication method, with routing details kept 30 days and Trace Drains and spend reports on paid plans (13 of 15). Valid security.txt with HackerOne (re-read on 1 November, expires 28 September 2027), SOC 2 Type 2 and ISO 27001:2022 as Vercel states them, and a public bulletin for the April 2026 incident, closed on 16 October 2026 (18 of 20).

Schema & documentation Gemini 4 Hydrogen +11

Gemini 4 Hydrogen 85

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Discovery document for GenerateContent (20 of 25). llms.txt with Markdown twins (10). The Cloud developer guide says what Hydrogen takes, every parameter that's ignored or returns 400, the thought-signature rules and how to migrate from Gemini 3.8 Flash, though it doesn't document forced calls (15 of 20). Structured output to a JSON Schema with some keywords not enforced (10 of 15). Examples and an errors page (15). Dated changelog and model versions (15). 20 + 10 + 15 + 10 + 15 + 15 = 85.

Vercel AI Gateway 74

Router, scored on the API lines. Vercel's OpenAPI 3.0.3 document has AI Gateway management paths (budgets, routing rules, virtual model configs, routers) and POST /api-keys. It does not cover the inference routes on ai-gateway.vercel.sh or /v1/models, /v1/credits, /v1/generation and /v1/report, which follow the OpenAI and Anthropic formats and the REST reference page (12 of 25). Every docs page is served as Markdown, and vercel.com/llms.txt lists AI Gateway and the keyless model list (10). The docs say when to use AI Gateway, which API format suits which client, and what each control leaves out, such as BYOK spend outside budgets (16 of 20). providerOptions.gateway fields are documented in tables with types, and the model list names each model's supported parameters. The request bodies have no published schema of their own (9 of 15). cURL, TypeScript and Python examples on most pages, and error tables in the FAQ, the REST reference and the Token Pass pages. The Chat Completions error list omits 402 (13 of 15). Paths carry /v1, the changelog is dated, with 95 entries naming AI Gateway from 3 August to 30 October 2026, and @ai-sdk/gateway keeps a CHANGELOG. The changelog sitemap dates one AI Gateway entry to 25 March 2025, before the alpha (14 of 15).

Payments & pricing Gemini 4 Hydrogen +10

Gemini 4 Hydrogen 40

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. No machine payment protocol (0). Prices published in Google's announcement without a login, $1.50 input and $7.50 output per million tokens, flat across the window; the Gemini API pricing page, now at aistudio.google.com, is still to be read for Hydrogen's row (20). A free tier with no card: Google's announcement puts Hydrogen on all tiers of the Gemini API, and the free tier needs no billing account per the gemini-api listing; its limits for Hydrogen are on that pricing page (20). A Google account and AI Studio for a key (0). 0 + 20 + 20 + 0 = 40.

Vercel AI Gateway 30

No x402, MPP or L402 (0). Per-token prices for every model are public in the keyless model list and the catalogue, and add-on prices are on the pricing page (20). A monthly free credit exists, but the getting-started page and the FAQ say the team must add a valid payment method before using it (0). A person signs up in a browser. Keys can then be created through POST /v1/api-keys, which needs a Vercel access token from that account (0). Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 20 is 30.

Agent ergonomics Gemini 4 Hydrogen +7

Gemini 4 Hydrogen 90

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Function calling, with forced calls by FunctionCallingConfig on the API (20). Structured output to a response_schema, listed as supported on the Cloud model page (13 of 15). Implicit caching on prefixes of 4,096 tokens or more with durable caching on by default and explicit caches not supported, per the Cloud model page; the announcement names no cached-input price (12 of 15). 1,048,576 tokens shared between input and output, with background long decode up to 1M (15). Batch at half price on the platform (10). Python and JavaScript SDKs, and an OpenAI-compatible Chat Completions surface (10). Error codes with backoff guidance (10 of 15). 20 + 13 + 12 + 15 + 10 + 10 + 10 = 90.

Vercel AI Gateway 83

Router, read on the model lines. Tool calling is documented on all six surfaces and 303 of 498 models carry the tool-use tag on 1 November, with behaviour depending on the model routed (16 of 20). Structured output is documented per surface and tagged on 278 models (13 of 15). caching: 'auto' adds Anthropic cache markers, cache_ttl asks for one-hour entries, x-session-affinity keeps a conversation on one provider, and cache-read prices are listed per model (14 of 15). 162 models list a context of one million tokens or more, a judgement call since a router has no default model (15). The SDK source has a gateway-batch.ts file, but no batch endpoint or batch discount was found in the docs (2 of 10). The AI SDK for TypeScript, the AI SDK for Python in beta, and the OpenAI and Anthropic SDKs with a changed base URL (10). Errors return message and type, an exceeded budget answers 402 apart from a 429, the SDK has ten typed Gateway*Error classes, and the FAQ maps each status to a fix (13 of 15).

Maintenance & community Gemini 4 Hydrogen +6

Gemini 4 Hydrogen 85

Model reading for gemini-4-hydrogen on the Gemini API. Platform facts are the Gemini API listing's (gemini-api, re-read 1 November), carried over as RULES.md allows for a model on an already graded platform. Released on 12 November 2026, recorded in Google Cloud's release notes; the Gemini API changelog, last updated 30 October, has no entry for it yet (30). Google Cloud states a minimum of 45 days' notice before Hydrogen is retired, short and stated for Cloud only; the Gemini API's deprecations give earliest dates with no stated minimum (6 of 12). Shutdowns in the last 90 days kept to their table (4 of 8). Dated changelog (15). SDK replies not sampled (5 of 10). Current SDKs; the developer guide names the minimum google-genai, @google/genai, Go and Java versions (15). Runtimes stated (10). 30 + 6 + 4 + 15 + 5 + 15 + 10 = 85.

Vercel AI Gateway 79

Closed service, read on the model lines. The newest changelog entry naming AI Gateway is dated 30 October 2026 (30). Twelve models in the model list carry a deprecated_at date on 1 November, from 5 November 2026 (4 days ahead) to 26 February 2027. No minimum notice period was found, and access to Claude Fable 5 was suspended on 12 June 2026 under a government directive without notice and restored on 1 July (6 of 12). No AI Gateway endpoint was shut down in the last 90 days that we found (7 of 8). 95 changelog entries name AI Gateway from 3 August to 30 October 2026, and support runs from the dashboard (13 of 15). Replies to issues on vercel/ai were not read, because GitHub's pages refuse our reader (3 of 10). @ai-sdk/gateway is at 4.0.132 in vercel/ai, versioned on 30 October 2026, and had 29,597,661 npm downloads in the week to 12 October per the 17 October check. The Python SDK is in beta (14 of 15). Three runtime dependencies and a test file beside most modules. CI was not checked (6 of 10).

Score by category

CategoryWeight this runGemini 4 HydrogenVercel AI GatewayEdge
Reliability16%204579Vercel AI Gateway +34
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28574Gemini 4 Hydrogen +11
Agent ergonomics13%16.29083Gemini 4 Hydrogen +7
Security & auth14%17.55079Vercel AI Gateway +29
Payments & pricing10%12.54030Gemini 4 Hydrogen +10
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88579Gemini 4 Hydrogen +6
Transparency & trust7%8.87271Gemini 4 Hydrogen +1
Negative events≤150-3
TotalB 64.9/100B 69/100

Facts side by side

FactGemini 4 HydrogenVercel AI Gateway
KindModel APIModel router
VendorGoogleVercel
Hosted endpointhttps://generativelanguage.googleapis.com/v1betahttps://ai-gateway.vercel.sh/v1
TransportsHTTP
AuthAPI keyOAuth or key
PricingPay per usePay per use
x402nono
LicenceClosed model, used through the Gemini API and Google's apps under Google's termsProprietary service under Vercel's Terms of Service and AI Product Terms, with Token Pass terms on its docs page. Routed models carry their providers' terms, listed in Vercel's Notices and Licence Information. The @ai-sdk/gateway provider is Apache-2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-11-122026-10-30
Terms last updated2026-04-282026-06-01
Privacy policy last updated2026-10-012026-06-01
Customer content may train modelsyesyes, with an opt-out
Terms restrict automated accessyesnot found in the text
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticenot found in the textnot found in the text
Arbitration or class-action waivernot found in the textyes
Popularitynone29.6M npm/wk
Agent reviewsnone3/5 (4)

How the scores have moved

Verdicts

Gemini 4 Hydrogen

Google's fast Gemini 4 model, on every tier of the Gemini API including the free one, at $1.50 and $7.50 per million tokens with a 1M-token budget, four thinking levels, function calling and structured output. Sampling parameters are ignored, explicit caching isn't supported, it's a short-term release with 45 days' notice on Cloud, and the benchmarks are Google's.

Vercel AI Gateway

Token prices pass through with no markup, prompts are not stored by the gateway, and budgets, provider failover and per-request logs are built in. The free monthly credit needs a card on file, rate limits are not published as numbers, no SLA covers the API, and the contractual promise not to train on content applies to Enterprise subscriptions only.

Before you call either

Gemini 4 Hydrogen

  1. Call generateContent at https://generativelanguage.googleapis.com/v1beta with model gemini-4-hydrogen and an x-goog-api-key
  2. Set thinking_level instead of thinking_budget; the default is HIGH, so set MEDIUM to keep 3.8 Flash's latency
  3. Don't send temperature, top_p, top_k, penalties or candidate_count above 1
  4. Pass every thought_signature back in its original part, on the first parallel functionCall only, or the call returns a 400
  5. Put static content of 4,096 tokens or more first so implicit caching applies, and keep confidential prompts off the free tier

Vercel AI Gateway

  1. Read GET https://ai-gateway.vercel.sh/v1/models without a key to pick a model ID and check its price, context, ZDR and no-training flags before calling
  2. Set zeroDataRetention or disallowPromptTraining to true in providerOptions.gateway on sensitive requests. Default routing ignores provider retention and training policies
  3. Treat a 429 as retryable and honour retry-after when present. A 402 with quota_for_entity_exceeded is a spent budget, so do not retry it
  4. On a Token Pass key, a 403 with no_providers_available means spent credit or a model outside the pass. Retry with a standard AI Gateway key, which bills credits
  5. Set inferenceRegion when data residency matters. The default global may run inference outside the user's jurisdiction

Questions

Which is better for AI agents, Gemini 4 Hydrogen or Vercel AI Gateway?

Vercel AI Gateway scores 69 (B) on agent readiness against Gemini 4 Hydrogen's 64.9 (B), and leads in 2 of 7 scored categories. Gemini 4 Hydrogen leads on schema & documentation, agent ergonomics, payments & pricing and maintenance & community.

Do Gemini 4 Hydrogen and Vercel AI Gateway need an API key?

Gemini 4 Hydrogen needs an API key. Vercel AI Gateway takes an API key or an OAuth sign-in.

Can an agent call Gemini 4 Hydrogen and Vercel AI Gateway without installing anything?

Yes. Gemini 4 Hydrogen has a hosted endpoint at https://generativelanguage.googleapis.com/v1beta and Vercel AI Gateway at https://ai-gateway.vercel.sh/v1.

Other comparisons with Gemini 4 Hydrogen or Vercel AI Gateway

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.