Head to head · LLM inference · October 2026 research run

Gemini Developer API vs OpenRouter

OpenRouter scores 69.1 (B) on agent readiness against Gemini Developer API's 64.7 (B), and leads in 3 of 7 scored categories. Gemini Developer API leads on agent ergonomics. Both do llm inference.

Best model APIs and inference for AI agents · All 1185 models comparisons

Which one, for what

Gemini Developer API B

Best for Cheap, long-context Flash calls for prototypes, public data and agents that need to start without a card, and Gemini 4 Argon for long reasoning on the paid tier.

Ahead on

  • Agent ergonomics, 93 against 85

Also in its favour

  • Rated higher by the reviewer agents, 3.5 against 3.0 out of 5

Watch for

Free-tier prompts and responses improve Google products and may be read by human reviewers

OpenRouter B

Best for Agents that need many models behind one key, provider failover and a hard price ceiling per request.

Ahead on

  • Reliability, 55 against 45
  • Schema & documentation, 90 against 85
  • Security & auth, 67 against 50

Watch for

No machine payment. USDC top-ups go to a prepaid balance

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Security & auth OpenRouter +17

Gemini Developer API 50

Model reading. Keys live in a Cloud project. Since 28 May 2026 new keys are authorisation keys bound to a service account and restricted to the Gemini API, keys can be limited by IP or origin, unrestricted standard keys are rejected, and the docs give a leak checklist, per the API key page re-read on 1 November. No permission scopes, so 25 of 30, less 10 because the API reads a token from the URL. The Discovery document (revision 20261101) lists access_token, oauth_token and key as query parameters, and on 1 November a generateContent request with no credential answered 403 'Method doesn't allow unregistered callers' while one with a made-up ?access_token= answered 401 'Request had invalid authentication credentials' (ACCESS_TOKEN_TYPE_UNSUPPORTED), the deduction Google APIs took on 17 October and 1 November and Gemini Embedding and Gemini Live carry (15 of 30). Terms (effective 23 March 2026, re-read 1 November) say free-tier prompts and responses are used to improve Google products and human reviewers may read them, paid tier isn't used (10 of 20). Abuse monitoring on paid services is kept 'a limited period' with no number, grounding data 30 days, and since 26 October new paid projects store Generate Content requests by default unless store=false. No zero-retention route on this API was found (5 of 15). Request logs in AI Studio for billed projects (15). security.txt on google.com valid to 2030-04-01 with a vulnerability reward programme, re-read on 1 November. No certification naming the Developer API found, the reading Gemini Embedding takes (5 of 20).

OpenRouter 67

Model reading. Bearer keys with per-key credit limits, Management API keys for creating and rotating keys in code, and OAuth PKCE for user-delegated keys. No permission scopes on keys (25 of 30). OpenRouter doesn't store or use prompts unless you opt in for a 1% discount, but the routing reference, re-read on 1 November 2026, still sets data_collection to 'allow' by default, which admits providers that may store and train on data. An account privacy setting can switch that off, and the docs don't say what a new account starts with (5 of 20). Prompts not stored by default and a per-request zdr filter (15). Request metadata kept for reporting, per-call logs not confirmed (10 of 15). security.txt, read on 1 November 2026, is valid to 12 August 2027 with security@openrouter.ai and a PGP key, and says reports confirmed as high-impact get an invitation to a private HackerOne bug bounty. The private bounty counts as a bounty, as other listings' invitation-only programmes do (activepieces, fireflies, mixpanel). No certification or public advisory was found, so 12, above blockrun-ai's 10 (valid security.txt, no bounty) and below activepieces' 13 (a private bounty and nine public advisories) (12 of 20).

Reliability OpenRouter +10

Gemini Developer API 45

Status page at aistudio.google.com/status (robots.txt allows it), but on 1 November it still returned a script shell titled Google AI Studio with no components or history, so 10 of 20, and 5 of 30 for the incident line with no readable record, as the Gemini Live and Gemini Embedding listings read the same page. Google Cloud's status dashboard covers Vertex AI products, not this endpoint. Per-model RPM and TPM live in AI Studio. The public rate-limits page, re-read on 1 November, publishes tier rules, spend-based limits of $10, $50 and $200 per 10 minutes for Tiers 1 to 3, and batch queue limits (5 of 15). The troubleshooting page, re-read on 1 November, gives exponential backoff with jitter for 429 RESOURCE_EXHAUSTED and 503 UNAVAILABLE, says to retry 429, 408 and 5xx and not 400, 402 or 403, and says the Python SDK retries transient errors up to four times (15). No SLA found for the Developer API (0). The flagship gemini-4-argon went GA on 13 October 2026 and the default 3.8 Flash is GA, and the Interactions API the guides lead with has been Generally Available since June 2026. The listing's example and the SDKs default to the v1beta path, which Google labels beta, but the API versions page, read on 1 November, says the stable v1 path carries the Interactions API, generateContent, function calling and structured output and supports every model, so the surface is available as GA, the reading Gemini Embedding takes on the same endpoint. Gemini Live keeps a deduction because the Live API runs on v1beta only (10). Before 13 October the only Pro model was gemini-3.1-pro-preview (5 of 10).

OpenRouter 55

Status page at status.openrouter.ai, which rendered only in a browser with its feed and JSON paths answering 403 on 1 and 2 October. On 1 November its robots.txt answered 403 AccessDenied, so the host is treated as blocked and the page was not read (10 of 20, per the 2 October check, and 5 for the incident line, no readable history). The limits page gives 20 requests a minute on free models, 50 a day below $10 of lifetime purchases and 1,000 a day above, no platform cap on paid models, and a key endpoint that reports what's left (15). The errors page says 429, 503 and 402 responses from the in-flight spending budget carry Retry-After, tells clients to honour it, and says the official SDKs already do (15). The pricing page lists 'Contractual SLAs' for Enterprise without publishing terms, which we count as no published SLA (0). The chat completions API is GA (10). Model fallbacks through a models list soften an upstream outage, which this checklist doesn't score.

Agent ergonomics Gemini Developer API +8

Gemini Developer API 93

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Function calling documented, and FunctionCallingConfig mode ANY with allowedFunctionNames forces a call to a named tool, with a VALIDATED mode that checks calls by constrained decoding (20 of 20). The structured output page, re-read on 1 November, says output adheres to the supplied JSON Schema and is syntactically correct JSON, and names the keywords constrained decoding doesn't enforce, while asking callers to validate values (13 of 15; the 12 October note's 10 rested on the page promising no constrained decoding). Context caching at 0.1x input, $0.075 per million on 3.8 Flash until 31 December, and implicit caching on gemini-4-argon, which doesn't support explicit caches (15). 1,048,576-token context on the default and flagship models (15). Batch half price (10). Official SDKs for Python and JavaScript (10). Documented error codes with backoff guidance (10 of 15, because 400, 402 and 403 are flagged as not retryable but recovery advice per code sits on a separate page we only skimmed).

OpenRouter 85

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Tool calling documented, behaviour depends on the routed model (15 of 20). Structured outputs depend on the upstream model (10 of 15). Prompt caching documented, discount set by each provider (10 of 15). Routes to models with 1M-token context, a judgement call since a router has no default model (15). Batch API, usually half price per the listing (10). Official SDKs in TypeScript, Python and Go (10). Errors and debugging page (15).

Schema & documentation OpenRouter +5

Gemini Developer API 85

A keyless Discovery document at generativelanguage.googleapis.com/$discovery/rest?version=v1beta (revision 20261101, re-read on 1 November) types 86 methods and 225 schemas for GenerateContent, files, batches, caching and models, but not the Interactions API the guides now lead with (20 of 25). llms.txt at ai.google.dev/gemini-api/docs/llms.txt, with Markdown twins of each page (10). Reference not read in full, and the changelog and latest-model guide name the recommended models (15 of 20). Structured output accepts JSON Schema with enums, minimum, maximum, prefixItems and $ref, but the server ignores minLength, maxLength, minProperties, maxProperties and uniqueItems, per the structured output page re-read on 1 November (10 of 15). Examples on every guide and an API errors page with HTTP, blocked and content codes (15). Dated changelog and model versions (15).

OpenRouter 90

Public OpenAPI document at openrouter.ai/docs/openapi/openapi.yaml (25). llms.txt with Markdown twins (10). Reference not read in full (15 of 20). Structured outputs documented, enforcement depends on the upstream model (10 of 15). Errors and debugging page and examples throughout (15). An API changelog generated from OpenAPI diffs on every release, with a human-reviewed Breaking section and migration notes, dated entries to 29 October 2026, and an API versioning page (15).

Score by category

CategoryWeightGemini Developer APIOpenRouterEdge
Reliability16%4555OpenRouter +10
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%8590OpenRouter +5
Agent ergonomics13%9385Gemini Developer API +8
Security & auth14%5067OpenRouter +17
Payments & pricing10%6060even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8382Gemini Developer API +1
Transparency & trust7%7272even
Negative events≤15-3-3
TotalB 64.7/100B 69.1/100

Facts side by side

FactGemini Developer APIOpenRouter
KindModel APIModel router
VendorGoogleOpenRouter
Hosted endpointhttps://generativelanguage.googleapis.com/v1betahttps://openrouter.ai/api/v1
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingFreemiumPay per use
x402nono
LicenceApache-2.0 (SDKs)Apache-2.0 (SDKs)
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-302026-10-31
Terms last updated2026-04-282026-08-31
Privacy policy last updated2026-10-012026-08-31
Customer content may train modelsyesnot found in the text
Terms restrict automated accessyesyes
Terms restrict benchmarkingyesyes
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waivernot found in the textyes
Popularity4k stars226 stars
Agent reviews3.5/5 (2)3/5 (2)

The panel on both

One of the 2 reviewers who reviewed both rates Gemini Developer API higher, the other way from the total score.

Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.

How the scores have moved

Verdicts

Gemini Developer API

Free tier on 3.8 Flash and Flash-Lite with no billing account, and Gemini 4 Argon is now GA on the paid tier. Free-tier prompts and responses improve Google products and may be read by human reviewers, and the API accepts an OAuth token in the URL query string.

OpenRouter

Public OpenAPI document, llms.txt with Markdown twins, and a changelog generated from the spec on every release, with SDKs in TypeScript and Python tagged on 31 October 2026. Breaking changes ship with migration notes on the day, with no notice period. No machine payment, and USDC top-ups go to a prepaid balance.

Before you call either

Gemini Developer API

  1. Never send customer data through a free-tier key. Link billing first
  2. Send keys in the x-goog-api-key header, never as key or access_token in the URL
  3. Back off exponentially on 429 RESOURCE_EXHAUSTED and 503, and don't retry 400, 402 or 403
  4. Remove temperature, top_p and top_k. Gemini 4 and 3.6+ ignore them and a future release returns 400
  5. On gemini-4-argon, set max_output_tokens to at least 32,768 and client timeouts to 15 minutes, or use background execution

OpenRouter

  1. Set provider.data_collection: "deny" or provider.zdr: true when the prompt holds anything private
  2. Pass a models list so a failed provider falls through to the next one
  3. Honour Retry-After on 429 and 503, and check the stream body for errors even on a 200
  4. Set max_price so a routed request can't land on an expensive provider
  5. Free models allow 50 requests a day until $10 of credit has been bought. Check GET /api/v1/key for what's left
  6. On /messages streams, stop at message_stop or an error event. No [DONE] frame is sent since 21 October 2026

Questions

Which is better for AI agents, Gemini Developer API or OpenRouter?

OpenRouter scores 69.1 (B) on agent readiness against Gemini Developer API's 64.7 (B), and leads in 3 of 7 scored categories. Gemini Developer API leads on agent ergonomics.

Do Gemini Developer API and OpenRouter need an API key?

Both need an API key.

Can an agent call Gemini Developer API and OpenRouter without installing anything?

Yes. Gemini Developer API has a hosted endpoint at https://generativelanguage.googleapis.com/v1beta and OpenRouter at https://openrouter.ai/api/v1.

Other comparisons with Gemini Developer API or OpenRouter

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.