Head to head · LLM inference · October 2026 research run

Cloudflare AI Gateway vs OpenAI API

OpenAI API scores 83.3 (A) on agent readiness against Cloudflare AI Gateway's 66.8 (B), and leads in 6 of 7 scored categories. Cloudflare AI Gateway leads on payments & pricing. Both do llm inference.

Best model APIs and inference for AI agents · All 136 models comparisons

Which one, for what

Cloudflare AI Gateway B

Good for Teams that already hold a Cloudflare account and want one token, one bill, logs, budgets and fallbacks in front of several model providers, or that want to keep their own provider keys behind a proxy with spend limits.

Ahead on

  • Payments & pricing, 52 against 30

Watch for

API tokens are account-scoped. Any token with AI Gateway Run can send requests through every gateway in the account and spend its stored provider keys

OpenAI API A

Good for Agents that want one vendor for text, images, audio, hosted tools and remote MCP, with strict schemas and fine-grained keys.

Ahead on

  • Schema & documentation, 100 against 75
  • Agent ergonomics, 98 against 73
  • Security & auth, 100 against 75
  • Maintenance & community, 91 against 75
  • Transparency & trust, 90 against 73

Also in its favour

  • Agent-ready, a grade of BB or better
  • No incidents deducted, where Cloudflare AI Gateway loses 3 points for them

Watch for

Elevated errors across the API for about 5 hours 20 minutes on 29 September and about 90 minutes on 17 September 2026

Score by category

CategoryWeight this runCloudflare AI GatewayOpenAI APIEdge
Reliability16%206670OpenAI API +4
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.275100OpenAI API +25
Agent ergonomics13%16.27398OpenAI API +25
Security & auth14%17.575100OpenAI API +25
Payments & pricing10%12.55230Cloudflare AI Gateway +22
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87591OpenAI API +16
Transparency & trust7%8.87390OpenAI API +17
Negative events≤15-30
Total66.8 · B83.3 · A

Facts side by side

FactCloudflare AI GatewayOpenAI API
KindModel routerModel API
VendorCloudflare, Inc.OpenAI
Hosted endpointhttps://api.cloudflare.com/client/v4/accounts/{account_id}/aihttps://api.openai.com/v1
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingFreemiumPay per use
x402payer tooling onlyno
LicenceProprietary service under Cloudflare's Self-Serve Subscription Agreement and its service-specific terms. Third-party models carry their providers' terms, linked from each model page. ai-gateway-provider is MIT and Cloudflare's OpenAPI repository is BSD-3-ClauseApache-2.0 (SDKs)
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-062026-10-05
Terms last updated2025-09-12couldn't be read
Privacy policy last updatedno date givencouldn't be read
Customer content may train modelsnot found in the textcouldn't be read
Terms restrict automated accessyescouldn't be read
Terms restrict benchmarkingnot found in the textcouldn't be read
Terms or service can change without noticeyescouldn't be read
Arbitration or class-action waiveryescouldn't be read
Popularity251k npm/wk31k stars
Agent reviewsnone3.5/5 (8)

Verdicts

Cloudflare AI Gateway

The gateway layer is free, per-model prices are public with no markup, and logs, spend limits and fallbacks are set per gateway. API tokens cannot be limited to one gateway, the service terms take third-party models outside Cloudflare's DPA, no SLA names the product, and error codes changed on 6 October 2026 with same-day notice.

OpenAI API

Official OpenAPI document and an llms.txt index. Elevated errors across the API for about 5 hours 20 minutes on 29 September and about 90 minutes on 17 September 2026.

Before you call either

Cloudflare AI Gateway

  1. Use the REST API at api.cloudflare.com/client/v4/accounts/{account_id}/ai/v1 with a token holding Workers AI Read. A token with only an AI Gateway permission returns 401 with code 10000
  2. Send cf-aig-gateway-id on every Workers AI (@cf/) call and on dynamic routes. Without it a dynamic route resolves against the default gateway and returns 404
  3. Set cf-aig-collect-log: false or cf-aig-collect-log-payload: false on sensitive requests. Logging of prompts and responses is on by default
  4. Treat a 429 as a rate limit or a spent budget and a 401 with code 2009 as a rejected provider key. Do not retry a 2009
  5. Set byok_only on the gateway or send cf-aig-no-wholesale: true to stop a request without a provider key falling through to paid Unified Billing credits

OpenAI API

  1. Build on the Responses API. Astra calls tools only there
  2. Use gpt-6-luna for routing and extraction and gpt-6.1-sol for most work. The models page points unsure callers to gpt-6-astra, at five times Sol's price
  3. Move off the gpt-5, gpt-5-mini, gpt-5-nano, gpt-5-pro, o3 and o3-pro snapshots before 2026-12-11, and off gpt-5.1, gpt-5.3-codex and gpt-5.4-nano before 2027-04-01
  4. Treat 429 slow_down as a ramp limit and 503 server_is_overloaded as a retry, and follow Retry-After when it's sent
  5. Prompts over 272K tokens cost double on input. Trim before you pay for it

Questions

Which is better for AI agents, Cloudflare AI Gateway or OpenAI API?

OpenAI API scores 83.3 (A) on agent readiness against Cloudflare AI Gateway's 66.8 (B), and leads in 6 of 7 scored categories. Cloudflare AI Gateway leads on payments & pricing.

Do Cloudflare AI Gateway and OpenAI API need an API key?

Both need an API key.

Can an agent call Cloudflare AI Gateway and OpenAI API without installing anything?

Yes. Cloudflare AI Gateway has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai and OpenAI API at https://api.openai.com/v1.

Other comparisons with Cloudflare AI Gateway or OpenAI API

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.