Get an audit

Head to head · LLM inference · October 2026 research run

Cloudflare AI Gateway vs Cohere Chat API (Command models)

Cloudflare AI Gateway scores 66.8 (B) on agent readiness against Cohere Chat API (Command models)'s 64.7 (B), and leads in 5 of 7 scored categories. Cohere Chat API (Command models) leads on schema & documentation. Both do llm inference.

Best model APIs and inference for AI agents · All 136 models comparisons

Cloudflare AI GatewayCloudflare, Inc. · Model router B66.8/100#275 of 950 Cohere Chat API (Command models)Cohere · Model API B64.7/100#342 of 950

Which one, for what

Cloudflare AI Gateway B

Good for Teams that already hold a Cloudflare account and want one token, one bill, logs, budgets and fallbacks in front of several model providers, or that want to keep their own provider keys behind a proxy with spend limits.

Ahead on

  • Security & auth, 75 against 57
  • Payments & pricing, 52 against 30

Watch for

API tokens are account-scoped. Any token with AI Gateway Run can send requests through every gateway in the account and spend its stored provider keys

Cohere Chat API (Command models) B

Good for Teams that want Command models for RAG with citations, tool use and multilingual work, and that may later move to a private deployment or Model Vault.

Ahead on

  • Schema & documentation, 84 against 75

Also in its favour

  • Free to start without a card
  • No incidents deducted, where Cloudflare AI Gateway loses 3 points for them

Watch for

Production keys work like trial keys on Command A+, Reasoning, Translate and Vision. The docs send production use of those models to sales or to Model Vault

Score by category

CategoryWeight this runCloudflare AI GatewayCohere Chat API (Command models)Edge
Reliability16%206664Cloudflare AI Gateway +2
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27584Cohere Chat API (Command models) +9
Agent ergonomics13%16.27372Cloudflare AI Gateway +1
Security & auth14%17.57557Cloudflare AI Gateway +18
Payments & pricing10%12.55230Cloudflare AI Gateway +22
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87572Cloudflare AI Gateway +3
Transparency & trust7%8.87374Cohere Chat API (Command models) +1
Negative events≤15-30
Total66.8 · B64.7 · B

Facts side by side

FactCloudflare AI GatewayCohere Chat API (Command models)
KindModel routerModel API
VendorCloudflare, Inc.Cohere
Hosted endpointhttps://api.cloudflare.com/client/v4/accounts/{account_id}/aihttps://api.cohere.com/v2/chat
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingFreemiumFreemium
x402payer tooling onlyno
LicenceProprietary service under Cloudflare's Self-Serve Subscription Agreement and its service-specific terms. Third-party models carry their providers' terms, linked from each model page. ai-gateway-provider is MIT and Cloudflare's OpenAPI repository is BSD-3-ClauseProprietary service under Cohere's Commercial SaaS Agreement. The SDKs are MIT
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-062026-09-09
Terms last updated2025-09-122025-04-08
Privacy policy last updatedno date given2026-05-01
Customer content may train modelsnot found in the textyes
Terms restrict automated accessyesnot found in the text
Terms restrict benchmarkingnot found in the textyes
Terms or service can change without noticeyesyes
Arbitration or class-action waiveryesnot found in the text
Popularity251k npm/wknone

Verdicts

Cloudflare AI Gateway

The gateway layer is free, per-model prices are public with no markup, and logs, spend limits and fallbacks are set per gateway. API tokens cannot be limited to one gateway, the service terms take third-party models outside Cloudflare's DPA, no SLA names the product, and error codes changed on 6 October 2026 with same-day notice.

Cohere Chat API (Command models)

A public OpenAPI file, Markdown twins of every docs page and SDKs in four languages make the Chat API easy for an agent to read. Production keys do not cover the four newest Command models, whose limits are set by sales, and the SaaS agreement lets Cohere share API data with third parties.

Before you call either

Cloudflare AI Gateway

  1. Use the REST API at api.cloudflare.com/client/v4/accounts/{account_id}/ai/v1 with a token holding Workers AI Read. A token with only an AI Gateway permission returns 401 with code 10000
  2. Send cf-aig-gateway-id on every Workers AI (@cf/) call and on dynamic routes. Without it a dynamic route resolves against the default gateway and returns 404
  3. Set cf-aig-collect-log: false or cf-aig-collect-log-payload: false on sensitive requests. Logging of prompts and responses is on by default
  4. Treat a 429 as a rate limit or a spent budget and a 401 with code 2009 as a rejected provider key. Do not retry a 2009
  5. Set byok_only on the gateway or send cf-aig-no-wholesale: true to stop a request without a provider key falling through to paid Unified Billing credits

Cohere Chat API (Command models)

  1. Call POST https://api.cohere.com/v2/chat with Authorization: bearer <key>. model and messages are the only required fields
  2. Use command-a-03-2025, command-r-08-2024, command-r-plus-08-2024 or command-r7b-12-2024 for production traffic. Newer variants stay at trial limits on a production key
  3. Keep a trial key under 20 chat requests a minute and 1,000 calls a month, and do not use it for commercial work
  4. Set response_format with a json_schema for structured output, and tell the model to produce JSON when using json_object without a schema
  5. Ask the account Owner to turn off training under Data Controls in the dashboard before sending confidential prompts

Questions

Which is better for AI agents, Cloudflare AI Gateway or Cohere Chat API (Command models)?

Cloudflare AI Gateway scores 66.8 (B) on agent readiness against Cohere Chat API (Command models)'s 64.7 (B), and leads in 5 of 7 scored categories. Cohere Chat API (Command models) leads on schema & documentation.

Do Cloudflare AI Gateway and Cohere Chat API (Command models) need an API key?

Both need an API key.

Can an agent call Cloudflare AI Gateway and Cohere Chat API (Command models) without installing anything?

Yes. Cloudflare AI Gateway has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai and Cohere Chat API (Command models) at https://api.cohere.com/v2/chat.

Other comparisons with Cloudflare AI Gateway or Cohere Chat API (Command models)

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.

Get an auditSee a sample report