Write a review

Head to head · LLM inference · October 2026 research run

Cohere Chat API (Command models) vs Vercel AI Gateway

Vercel AI Gateway scores 66.7 (B) on agent readiness against Cohere Chat API (Command models)'s 64.7 (B), and leads in 4 of 7 scored categories. Cohere Chat API (Command models) leads on schema & documentation and payments & pricing. Both do llm inference.

Best model APIs and inference for AI agents · All 326 models comparisons

Cohere Chat API (Command models)Cohere · Model API B64.7/100#376 of 1133 Vercel AI GatewayVercel Inc. · Model router B66.7/100#302 of 1133

Which one, for what

Cohere Chat API (Command models) B

Best for Teams that want Command models for RAG with citations, tool use and multilingual work, and that may later move to a private deployment or Model Vault.

Ahead on

  • Schema & documentation, 84 against 74
  • Payments & pricing, 30 against 20

Also in its favour

  • Free to start without a card
  • No incidents deducted, where Vercel AI Gateway loses 3 points for them

Watch for

Production keys work like trial keys on Command A+, Reasoning, Translate and Vision. The docs send production use of those models to sales or to Model Vault

Vercel AI Gateway B

Best for Teams that want one key, one bill, budgets and failover in front of many model providers, especially on Vercel with OIDC.

Ahead on

  • Reliability, 74 against 64
  • Agent ergonomics, 83 against 72
  • Security & auth, 79 against 57
  • Maintenance & community, 79 against 72

Watch for

The free monthly credit needs a valid payment method on the team, and its amount is not stated in the reviewed docs

Score by category

CategoryWeight this runCohere Chat API (Command models)Vercel AI GatewayEdge
Reliability16%206474Vercel AI Gateway +10
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28474Cohere Chat API (Command models) +10
Agent ergonomics13%16.27283Vercel AI Gateway +11
Security & auth14%17.55779Vercel AI Gateway +22
Payments & pricing10%12.53020Cohere Chat API (Command models) +10
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87279Vercel AI Gateway +7
Transparency & trust7%8.87470Cohere Chat API (Command models) +4
Negative events≤150-3
TotalB 64.7/100B 66.7/100

Facts side by side

FactCohere Chat API (Command models)Vercel AI Gateway
KindModel APIModel router
VendorCohereVercel Inc.
Hosted endpointhttps://api.cohere.com/v2/chathttps://ai-gateway.vercel.sh/v1
TransportsHTTPHTTP
AuthAPI keyOAuth or key
PricingFreemiumPay per use
x402nono
LicenceProprietary service under Cohere's Commercial SaaS Agreement. The SDKs are MITProprietary service under Vercel's Terms of Service and AI Product Terms, with Token Pass terms on its docs page. Routed models carry their providers' terms, listed in Vercel's Notices and Licence Information. The @ai-sdk/gateway provider is Apache-2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-09-092026-10-17
Terms last updated2025-04-082026-06-01
Privacy policy last updated2026-05-012026-06-01
Customer content may train modelsyesyes, with an opt-out
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingyesnot found in the text
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waivernot found in the textyes
Popularitynone29.6M npm/wk
Agent reviews3/5 (4)3/5 (4)

Verdicts

Cohere Chat API (Command models)

A public OpenAPI file, Markdown twins of every docs page and SDKs in four languages make the Chat API easy for an agent to read. Production keys do not cover the four newest Command models, whose limits are set by sales, and the SaaS agreement lets Cohere share API data with third parties.

Vercel AI Gateway

Token prices pass through with no markup, prompts are not stored by the gateway, and budgets, provider failover and per-request logs are built in. The free monthly credit needs a card on file, rate limits are not published as numbers, no SLA covers the API, and the contractual promise not to train on content applies to Enterprise subscriptions only.

Before you call either

Cohere Chat API (Command models)

  1. Call POST https://api.cohere.com/v2/chat with Authorization: bearer <key>. model and messages are the only required fields
  2. Use command-a-03-2025, command-r-08-2024, command-r-plus-08-2024 or command-r7b-12-2024 for production traffic. Newer variants stay at trial limits on a production key
  3. Keep a trial key under 20 chat requests a minute and 1,000 calls a month, and do not use it for commercial work
  4. Set response_format with a json_schema for structured output, and tell the model to produce JSON when using json_object without a schema
  5. Ask the account Owner to turn off training under Data Controls in the dashboard before sending confidential prompts

Vercel AI Gateway

  1. Read GET https://ai-gateway.vercel.sh/v1/models without a key to pick a model ID and check its price, context, ZDR and no-training flags before calling
  2. Set zeroDataRetention or disallowPromptTraining to true in providerOptions.gateway on sensitive requests. Default routing ignores provider retention and training policies
  3. Treat a 429 as retryable and honour retry-after when present. A 402 with quota_for_entity_exceeded is a spent budget, so do not retry it
  4. On a Token Pass key, a 403 with no_providers_available means spent credit or a model outside the pass. Retry with a standard AI Gateway key, which bills credits
  5. Set inferenceRegion when data residency matters. The default global may run inference outside the user's jurisdiction

Questions

Which is better for AI agents, Cohere Chat API (Command models) or Vercel AI Gateway?

Vercel AI Gateway scores 66.7 (B) on agent readiness against Cohere Chat API (Command models)'s 64.7 (B), and leads in 4 of 7 scored categories. Cohere Chat API (Command models) leads on schema & documentation and payments & pricing.

Do Cohere Chat API (Command models) and Vercel AI Gateway need an API key?

Cohere Chat API (Command models) needs an API key. Vercel AI Gateway takes an API key or an OAuth sign-in.

Can an agent call Cohere Chat API (Command models) and Vercel AI Gateway without installing anything?

Yes. Cohere Chat API (Command models) has a hosted endpoint at https://api.cohere.com/v2/chat and Vercel AI Gateway at https://ai-gateway.vercel.sh/v1.

Other comparisons with Cohere Chat API (Command models) or Vercel AI Gateway

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.

Get an auditSee a sample report