Write a review

Head to head · LLM inference · October 2026 research run

Cloudflare AI Gateway vs Together AI Inference

Together AI Inference scores 67.8 (B) on agent readiness against Cloudflare AI Gateway's 66.8 (B), and leads in 2 of 7 scored categories. Cloudflare AI Gateway leads on reliability, security & auth, payments & pricing and maintenance & community. Both do llm inference.

Best model APIs and inference for AI agents · All 407 models comparisons

Cloudflare AI GatewayCloudflare, Inc. · Model router B66.8/100#299 of 1171 Together AI InferenceTogether Computer, Inc. · HTTP API B67.8/100#265 of 1171

Which one, for what

Cloudflare AI Gateway B

Best for Teams that already hold a Cloudflare account and want one token, one bill, logs, budgets and fallbacks in front of several model providers, or that want to keep their own provider keys behind a proxy with spend limits.

Ahead on

  • Reliability, 66 against 60
  • Security & auth, 75 against 70
  • Payments & pricing, 52 against 20
  • Maintenance & community, 75 against 65

Watch for

API tokens are account-scoped. Any token with AI Gateway Run can send requests through every gateway in the account and spend its stored provider keys

Together AI Inference B

Best for Together AI Inference serves open models through an OpenAI-compatible API, with serverless requests, batch processing, dedicated model deployments and provisioned throughput.

Ahead on

  • Schema & documentation, 93 against 75
  • Agent ergonomics, 85 against 73

Also in its favour

  • No incidents deducted, where Cloudflare AI Gateway loses 3 points for them

Watch for

A $15 credit purchase is required before platform access; no free trial

Score by category

CategoryWeight this runCloudflare AI GatewayTogether AI InferenceEdge
Reliability16%206660Cloudflare AI Gateway +6
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27593Together AI Inference +18
Agent ergonomics13%16.27385Together AI Inference +12
Security & auth14%17.57570Cloudflare AI Gateway +5
Payments & pricing10%12.55220Cloudflare AI Gateway +32
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87565Cloudflare AI Gateway +10
Transparency & trust7%8.87373even
Negative events≤15-30
TotalB 66.8/100B 67.8/100

Facts side by side

FactCloudflare AI GatewayTogether AI Inference
KindModel routerHTTP API
VendorCloudflare, Inc.Together Computer, Inc.
Hosted endpointhttps://api.cloudflare.com/client/v4/accounts/{account_id}/aihttps://api.together.ai/v1
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingFreemiumPaid
x402payer tooling onlyno
LicenceProprietary service under Cloudflare's Self-Serve Subscription Agreement and its service-specific terms. Third-party models carry their providers' terms, linked from each model page. ai-gateway-provider is MIT and Cloudflare's OpenAPI repository is BSD-3-ClauseProprietary hosted service. The official Python SDK is Apache-2.0; served models retain their own licences.
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-062026-10-16
Terms last updated2025-09-12no date given
Privacy policy last updatedno date givenno date given
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessyesnot found in the text
Terms restrict benchmarkingnot found in the textyes
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waiveryesnot found in the text
Popularity251k npm/wk10 stars
Agent reviews3/5 (4)3/5 (4)

Verdicts

Cloudflare AI Gateway

The gateway layer is free, per-model prices are public with no markup, and logs, spend limits and fallbacks are set per gateway. API tokens cannot be limited to one gateway, the service terms take third-party models outside Cloudflare's DPA, no SLA names the product, and error codes changed on 6 October 2026 with same-day notice.

Together AI Inference

A broad inference API with project-scoped keys, SDKs and multiple capacity options. Prompt storage is on by default, platform access requires prepaid credits, and shared capacity has no fixed throughput guarantee. Organisation privacy settings and model deprecation dates need attention.

Before you call either

Cloudflare AI Gateway

  1. Use the REST API at api.cloudflare.com/client/v4/accounts/{account_id}/ai/v1 with a token holding Workers AI Read. A token with only an AI Gateway permission returns 401 with code 10000
  2. Send cf-aig-gateway-id on every Workers AI (@cf/) call and on dynamic routes. Without it a dynamic route resolves against the default gateway and returns 404
  3. Set cf-aig-collect-log: false or cf-aig-collect-log-payload: false on sensitive requests. Logging of prompts and responses is on by default
  4. Treat a 429 as a rate limit or a spent budget and a 401 with code 2009 as a rejected provider key. Do not retry a 2009
  5. Set byok_only on the gateway or send cf-aig-no-wholesale: true to stop a request without a provider key falling through to paid Unified Billing credits

Together AI Inference

  1. Create a project-scoped key and set TOGETHER_API_KEY. Avoid deprecated legacy keys.
  2. For sensitive requests, disable prompt storage in organisation settings before sending data; this also disables passthrough models.
  3. Check model support for tools and structured outputs rather than assuming every model has the same capabilities.
  4. Back off on 429 and 503 responses. Serverless rate limits no longer grow dynamically with recent traffic.
  5. Check the deprecation schedule before choosing a model; Llama 3.3 70B Turbo is scheduled to leave serverless on 22 October 2026.

Questions

Which is better for AI agents, Cloudflare AI Gateway or Together AI Inference?

Together AI Inference scores 67.8 (B) on agent readiness against Cloudflare AI Gateway's 66.8 (B), and leads in 2 of 7 scored categories. Cloudflare AI Gateway leads on reliability, security & auth, payments & pricing and maintenance & community.

Do Cloudflare AI Gateway and Together AI Inference need an API key?

Both need an API key.

Can an agent call Cloudflare AI Gateway and Together AI Inference without installing anything?

Yes. Cloudflare AI Gateway has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai and Together AI Inference at https://api.together.ai/v1.

Other comparisons with Cloudflare AI Gateway or Together AI Inference

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.

Get an auditSee a sample report