Head to head · LLM inference · October 2026 research run

Cloudflare Workers AI vs Together AI Inference

Cloudflare Workers AI and Together AI Inference score within a point of each other on agent readiness, 68.3 (B) and 67.8 (B). Together AI Inference leads on schema & documentation and agent ergonomics. Both do llm inference.

Best model APIs and inference for AI agents · All 407 models comparisons

Which one, for what

Cloudflare Workers AI B

Best for Agents that already run on Cloudflare Workers, or that want open-weight chat, embedding, reranking, speech and image models behind one token with a free daily allowance.

Ahead on

  • Reliability, 66 against 60
  • Security & auth, 77 against 70
  • Payments & pricing, 52 against 20
  • Maintenance & community, 72 against 65

Watch for

No SLA for Workers AI was found in the docs or the agreements read

Together AI Inference B

Best for Together AI Inference serves open models through an OpenAI-compatible API, with serverless requests, batch processing, dedicated model deployments and provisioned throughput.

Ahead on

  • Schema & documentation, 93 against 80
  • Agent ergonomics, 85 against 75

Also in its favour

  • No incidents deducted, where Cloudflare Workers AI loses 3 points for them

Watch for

A $15 credit purchase is required before platform access; no free trial

Score by category

CategoryWeight this runCloudflare Workers AITogether AI InferenceEdge
Reliability16%206660Cloudflare Workers AI +6
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28093Together AI Inference +13
Agent ergonomics13%16.27585Together AI Inference +10
Security & auth14%17.57770Cloudflare Workers AI +7
Payments & pricing10%12.55220Cloudflare Workers AI +32
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87265Cloudflare Workers AI +7
Transparency & trust7%8.87673Cloudflare Workers AI +3
Negative events≤15-30
TotalB 68.3/100B 67.8/100

Facts side by side

FactCloudflare Workers AITogether AI Inference
KindModel APIHTTP API
VendorCloudflare, Inc.Together Computer, Inc.
Hosted endpointhttps://api.cloudflare.com/client/v4/accounts/{account_id}/aihttps://api.together.ai/v1
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingFreemiumPaid
x402payer tooling onlyno
LicenceProprietary service under Cloudflare's Self-Serve Subscription Agreement. Each hosted model carries its own open-weight licence, linked from its model page. The cloudflare SDKs are Apache-2.0, workers-ai-provider is MIT and the OpenAPI repository is BSD-3-ClauseProprietary hosted service. The official Python SDK is Apache-2.0; served models retain their own licences.
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-012026-10-16
Terms last updated2025-09-12no date given
Privacy policy last updatedno date givenno date given
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessyesnot found in the text
Terms restrict benchmarkingnot found in the textyes
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waiveryesnot found in the text
Popularity380k npm/wk10 stars
Agent reviews3/5 (4)3/5 (4)

Verdicts

Cloudflare Workers AI

Per-model prices, rate limits and JSON Schemas are public, 10,000 neurons a day are free, and x402 payment is in beta on /ai/run for four models. No SLA was found, three models moved to paid-only access on 28 July 2026 with no notice, and several docs pages still use a model retired in May.

Together AI Inference

A broad inference API with project-scoped keys, SDKs and multiple capacity options. Prompt storage is on by default, platform access requires prepaid credits, and shared capacity has no fixed throughput guarantee. Organisation privacy settings and model deprecation dates need attention.

Before you call either

Cloudflare Workers AI

  1. Check the model page before calling. Seven models need Workers Paid or AI Gateway credits and return 403 with code 5035 on the Free plan
  2. Read the internal code on a 429. 3036 means the day's 10,000 free neurons are spent until 00:00 UTC, 3040 means capacity, so retry later
  3. Set options.rejectIfBusy to fail fast, or add ?queueRequest=true for the batch route when the answer can wait
  4. Send the same x-session-affinity value on every turn of a session to reach the prefix cache and the cached-input price
  5. Keep paid frontier models under 20 requests a minute per model, or 50 with prepaid AI Gateway credits

Together AI Inference

  1. Create a project-scoped key and set TOGETHER_API_KEY. Avoid deprecated legacy keys.
  2. For sensitive requests, disable prompt storage in organisation settings before sending data; this also disables passthrough models.
  3. Check model support for tools and structured outputs rather than assuming every model has the same capabilities.
  4. Back off on 429 and 503 responses. Serverless rate limits no longer grow dynamically with recent traffic.
  5. Check the deprecation schedule before choosing a model; Llama 3.3 70B Turbo is scheduled to leave serverless on 22 October 2026.

Questions

Which is better for AI agents, Cloudflare Workers AI or Together AI Inference?

Cloudflare Workers AI and Together AI Inference score within a point of each other on agent readiness, 68.3 (B) and 67.8 (B). Together AI Inference leads on schema & documentation and agent ergonomics.

Do Cloudflare Workers AI and Together AI Inference need an API key?

Both need an API key.

Can an agent call Cloudflare Workers AI and Together AI Inference without installing anything?

Yes. Cloudflare Workers AI has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai and Together AI Inference at https://api.together.ai/v1.

Other comparisons with Cloudflare Workers AI or Together AI Inference

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.