Get an audit

Head to head · LLM inference · October 2026 research run

Cloudflare AI Gateway vs Prism Inference

Cloudflare AI Gateway scores 66.8 (B) on agent readiness against Prism Inference's 60.1 (C), and leads in 6 of 7 scored categories. Prism Inference leads on schema & documentation. Both do llm inference.

Best model APIs and inference for AI agents · All 136 models comparisons

Cloudflare AI GatewayCloudflare, Inc. · Model router B66.8/100#275 of 950 Prism InferencePrism Technologies Inc · Model API C60.1/100#528 of 950

Which one, for what

Cloudflare AI Gateway B

Good for Teams that already hold a Cloudflare account and want one token, one bill, logs, budgets and fallbacks in front of several model providers, or that want to keep their own provider keys behind a proxy with spend limits.

Ahead on

  • Agent ergonomics, 73 against 68
  • Security & auth, 75 against 65
  • Payments & pricing, 52 against 30
  • Maintenance & community, 75 against 49
  • Transparency & trust, 73 against 61

Watch for

API tokens are account-scoped. Any token with AI Gateway Run can send requests through every gateway in the account and spend its stored provider keys

Prism Inference C

Good for Coding agents that want DeepSeek-V4.1-Flash at a low input price, with no retention, through whichever of the three wire formats the harness already speaks.

Ahead on

  • Schema & documentation, 82 against 75

Watch for

Two models. The docs mark Gemma 4 31B as request access per organisation, while llms.txt and the keyless catalogue list it as available

Score by category

CategoryWeight this runCloudflare AI GatewayPrism InferenceEdge
Reliability16%206665Cloudflare AI Gateway +1
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27582Prism Inference +7
Agent ergonomics13%16.27368Cloudflare AI Gateway +5
Security & auth14%17.57565Cloudflare AI Gateway +10
Payments & pricing10%12.55230Cloudflare AI Gateway +22
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87549Cloudflare AI Gateway +26
Transparency & trust7%8.87361Cloudflare AI Gateway +12
Negative events≤15-3-2
Total66.8 · B60.1 · C

Facts side by side

FactCloudflare AI GatewayPrism Inference
KindModel routerModel API
VendorCloudflare, Inc.Prism Technologies Inc
Hosted endpointhttps://api.cloudflare.com/client/v4/accounts/{account_id}/aihttps://api.prisminference.com/v1
TransportsHTTPHTTP
AuthAPI keyAPI key
PricingFreemiumPay per use
x402payer tooling onlyno
LicenceProprietary service under Cloudflare's Self-Serve Subscription Agreement and its service-specific terms. Third-party models carry their providers' terms, linked from each model page. ai-gateway-provider is MIT and Cloudflare's OpenAPI repository is BSD-3-ClauseProprietary service under Prism's terms of service. The OpenAPI file declares LicenseRef-Proprietary. The Hermes provider plugin repository carries no licence file
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-062026-10-06
Terms last updated2025-09-122026-09-09
Privacy policy last updatedno date given2026-09-09
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessyesyes
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticeyesnot found in the text
Arbitration or class-action waiveryesyes
Popularity251k npm/wknone

Verdicts

Cloudflare AI Gateway

The gateway layer is free, per-model prices are public with no markup, and logs, spend limits and fallbacks are set per gateway. API tokens cannot be limited to one gateway, the service terms take third-party models outside Cloudflare's DPA, no SLA names the product, and error codes changed on 6 October 2026 with same-day notice.

Prism Inference

Three wire formats, a public OpenAPI 3.1 file, per-token prices in a keyless catalogue and zero data retention by default on every tier. The service launched on 24 September 2026 with two models, one of them by request, from a two-person company. No rate-limit numbers, SLA document, free tier or deprecation policy was found.

Before you call either

Cloudflare AI Gateway

  1. Use the REST API at api.cloudflare.com/client/v4/accounts/{account_id}/ai/v1 with a token holding Workers AI Read. A token with only an AI Gateway permission returns 401 with code 10000
  2. Send cf-aig-gateway-id on every Workers AI (@cf/) call and on dynamic routes. Without it a dynamic route resolves against the default gateway and returns 404
  3. Set cf-aig-collect-log: false or cf-aig-collect-log-payload: false on sensitive requests. Logging of prompts and responses is on by default
  4. Treat a 429 as a rate limit or a spent budget and a 401 with code 2009 as a rejected provider key. Do not retry a 2009
  5. Set byok_only on the gateway or send cf-aig-no-wholesale: true to stop a request without a provider key falling through to paid Unified Billing credits

Prism Inference

  1. Call GET https://api.prisminference.com/v1/models at start-up, with no key, and use only ids it returns. Expect 403 on gemma-4-31b without organisation access
  2. Use base URL https://api.prisminference.com/v1 for OpenAI clients and https://api.prisminference.com with no /v1 for Anthropic clients
  3. Read error.retryable before retrying, and wait for Retry-After on 429, which covers both key limits and model capacity
  4. Send reasoning_effort: "none" or low when latency matters. Reasoning is on by default and its tokens are billed as output
  5. Keep conversation state yourself and send store: false on Responses. previous_response_id, stored responses and hosted tools aren't supported

Questions

Which is better for AI agents, Cloudflare AI Gateway or Prism Inference?

Cloudflare AI Gateway scores 66.8 (B) on agent readiness against Prism Inference's 60.1 (C), and leads in 6 of 7 scored categories. Prism Inference leads on schema & documentation.

Do Cloudflare AI Gateway and Prism Inference need an API key?

Both need an API key.

Can an agent call Cloudflare AI Gateway and Prism Inference without installing anything?

Yes. Cloudflare AI Gateway has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai and Prism Inference at https://api.prisminference.com/v1.

Other comparisons with Cloudflare AI Gateway or Prism Inference

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.

Get an auditSee a sample report