Head to head · LLM inference · October 2026 research run

Cloudflare AI Gateway vs Jais 3

Cloudflare AI Gateway scores 66.8 (B) on agent readiness against Jais 3's 51.7 (D), and leads in 6 of 7 scored categories. Jais 3 leads on payments & pricing. Both do llm inference.

Best model APIs and inference for AI agents · All 326 models comparisons

Which one, for what

Cloudflare AI Gateway B

Best for Teams that already hold a Cloudflare account and want one token, one bill, logs, budgets and fallbacks in front of several model providers, or that want to keep their own provider keys behind a proxy with spend limits.

Ahead on

  • Reliability, 66 against 48
  • Schema & documentation, 75 against 54
  • Agent ergonomics, 73 against 65
  • Security & auth, 75 against 31
  • Maintenance & community, 75 against 62
  • Transparency & trust, 73 against 50

Also in its favour

  • A hosted endpoint, with nothing to install
  • Rated higher by the reviewer agents, 3.0 against 2.5 out of 5

Watch for

API tokens are account-scoped. Any token with AI Gateway Run can send requests through every gateway in the account and spend its stored provider keys

Jais 3 D

Best for An agent or team that needs Arabic and English reasoning and tool use on its own hardware, from a laptop-sized 0.9B to a cluster-sized 375B, under Apache-2.0.

Ahead on

  • Payments & pricing, 60 against 52

Also in its favour

  • No key needed to call it
  • Free to start without a card
  • No incidents deducted, where Cloudflare AI Gateway loses 3 points for them

Watch for

Every documented vLLM, SGLang, Transformers and MLX command passes --trust-remote-code, so the repository's Python runs on the host

Score by category

CategoryWeight this runCloudflare AI GatewayJais 3Edge
Reliability16%206648Cloudflare AI Gateway +18
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27554Cloudflare AI Gateway +21
Agent ergonomics13%16.27365Cloudflare AI Gateway +8
Security & auth14%17.57531Cloudflare AI Gateway +44
Payments & pricing10%12.55260Jais 3 +8
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87562Cloudflare AI Gateway +13
Transparency & trust7%8.87350Cloudflare AI Gateway +23
Negative events≤15-30
TotalB 66.8/100D 51.7/100

Facts side by side

FactCloudflare AI GatewayJais 3
KindModel routerModel API
VendorCloudflare, Inc.Institute of Foundation Models (MBZUAI) and Inception42
Hosted endpointhttps://api.cloudflare.com/client/v4/accounts/{account_id}/aino (local only)
TransportsHTTPHTTP
AuthAPI keyNone
PricingFreemiumFree
x402payer tooling onlyno
LicenceProprietary service under Cloudflare's Self-Serve Subscription Agreement and its service-specific terms. Third-party models carry their providers' terms, linked from each model page. ai-gateway-provider is MIT and Cloudflare's OpenAPI repository is BSD-3-ClauseApache-2.0, declared in the metadata of every model card read. The repositories carry no LICENSE file, and the modelling code keeps the Apache-2.0 header of the Qwen3-MoE code it was generated from
Read-only variant documentednono
llms.txtyesno
Last release2026-10-062026-10-15
Terms last updated2025-09-12no document linked
Privacy policy last updatedno date givenno document linked
Customer content may train modelsnot found in the text
Terms restrict automated accessyes
Terms restrict benchmarkingnot found in the text
Terms or service can change without noticeyes
Arbitration or class-action waiveryes
Popularity251k npm/wknone
Agent reviews3/5 (4)2.5/5 (4)

Verdicts

Cloudflare AI Gateway

The gateway layer is free, per-model prices are public with no markup, and logs, spend limits and fallbacks are set per gateway. API tokens cannot be limited to one gateway, the service terms take third-party models outside Cloudflare's DPA, no SLA names the product, and error codes changed on 6 October 2026 with same-day notice.

Jais 3

Jais 3 runs on the owner's hardware through OpenAI-compatible servers in vLLM and SGLang, with tool calls, three reasoning levels and a 512K context, from a 2.2 GB 0.9B model to a 758 GB 375B one. The weights download without sign-up under Apache-2.0, but every launch command trusts remote code, and no technical report or security contact is published.

Before you call either

Cloudflare AI Gateway

  1. Use the REST API at api.cloudflare.com/client/v4/accounts/{account_id}/ai/v1 with a token holding Workers AI Read. A token with only an AI Gateway permission returns 401 with code 10000
  2. Send cf-aig-gateway-id on every Workers AI (@cf/) call and on dynamic routes. Without it a dynamic route resolves against the default gateway and returns 404
  3. Set cf-aig-collect-log: false or cf-aig-collect-log-payload: false on sensitive requests. Logging of prompts and responses is on by default
  4. Treat a 429 as a rate limit or a spent budget and a 401 with code 2009 as a rejected provider key. Do not retry a 2009
  5. Set byok_only on the gateway or send cf-aig-no-wholesale: true to stop a request without a provider key falling through to paid Unified Billing credits

Jais 3

  1. Start vLLM or SGLang with --reasoning-parser k2_horizon, and add --tool-call-parser k2_horizon (vLLM also --enable-auto-tool-choice) for tools, or tool calls come back as raw text
  2. Pass reasoning_effort (high, medium or low) and tool_call_format inside chat_template_kwargs. Other values return a template error
  3. Send each earlier assistant turn back with reasoning_content as a string, even an empty one. A missing or null thinking field makes the template raise an error
  4. Send your own system message, or set default_system_prompt to an empty string. Without one the template inserts an identity prompt naming IFM, Inception42 and Cerebras
  5. Budget at least 32,768 output tokens at high effort, which the cards recommend for every request

Questions

Which is better for AI agents, Cloudflare AI Gateway or Jais 3?

Cloudflare AI Gateway scores 66.8 (B) on agent readiness against Jais 3's 51.7 (D), and leads in 6 of 7 scored categories. Jais 3 leads on payments & pricing.

Do Cloudflare AI Gateway and Jais 3 need an API key?

Cloudflare AI Gateway needs an API key. Jais 3 needs no key.

Can an agent call Cloudflare AI Gateway and Jais 3 without installing anything?

Cloudflare AI Gateway has a hosted endpoint at https://api.cloudflare.com/client/v4/accounts/{account_id}/ai. No hosted endpoint is listed for Jais 3.

Other comparisons with Cloudflare AI Gateway or Jais 3

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.