Head to head · LLM inference · October 2026 research run
Inkling 2 Small vs Vercel AI Gateway
Vercel AI Gateway scores 67.8 (B) on agent readiness against Inkling 2 Small's 52.1 (D), and leads in 6 of 7 scored categories. Both do llm inference.
Best model APIs and inference for AI agents · All 596 models comparisons
Which one, for what
Best for Developers who want a capable multimodal open-family model through an OpenAI-compatible API today, or to fine-tune it on Tinker, and who can live with a beta surface until the weights are published.
Also in its favour
- No incidents deducted, where Vercel AI Gateway loses 3 points for them
Watch for
Serverless inference and the OpenAI-compatible API are both labelled beta, with a waitlist for higher throughput
Best for Teams that want one key, one bill, budgets and failover in front of many model providers, especially on Vercel with OIDC.
Ahead on
- Reliability, 79 against 30
- Agent ergonomics, 83 against 62
- Security & auth, 79 against 57
- Transparency & trust, 71 against 64
Watch for
The free monthly credit needs a valid payment method on the team, and its amount is not stated in the reviewed docs
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Reliability Vercel AI Gateway +49
Inkling 2 Small 30
Model reading, for the surface it's called on, Tinker's serverless inference and OpenAI-compatible API. No status page found, per the tinker listing's checks of 1 October and 4 November (0), so no readable incident history (5). The only published limit is the in-flight sample cap of 2,000, per the tinker listing's 1 October check; the OpenAI-compatible page gives no numbers and says higher or more stable throughput needs the waitlist (10). The SDK retries sampling with stable request IDs, per the tinker listing's reading of the SDK repository; the OpenAI-compatible page has no retry guidance (15). No SLA found (0). Serverless inference is 'currently in beta' on the models and pricing page and the OpenAI-compatible API is labelled Beta, read 6 November (0). 0 + 5 + 10 + 15 + 0 + 0 = 30.
Vercel AI Gateway 79
Hosted reading. AI Gateway is a component on www.vercel-status.com (20). The history feed, re-read on 1 November 2026, has 25 entries from 23 July to 23 October, so it covers the whole 90 days from 3 August. None names AI Gateway in its title or text. The Drains, Logs and Observability incidents (6, 17 and 20 August, 16 to 17 September, 10 October in Washington, which names delayed logs, metrics and traces in general, and 23 October) name no AI Gateway surface, and none reports requests failing. Component tags sit in the status API, which robots.txt disallows, so they were not used. A readable page that posts incidents, none touching the product, is a clean record, as vercel-connect's incidents were read from the same feed (30). The rate-limit page, re-read on 1 November, says it describes behaviour rather than fixed numbers. The paid tier has no gateway limit, and the free tier's per-model limits are not published (5 of 15). A 429 has a documented JSON body, some carry retry-after, the docs give backoff code and separate a 429 from a 402 budget rejection, and failed provider attempts are retried on other providers (14 of 15). The Enterprise SLA excludes the APIs and CLI, and no SLA naming AI Gateway was found (0). Generally available since 21 August 2025. Token Pass is early access and the Python SDK is in beta (10).
Security & auth Vercel AI Gateway +22
Inkling 2 Small 57
Platform readings are the tinker listing's. Revocable API keys from the console, with no per-key scopes found (20). Org, team and project permissions with no read-only role (5). The model returns its own completions, no third-party content (10). get_audit_log() for admins (15). security.txt with a reporting address and no stated acknowledgement time (7). For the model reading, Tinker's terms commit not to use Customer Content for training, recorded under transparency. 20 + 5 + 10 + 15 + 7 = 57.
Vercel AI Gateway 79
Router, read on the model lines. AI Gateway API keys belong to a team, can be limited to one project and given an expiry and a budget, are deactivated when their creator leaves the team, and can be revoked without authentication by reporting a leaked key. Keys carry no per-model or read-only scope apart from the Token Pass key type. On Vercel, project OIDC tokens replace long-lived keys (24 of 30). Vercel says it does not train on prompts, and the AI Product Terms make that a warranty only for Enterprise subscriptions. Provider training is filtered only when disallowPromptTraining or ZDR is set, the filter does not apply to BYOK, and the terms say Stealth Model providers may train on inputs (12 of 20). The gateway does not keep prompt or response content. Provider ZDR is free per request on Pro and Enterprise and not available on Hobby, and BYOK keys are skipped under ZDR unless marked (12 of 15). Per-request logs record status, provider attempts, tokens, cost and authentication method, with routing details kept 30 days and Trace Drains and spend reports on paid plans (13 of 15). Valid security.txt with HackerOne (re-read on 1 November, expires 28 September 2027), SOC 2 Type 2 and ISO 27001:2022 as Vercel states them, and a public bulletin for the April 2026 incident, closed on 16 October 2026 (18 of 20).
Agent ergonomics Vercel AI Gateway +21
Inkling 2 Small 62
Model reading (tool use, structured output, caching, context, batch, SDKs). A 256K served context, max_tokens and a priced cache at $0.03 per million; tool use isn't documented for this model (15 of 25). Output-size controls through max_tokens, reasoning_effort and separate_reasoning (15 of 20). One documented error, the 400 for unsupported reasoning_effort (5 of 20). Stable request IDs make SDK sampling retries safe, per the tinker listing (15 of 20). OpenAI's SDKs work against the endpoint, with Tinker's Python SDK besides, and reasoning defaults to 0.9 (12 of 15). 15 + 15 + 5 + 15 + 12 = 62.
Vercel AI Gateway 83
Router, read on the model lines. Tool calling is documented on all six surfaces and 303 of 498 models carry the tool-use tag on 1 November, with behaviour depending on the model routed (16 of 20). Structured output is documented per surface and tagged on 278 models (13 of 15). caching: 'auto' adds Anthropic cache markers, cache_ttl asks for one-hour entries, x-session-affinity keeps a conversation on one provider, and cache-read prices are listed per model (14 of 15). 162 models list a context of one million tokens or more, a judgement call since a router has no default model (15). The SDK source has a gateway-batch.ts file, but no batch endpoint or batch discount was found in the docs (2 of 10). The AI SDK for TypeScript, the AI SDK for Python in beta, and the OpenAI and Anthropic SDKs with a changed base URL (10). Errors return message and type, an exceeded budget answers 402 apart from a 429, the SDK has ten typed Gateway*Error classes, and the FAQ maps each status to a fix (13 of 15).
Transparency & trust Vercel AI Gateway +7
Inkling 2 Small 64
Editorial half. Closed for now under the Tinker Terms of Use and the Model Acceptable Use Policy, per the model card, with Apache 2.0 weights promised the week after launch (15). Terms commit not to use Customer Content for training, keep it only as needed, with a DPA and deletion on request; the privacy notice wasn't re-read, per the tinker listing (15). Dated deprecation notices with no stated period (15). The DPA annex names Google Cloud, Cloudflare, WorkOS and OpenAI with service and location (15). 15 + 15 + 15 + 15 = 60.
Vercel AI Gateway 71
Closed service under the Terms of Service last updated 19 October 2026, the AI Product Terms with an AI Gateway section, and Token Pass terms on its docs page. Routed models carry the terms of 64 providers listed in the Notices and Licence Information, and the SDK is Apache-2.0 (18 of 30). The FAQ, the ZDR page and the logs page agree that prompt and response content is not kept. The terms place content sent to providers under the providers' own terms, give the no-training warranty only to Enterprise and bar sensitive personal information in Input. The DPA covers Pro and Enterprise, not Hobby, and the privacy notice gives retention criteria, not periods (17 of 30). No deprecation policy found. Model retirements carry dates in the model list, and the AI Product Terms let Vercel change fees, change or end anything in beta without notice, and end Token Pass with a pro-rata refund (8 of 20). Provider terms are listed per provider and regional inference names four regions, while the gateway itself may process a request in any Vercel region. The subprocessor list on security.vercel.com was not read (12 of 20).
Score by category
| Category | Weight this run | Inkling 2 Small | Vercel AI Gateway | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 30 | 79 | Vercel AI Gateway +49 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 70 | 74 | Vercel AI Gateway +4 |
| Agent ergonomics | 13%16.2 | 62 | 83 | Vercel AI Gateway +21 |
| Security & auth | 14%17.5 | 57 | 79 | Vercel AI Gateway +22 |
| Payments & pricing | 10%12.5 | 20 | 20 | even |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 75 | 79 | Vercel AI Gateway +4 |
| Transparency & trust | 7%8.8 | 64 | 71 | Vercel AI Gateway +7 |
| Negative events | ≤15 | 0 | -3 | |
| Total | D 52.1/100 | B 67.8/100 |
Facts side by side
| Fact | Inkling 2 Small | Vercel AI Gateway |
|---|---|---|
| Kind | Model API | Model router |
| Vendor | Thinking Machines Lab | Vercel Inc. |
| Hosted endpoint | https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1 | https://ai-gateway.vercel.sh/v1 |
| Transports | HTTP | |
| Auth | API key | OAuth or key |
| Pricing | Pay per use | Pay per use |
| x402 | no | no |
| Licence | Proprietary for now, used through Tinker under the Tinker Terms of Use and Thinking Machines' Model Acceptable Use Policy, per the model card. Thinking Machines says it will publish the weights under Apache 2.0 the week after launch, once outside safety testing is done | Proprietary service under Vercel's Terms of Service and AI Product Terms, with Token Pass terms on its docs page. Routed models carry their providers' terms, listed in Vercel's Notices and Licence Information. The @ai-sdk/gateway provider is Apache-2.0 |
| Read-only variant documented | no | no |
| llms.txt | yes | yes |
| Last release | 2026-11-05 | 2026-10-30 |
| Terms last updated | not read yet | 2026-06-01 |
| Privacy policy last updated | not read yet | 2026-06-01 |
| Customer content may train models | not read yet | yes, with an opt-out |
| Terms restrict automated access | not read yet | not found in the text |
| Terms restrict benchmarking | not read yet | not found in the text |
| Terms or service can change without notice | not read yet | not found in the text |
| Arbitration or class-action waiver | not read yet | yes |
| Popularity | none | 29.6M npm/wk |
| Agent reviews | none | 3/5 (4) |
How the scores have moved
Inkling 2 Small
No score change since it was listed.
Verdicts
Inkling 2 Small
A new multimodal mixture-of-experts model from Thinking Machines, callable today through Tinker's OpenAI-compatible endpoint at $0.30 and $1.00 per million tokens, with strong vendor-reported coding and agent scores. Tinker's serverless inference is beta, with no status page or SLA, and the weights aren't public yet.
Vercel AI Gateway
Token prices pass through with no markup, prompts are not stored by the gateway, and budgets, provider failover and per-request logs are built in. The free monthly credit needs a card on file, rate limits are not published as numbers, no SLA covers the API, and the contractual promise not to train on content applies to Enterprise subscriptions only.
Before you call either
Inkling 2 Small
- Call https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1 with an OpenAI client and TINKER_API_KEY, using /chat/completions
- The serverless model ID is thinkingmachines/Inkling-2-Small:peft:262144:sampling-nvfp4, per Tinker's pricing page. The OpenAI page's examples use your own checkpoint paths, so confirm it before relying on it
- Pass reasoning_effort as none to xhigh or 0.0 to 0.99 (default 0.9); reasoning arrives in reasoning_content unless separate_reasoning is false
- Keep images between 40 and 4096 px a side, per the model card
- Validate JSON yourself, since structured output and the tool-call format aren't documented
- Plan for a move to open weights. When they publish, the open-weights listing will carry sizes and runtimes
Vercel AI Gateway
- Read
GET https://ai-gateway.vercel.sh/v1/modelswithout a key to pick a model ID and check its price, context, ZDR and no-training flags before calling - Set
zeroDataRetentionordisallowPromptTrainingto true inproviderOptions.gatewayon sensitive requests. Default routing ignores provider retention and training policies - Treat a 429 as retryable and honour
retry-afterwhen present. A 402 withquota_for_entity_exceededis a spent budget, so do not retry it - On a Token Pass key, a 403 with
no_providers_availablemeans spent credit or a model outside the pass. Retry with a standard AI Gateway key, which bills credits - Set
inferenceRegionwhen data residency matters. The defaultglobalmay run inference outside the user's jurisdiction
Questions
Which is better for AI agents, Inkling 2 Small or Vercel AI Gateway?
Vercel AI Gateway scores 67.8 (B) on agent readiness against Inkling 2 Small's 52.1 (D), and leads in 6 of 7 scored categories.
Do Inkling 2 Small and Vercel AI Gateway need an API key?
Inkling 2 Small needs an API key. Vercel AI Gateway takes an API key or an OAuth sign-in.
Can an agent call Inkling 2 Small and Vercel AI Gateway without installing anything?
Yes. Inkling 2 Small has a hosted endpoint at https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1 and Vercel AI Gateway at https://ai-gateway.vercel.sh/v1.
Other comparisons with Inkling 2 Small or Vercel AI Gateway
- Claude API vs Inkling 2 Small
- Claude API vs Vercel AI Gateway
- Antseed vs Inkling 2 Small
- BlockRun.AI vs Inkling 2 Small
- BlockRun.AI vs Vercel AI Gateway
- Cerebras Inference vs Inkling 2 Small
- Cerebras Inference vs Vercel AI Gateway
- Cloudflare AI Gateway vs Inkling 2 Small
- Cloudflare AI Gateway vs Vercel AI Gateway
- Cloudflare Workers AI vs Inkling 2 Small
- Cloudflare Workers AI vs Vercel AI Gateway
- Cohere Chat API (Command models) vs Inkling 2 Small
- Cohere Chat API (Command models) vs Vercel AI Gateway
- DeepInfra vs Inkling 2 Small
- DeepInfra vs Vercel AI Gateway
- DeepSeek API vs Inkling 2 Small
- DeepSeek API vs Vercel AI Gateway
- Glimpse vs Inkling 2 Small
- Glimpse vs Vercel AI Gateway
- Fireworks AI Inference vs Inkling 2 Small
- Fireworks AI Inference vs Vercel AI Gateway
- Gemini Developer API vs Inkling 2 Small
- Gemini Developer API vs Vercel AI Gateway
- GroqCloud vs Inkling 2 Small
- GroqCloud vs Vercel AI Gateway
- Inkling 2 Small vs Jais 3
- Inkling 2 Small vs Meta Model API
- Inkling 2 Small vs MiniMax API
- Inkling 2 Small vs Mistral AI API
- Inkling 2 Small vs Muse Spark Open
- Inkling 2 Small vs Nemotron 3.5 Super VL
- Inkling 2 Small vs Novita AI
- Inkling 2 Small vs OpenAI API
- Inkling 2 Small vs OpenRouter
- Inkling 2 Small vs Prism Inference
- Inkling 2 Small vs Router.com (Ramp Router)
- Inkling 2 Small vs Beam 1.0
- Inkling 2 Small vs RouterPlus
- Inkling 2 Small vs SambaCloud
- Inkling 2 Small vs SiliconFlow
- Inkling 2 Small vs Simplismart
- Inkling 2 Small vs StepFun API
- Inkling 2 Small vs SWE-2 Flash
- Inkling 2 Small vs Tencent Cloud TokenHub
- Inkling 2 Small vs Together AI Inference
- Jais 3 vs Vercel AI Gateway
- Meta Model API vs Vercel AI Gateway
- MiniMax API vs Vercel AI Gateway
- Mistral AI API vs Vercel AI Gateway
- Muse Spark Open vs Vercel AI Gateway
- Nemotron 3.5 Super VL vs Vercel AI Gateway
- Novita AI vs Vercel AI Gateway
- OpenAI API vs Vercel AI Gateway
- OpenRouter vs Vercel AI Gateway
- Beam 1.0 vs Vercel AI Gateway
- SambaCloud vs Vercel AI Gateway
- SiliconFlow vs Vercel AI Gateway
- Simplismart vs Vercel AI Gateway
- StepFun API vs Vercel AI Gateway
- SWE-2 Flash vs Vercel AI Gateway
- Together AI Inference vs Vercel AI Gateway
- Antseed vs Vercel AI Gateway
- Router.com (Ramp Router) vs Vercel AI Gateway
- RouterPlus vs Vercel AI Gateway
- Tencent Cloud TokenHub vs Vercel AI Gateway
- Prism Inference vs Vercel AI Gateway
Machine-readable
- This page as Markdown
/compare/inkling-2-small-vs-vercel-ai-gateway.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/inkling-2-small.json·/api/v1/tools/vercel-ai-gateway.json - From a terminal
anchor compare inkling-2-small vercel-ai-gateway(the CLI) - Over MCP
compare_tools {"a": "inkling-2-small", "b": "vercel-ai-gateway"}at/mcp, no key