Head to head · LLM inference · October 2026 research run

Inkling 2 Small vs SambaCloud

SambaCloud scores 64.9 (B) on agent readiness against Inkling 2 Small's 52.1 (D), and leads in every scored category. Both do llm inference.

Best model APIs and inference for AI agents · All 596 models comparisons

Which one, for what

Inkling 2 Small D

Best for Developers who want a capable multimodal open-family model through an OpenAI-compatible API today, or to fine-tune it on Tinker, and who can live with a beta surface until the weights are published.

Also in its favour

  • No incidents deducted, where SambaCloud loses 5 points for them

Watch for

Serverless inference and the OpenAI-compatible API are both labelled beta, with a waitlist for higher throughput

SambaCloud B

Best for Agents that want open-weight models behind an OpenAI or Anthropic client with a free start and prices an agent can read from the API.

Ahead on

  • Reliability, 85 against 30
  • Schema & documentation, 81 against 70
  • Agent ergonomics, 67 against 62
  • Payments & pricing, 40 against 20
  • Transparency & trust, 73 against 64

Also in its favour

  • Free to start without a card

Watch for

Production models get a notice of two to three weeks, and 13 model ids were removed between 9 March and 9 June 2026

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reliability SambaCloud +55

Inkling 2 Small 30

Model reading, for the surface it's called on, Tinker's serverless inference and OpenAI-compatible API. No status page found, per the tinker listing's checks of 1 October and 4 November (0), so no readable incident history (5). The only published limit is the in-flight sample cap of 2,000, per the tinker listing's 1 October check; the OpenAI-compatible page gives no numbers and says higher or more stable throughput needs the waitlist (10). The SDK retries sampling with stable request IDs, per the tinker listing's reading of the SDK repository; the OpenAI-compatible page has no retry guidance (15). No SLA found (0). Serverless inference is 'currently in beta' on the models and pricing page and the OpenAI-compatible API is labelled Beta, read 6 November (0). 0 + 5 + 10 + 15 + 0 + 0 = 30.

SambaCloud 85

Hosted reading. Status page at status.sambanova.ai on Statuspage, with components for the API gateway, the Playground and each model, read from the page itself on 1 November (20). Its history.atom feed, read on 1 November (the 8 October reading came from the /api/ path, which robots.txt disallows, and is struck), has nothing newer than an 8-minute Playground login fault on 25 June 2026, so nothing is posted for the window from 3 August (30). Limits published per model and tier, 20 requests a minute and 20 a day on the free tier, 60 and 12,000 on the Developer tier, per the 8 October check, not re-read on 1 November (15). x-ratelimit-* headers on every response, the error table says to retry queue_full after a delay, and the SDKs retry 429 and server errors twice with backoff, per the 8 October check. No Retry-After header was found in the docs or the OpenAPI document (10 of 15). No SLA found on the legal page, re-read on 1 November, or in the terms (0). Three production models are generally available, the rest previews, per the 8 October check (10). 20+30+15+10+0+10 = 85.

Payments & pricing SambaCloud +20

Inkling 2 Small 20

Published rubric. No payment protocol (0). Per-million-token prices for serverless inference and training published without a login on 6 November (20). No free tier listed, and the quickstart asks for payment details before training, per the tinker listing (0). Sign-up is a browser flow (0). 0 + 20 + 0 + 0 = 20.

SambaCloud 40

No machine payment protocol (0). Per-token prices on the pricing page, read without a login on 1 November, such as gpt-oss-120b at $0.22 in and $0.59 out per 1M tokens (20). Free tier with no payment method, per the 8 October check (20). A person signs up in the console to get a key (0).

Schema & documentation SambaCloud +11

Inkling 2 Small 70

Model reading. No OpenAPI file of its own; the OpenAI-compatible chat and completions endpoints and the typed Python SDK are the contract, as the tinker listing reads it (15). llms.txt on the docs host, per the tinker listing's 1 October check (10). The model card states intended use (agentic and tool-use systems, coding assistants, chatbots, RAG), inputs, outputs and limitations, and the launch post its benchmarks (16 of 20). Model IDs, context lengths and the reasoning_effort values (none to xhigh, or 0.0 to 0.99) are documented; the tool-call format and structured output aren't, for this model (8 of 15). A Python example and an HTTP 400 for models without reasoning_effort, with no error page (6 of 15). A dated Tinker changelog and a model deprecations page, per the tinker listing (15). 15 + 10 + 16 + 8 + 6 + 15 = 70.

SambaCloud 81

Public OpenAPI 3.1.1 document, still labelled version 1.2.0 though its content changed on 27 October 2026, with 10 operations and 165 schemas (25). llms.txt at docs.sambanova.ai/docs/llms.txt and a Markdown copy of each page, per the 8 October check (docs.sambanova.ai answered robots.txt with a bot check on 1 November, so it wasn't read) (10). 718 descriptions in the document, with pages for function calling, Responses, Messages and caching. When not to use a route is rarely stated (15 of 20). Typed parameters with 150 enums, and request bodies now declare additionalProperties: false, but JSON schema output is best effort and strict: true has no effect (10 of 15). Code examples in Python and TypeScript, and an errors page with 13 codes and a recovery suggestion for each, per the 8 October check (13 of 15). The spec is versioned in its repository, but the version label didn't move with the 27 October changes, the newest SambaCloud release note seen is 7 July 2026, and the models page disagreed with /v1/models on 8 October (8 of 15). 25+10+15+10+13+8 = 81.

Transparency & trust SambaCloud +9

Inkling 2 Small 64

Editorial half. Closed for now under the Tinker Terms of Use and the Model Acceptable Use Policy, per the model card, with Apache 2.0 weights promised the week after launch (15). Terms commit not to use Customer Content for training, keep it only as needed, with a DPA and deletion on request; the privacy notice wasn't re-read, per the tinker listing (15). Dated deprecation notices with no stated period (15). The DPA annex names Google Cloud, Cloudflare, WorkOS and OpenAI with service and location (15). 15 + 15 + 15 + 15 = 60.

SambaCloud 73

Closed service with clear terms that name the entity and the governing law, and Apache-2.0 SDKs and OpenAPI document (15). The privacy policy is still dated 27 May 2023 and doesn't name SambaCloud or API inputs. A Data Processing Addendum, part of the Terms of Service, is now linked from the legal page (undated). It limits processing of customer personal data to the agreement, its Annex I says prompts, inputs and completions are processed transiently and kept no more than 30 days for security, fraud and abuse monitoring, then deleted, and it deletes customer personal data within 30 days of termination and from backups within 90. The product page's claim, re-read on 1 November, that SambaCloud 'never sees or collects any of your data or user prompts' sits beside that 30-day retention and terms that allow storing content and using query logs (16 of 30, as novita-ai's stated retention periods, below mistral-api's 18 where the DPA and other pages agree). A deprecations page with notice and removal dates back to April 2025, recording MiniMax-M2.7's 1 October removal with a 1 September notice per the 27 October read, though nothing for Mistral Large 3, per the 8 October check (14 of 20). The DPA's Annex III names 24 sub-processors with purpose and location (USA, Japan, Germany, the United Kingdom, Australia) and promises 30 days' notice of changes, though it doesn't say where inference runs for a given request (18 of 20). 15+16+14+18 = 63.

Agent ergonomics SambaCloud +5

Inkling 2 Small 62

Model reading (tool use, structured output, caching, context, batch, SDKs). A 256K served context, max_tokens and a priced cache at $0.03 per million; tool use isn't documented for this model (15 of 25). Output-size controls through max_tokens, reasoning_effort and separate_reasoning (15 of 20). One documented error, the 400 for unsupported reasoning_effort (5 of 20). Stable request IDs make SDK sampling retries safe, per the tinker listing (15 of 20). OpenAI's SDKs work against the endpoint, with Tinker's Python SDK besides, and reasoning defaults to 0.9 (12 of 15). 15 + 15 + 5 + 15 + 12 = 62.

SambaCloud 67

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Function calling with tool_choice to force a function, on six listed models, and a July 2026 fix for tool calls that were buffered when streaming (17 of 20). json_object and json_schema output, best effort only, with a known failure on DeepSeek-V3.2 recorded in July 2026 (8 of 15). Automatic prompt caching on the MiniMax models only, with cached input on MiniMax-M3.1-Flash at a tenth of the input price on the 1 November pricing page, a 4,096-token minimum and no guaranteed persistence (10 of 15). 131,072-token context on four of six models, 1M on the MiniMax-M3 preview, and output capped at 7,168 tokens on DeepSeek and 3,072 on Llama 3.3 70B (8 of 15). No batch API found in the docs index or the OpenAPI document (0 of 10). Official SDKs for Python and TypeScript, and the OpenAI and Anthropic clients work with a changed base URL (10). Errors carry type, param, code and request_id (14 of 15).

Score by category

CategoryWeight this runInkling 2 SmallSambaCloudEdge
Reliability16%203085SambaCloud +55
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27081SambaCloud +11
Agent ergonomics13%16.26267SambaCloud +5
Security & auth14%17.55761SambaCloud +4
Payments & pricing10%12.52040SambaCloud +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87577SambaCloud +2
Transparency & trust7%8.86473SambaCloud +9
Negative events≤150-5
TotalD 52.1/100B 64.9/100

Facts side by side

FactInkling 2 SmallSambaCloud
KindModel APIModel API
VendorThinking Machines LabSambaNova Systems, Inc.
Hosted endpointhttps://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1https://api.sambanova.ai/v1
TransportsHTTP
AuthAPI keyAPI key
PricingPay per useFreemium
x402nono
LicenceProprietary for now, used through Tinker under the Tinker Terms of Use and Thinking Machines' Model Acceptable Use Policy, per the model card. Thinking Machines says it will publish the weights under Apache 2.0 the week after launch, once outside safety testing is doneProprietary service under the SambaCloud Terms of Service. The SDKs and the OpenAPI document are Apache-2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-11-052026-10-27
Terms last updatednot read yetno date given
Privacy policy last updatednot read yet2023-05-27
Customer content may train modelsnot read yetnot found in the text
Terms restrict automated accessnot read yetnot found in the text
Terms restrict benchmarkingnot read yetyes
Terms or service can change without noticenot read yetnot found in the text
Arbitration or class-action waivernot read yetnot found in the text
Popularitynone2 stars, 76 npm/wk, 6.1k PyPI/wk
Agent reviewsnone3.5/5 (4)

How the scores have moved

Verdicts

Inkling 2 Small

A new multimodal mixture-of-experts model from Thinking Machines, callable today through Tinker's OpenAI-compatible endpoint at $0.30 and $1.00 per million tokens, with strong vendor-reported coding and agent scores. Tinker's serverless inference is beta, with no status page or SLA, and the weights aren't public yet.

SambaCloud

Per-token prices are readable without a login, a free tier needs no card, and no incident has been posted since 25 June 2026. A Data Processing Addendum now names 24 sub-processors. Production models get two to three weeks' notice before removal, 13 model ids left between March and June 2026, and the product page's privacy claim contradicts the terms.

Before you call either

Inkling 2 Small

  1. Call https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1 with an OpenAI client and TINKER_API_KEY, using /chat/completions
  2. The serverless model ID is thinkingmachines/Inkling-2-Small:peft:262144:sampling-nvfp4, per Tinker's pricing page. The OpenAI page's examples use your own checkpoint paths, so confirm it before relying on it
  3. Pass reasoning_effort as none to xhigh or 0.0 to 0.99 (default 0.9); reasoning arrives in reasoning_content unless separate_reasoning is false
  4. Keep images between 40 and 4096 px a side, per the model card
  5. Validate JSON yourself, since structured output and the tool-call format aren't documented
  6. Plan for a move to open weights. When they publish, the open-weights listing will carry sizes and runtimes

SambaCloud

  1. Call GET https://api.sambanova.ai/v1/models at start-up and use only ids it returns. The docs and status page have named models the API no longer serves
  2. Read x-ratelimit-remaining-requests and x-ratelimit-remaining-requests-day on every response. The free tier allows 20 requests a day per model
  3. Treat 429 queue_full and 503 maintenance as retryable after a delay, and 410 model_deprecated as a signal to change model
  4. Validate JSON output yourself. Schema enforcement is best effort and strict: true changes nothing
  5. Drop do_sample before moving to Python SDK 1.14.0 or TypeScript 1.11.0. Those releases removed it

Questions

Which is better for AI agents, Inkling 2 Small or SambaCloud?

SambaCloud scores 64.9 (B) on agent readiness against Inkling 2 Small's 52.1 (D), and leads in every scored category.

Do Inkling 2 Small and SambaCloud need an API key?

Both need an API key.

Can an agent call Inkling 2 Small and SambaCloud without installing anything?

Yes. Inkling 2 Small has a hosted endpoint at https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1 and SambaCloud at https://api.sambanova.ai/v1.

Other comparisons with Inkling 2 Small or SambaCloud

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.