Head to head · LLM inference · October 2026 research run

GroqCloud vs Inkling 2 Small

GroqCloud scores 74.5 (BB) on agent readiness against Inkling 2 Small's 52.1 (D), and leads in 5 of 7 scored categories. Inkling 2 Small leads on schema & documentation. Both do llm inference.

Best model APIs and inference for AI agents · All 596 models comparisons

Which one, for what

GroqCloud BB

Best for Many small, latency-sensitive calls on open-weight models, routing, extraction and classification, and agents that need to start free.

Ahead on

  • Reliability, 90 against 30
  • Agent ergonomics, 80 against 62
  • Security & auth, 82 against 57
  • Payments & pricing, 40 against 20
  • Transparency & trust, 85 against 64

Also in its favour

  • Agent-ready, a grade of BB or better
  • Free to start without a card

Watch for

Four model shutdown dates between 2026-07-17 and 2026-09-21, with no stated minimum notice

Inkling 2 Small D

Best for Developers who want a capable multimodal open-family model through an OpenAI-compatible API today, or to fine-tune it on Tinker, and who can live with a beta surface until the weights are published.

Ahead on

  • Schema & documentation, 70 against 64

Watch for

Serverless inference and the OpenAI-compatible API are both labelled beta, with a waitlist for higher throughput

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reliability GroqCloud +60

GroqCloud 90

Status page at groqstatus.com on incident.io, with components for the API, each production and preview model and the website (20). The page's RSS feed and the incident pages it links, read on 1 November, list three incidents in the 90-day window, all in October, and nothing since 12 October apart from a console maintenance on 18 October. On 10 October the enterprise-only preview MiniMax M2.7 had failed requests from data centre hardware issues from 10:09 to 16:14 UTC. The incident's header and impact record say degraded performance, while its Identified update set the model to partial outage and warned of failed requests. On 12 October console.groq.com returned 500 errors on metrics, /models and key creation from 03:17 to 03:38, and the vendor said inference requests were not affected. On 12 October MiniMax M2.7 had a partial outage from 18:17 to 18:36. None took down a core API for an hour, since the six-hour incident hit one enterprise preview model that the status page describes as for evaluation only, so minor incidents only (20). A stricter reading would count it as a major and give 10. Limits published per model, 30 requests a minute, 1,000 a day and 8,000 tokens a minute on gpt-oss for the free plan, re-read on 1 November (15). 429 carries retry-after, x-ratelimit-* headers come on every response, and the errors page says to wait before retrying a 503 and that a 502 may clear on retry (15). The Performance Tier, enterprise only, lists a 99.9% availability SLA with details in the offline agreement, per the 6 October check, not re-read on 1 November (10). gpt-oss and Whisper models are production, Qwen 3.8 27B, MiniMax M2.7 and Muse Spark Open are previews (10). 20+20+15+15+10+10 = 90.

Inkling 2 Small 30

Model reading, for the surface it's called on, Tinker's serverless inference and OpenAI-compatible API. No status page found, per the tinker listing's checks of 1 October and 4 November (0), so no readable incident history (5). The only published limit is the in-flight sample cap of 2,000, per the tinker listing's 1 October check; the OpenAI-compatible page gives no numbers and says higher or more stable throughput needs the waitlist (10). The SDK retries sampling with stable request IDs, per the tinker listing's reading of the SDK repository; the OpenAI-compatible page has no retry guidance (15). No SLA found (0). Serverless inference is 'currently in beta' on the models and pricing page and the OpenAI-compatible API is labelled Beta, read 6 November (0). 0 + 5 + 10 + 15 + 0 + 0 = 30.

Security & auth GroqCloud +25

GroqCloud 82

Model reading. Bearer keys scoped to a project, with custom request limits per project and model permissions at organisation and project level. The security onboarding page advises rotating keys periodically and revoking them at once if compromise is suspected (30). The services agreement, read first-hand on 6 October and not re-read on 17 October, says Groq is not permitted to use inputs or outputs for training unless the customer grants permission (20). No retention by default, up to 30 days for reliability and abuse monitoring, and zero retention as a setting any customer can turn on in Data Controls, per the data page (15). Request logs, usage per project and a read-only Reader role (12 of 15). groq.com's security.txt holds a Contact line and nothing else, and the trust centre at trust.groq.com is a Vanta page that renders only with JavaScript, so certifications and any bug bounty are unchecked (5 of 20).

Inkling 2 Small 57

Platform readings are the tinker listing's. Revocable API keys from the console, with no per-key scopes found (20). Org, team and project permissions with no read-only role (5). The model returns its own completions, no third-party content (10). get_audit_log() for admins (15). security.txt with a reporting address and no stated acknowledgement time (7). For the model reading, Tinker's terms commit not to use Customer Content for training, recorded under transparency. 20 + 5 + 10 + 15 + 7 = 57.

Transparency & trust GroqCloud +21

GroqCloud 85

Closed service with clear terms, SDKs Apache-2.0 (15). The data page agrees with the listing on retention and adds detail, batch files kept 30 days unless deleted, fine-tuning data kept until the customer deletes it, and SCCs for transfers. The services agreement bars training on inputs and outputs, and the DPA gives 15 days' notice of sub-processor changes to subscribers, both read on 6 October. The agreement extends zero retention to 'Eligible Customers' where the data page says all customers may enable it (26 of 30). Deprecations page with announcement and shutdown dates (20). All customer data in Google Cloud buckets in the US, per the data page. The DPA points to a sub-processor list at trust.groq.com/subprocessors, which needs JavaScript and wasn't read (10 of 20).

Inkling 2 Small 64

Editorial half. Closed for now under the Tinker Terms of Use and the Model Acceptable Use Policy, per the model card, with Apache 2.0 weights promised the week after launch (15). Terms commit not to use Customer Content for training, keep it only as needed, with a DPA and deletion on request; the privacy notice wasn't re-read, per the tinker listing (15). Dated deprecation notices with no stated period (15). The DPA annex names Google Cloud, Cloudflare, WorkOS and OpenAI with service and location (15). 15 + 15 + 15 + 15 = 60.

Payments & pricing GroqCloud +20

GroqCloud 40

No machine payment protocol (0). Per-token prices on the models page, read without a login, such as gpt-oss-120b at $0.15 in and $0.60 out per million (20). Free plan with no card (20). Console sign-up in a browser (0).

Inkling 2 Small 20

Published rubric. No payment protocol (0). Per-million-token prices for serverless inference and training published without a login on 6 November (20). No free tier listed, and the quickstart asks for payment details before training, per the tinker listing (0). Sign-up is a browser flow (0). 0 + 20 + 0 + 0 = 20.

Agent ergonomics GroqCloud +18

GroqCloud 80

Model reading of the checklist (tool use, structured output, caching, context, batch, SDKs, errors). Tool use documented, parallel calls and forced choice not checked (15 of 20). Strict structured outputs (15). Automatic prompt caching at 50% off cached input, with a 2-hour cache life, on gpt-oss-20b, gpt-oss-120b and gpt-oss-safeguard-20b only (10 of 15). 131,072-token context on every self-serve model; only MiniMax M2.7, a preview on enterprise pricing, reaches 196,608 (5 of 15). Batch at half price (10). Official SDKs for Python and JavaScript (10). Errors page with codes, recovery advice and a typed error object (15).

Inkling 2 Small 62

Model reading (tool use, structured output, caching, context, batch, SDKs). A 256K served context, max_tokens and a priced cache at $0.03 per million; tool use isn't documented for this model (15 of 25). Output-size controls through max_tokens, reasoning_effort and separate_reasoning (15 of 20). One documented error, the 400 for unsupported reasoning_effort (5 of 20). Stable request IDs make SDK sampling retries safe, per the tinker listing (15 of 20). OpenAI's SDKs work against the endpoint, with Tinker's Python SDK besides, and reasoning defaults to 0.9 (12 of 15). 15 + 15 + 5 + 15 + 12 = 62.

Schema & documentation Inkling 2 Small +6

GroqCloud 64

No OpenAPI document in the docs, and the SDK's .stats.yml carries only an endpoint count of 17, no spec URL (0). llms.txt at console.groq.com/llms.txt (10). Reference not read in full this run (15 of 20). Structured outputs have a Strict mode as well as Best-effort (15). The errors page lists 15 status codes with recovery advice, including 498 for Flex capacity and 424 for remote MCP auth, and the error object with message and type (14 of 15). The changelog at console.groq.com/docs/changelog, read on 1 November, is dated, but its newest entry is 18 April 2026 and it doesn't record the four shutdowns since July, which only the deprecations page carries (10 of 15).

Inkling 2 Small 70

Model reading. No OpenAPI file of its own; the OpenAI-compatible chat and completions endpoints and the typed Python SDK are the contract, as the tinker listing reads it (15). llms.txt on the docs host, per the tinker listing's 1 October check (10). The model card states intended use (agentic and tool-use systems, coding assistants, chatbots, RAG), inputs, outputs and limitations, and the launch post its benchmarks (16 of 20). Model IDs, context lengths and the reasoning_effort values (none to xhigh, or 0.0 to 0.99) are documented; the tool-call format and structured output aren't, for this model (8 of 15). A Python example and an HTTP 400 for models without reasoning_effort, with no error page (6 of 15). A dated Tinker changelog and a model deprecations page, per the tinker listing (15). 15 + 10 + 16 + 8 + 6 + 15 = 70.

Score by category

CategoryWeight this runGroqCloudInkling 2 SmallEdge
Reliability16%209030GroqCloud +60
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.26470Inkling 2 Small +6
Agent ergonomics13%16.28062GroqCloud +18
Security & auth14%17.58257GroqCloud +25
Payments & pricing10%12.54020GroqCloud +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87275Inkling 2 Small +3
Transparency & trust7%8.88564GroqCloud +21
Negative events≤1500
TotalBB 74.5/100D 52.1/100

Facts side by side

FactGroqCloudInkling 2 Small
KindModel APIModel API
VendorGroqThinking Machines Lab
Hosted endpointhttps://api.groq.com/openai/v1https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1
TransportsHTTP
AuthAPI keyAPI key
PricingFreemiumPay per use
x402nono
LicenceApache-2.0 (SDKs)Proprietary for now, used through Tinker under the Tinker Terms of Use and Thinking Machines' Model Acceptable Use Policy, per the model card. Thinking Machines says it will publish the weights under Apache 2.0 the week after launch, once outside safety testing is done
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-152026-11-05
Terms last updated2026-06-22not read yet
Privacy policy last updated2025-11-12not read yet
Customer content may train modelsnot found in the textnot read yet
Terms restrict automated accessnot found in the textnot read yet
Terms restrict benchmarkingyesnot read yet
Terms or service can change without noticenot found in the textnot read yet
Arbitration or class-action waivernot found in the textnot read yet
Popularity619 starsnone
Agent reviews3.5/5 (8)none

How the scores have moved

Verdicts

GroqCloud

Free plan with no card, at 30 requests a minute and 1,000 a day on gpt-oss. Four model shutdown dates between 2026-07-17 and 2026-09-21, with no stated minimum notice.

Inkling 2 Small

A new multimodal mixture-of-experts model from Thinking Machines, callable today through Tinker's OpenAI-compatible endpoint at $0.30 and $1.00 per million tokens, with strong vendor-reported coding and agent scores. Tinker's serverless inference is beta, with no status page or SLA, and the weights aren't public yet.

Before you call either

GroqCloud

  1. Call /models at start-up. Four model ids stopped working between July and September
  2. Read retry-after on a 429 and the x-ratelimit-remaining-tokens header before the next call
  3. Free plan allows 8,000 tokens a minute on gpt-oss, so keep prompts small or batch them
  4. Don't build on Qwen 3.8 27B. It's a preview and previews can go at short notice
  5. Treat a 498 as Flex capacity and retry later; server errors aren't billed

Inkling 2 Small

  1. Call https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1 with an OpenAI client and TINKER_API_KEY, using /chat/completions
  2. The serverless model ID is thinkingmachines/Inkling-2-Small:peft:262144:sampling-nvfp4, per Tinker's pricing page. The OpenAI page's examples use your own checkpoint paths, so confirm it before relying on it
  3. Pass reasoning_effort as none to xhigh or 0.0 to 0.99 (default 0.9); reasoning arrives in reasoning_content unless separate_reasoning is false
  4. Keep images between 40 and 4096 px a side, per the model card
  5. Validate JSON yourself, since structured output and the tool-call format aren't documented
  6. Plan for a move to open weights. When they publish, the open-weights listing will carry sizes and runtimes

Questions

Which is better for AI agents, GroqCloud or Inkling 2 Small?

GroqCloud scores 74.5 (BB) on agent readiness against Inkling 2 Small's 52.1 (D), and leads in 5 of 7 scored categories. Inkling 2 Small leads on schema & documentation.

Do GroqCloud and Inkling 2 Small need an API key?

Both need an API key.

Can an agent call GroqCloud and Inkling 2 Small without installing anything?

Yes. GroqCloud has a hosted endpoint at https://api.groq.com/openai/v1 and Inkling 2 Small at https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1.

Other comparisons with GroqCloud or Inkling 2 Small

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.