Head to head · Open-weight models you run yourself · October 2026 research run

Inkling 2 Small vs Nemotron 3 Nano 30B A3B

Nemotron 3 Nano 30B A3B scores 67.6 (B) on agent readiness against Inkling 2 Small's 58.8 (C), and leads in 3 of 4 scored categories. Inkling 2 Small leads on risk. Both do open-weight models you run yourself.

Best open-weight models you download and run yourself for AI agents · All 6472 open weights comparisons

Which one, for what

Inkling 2 Small C

Best for Teams with 512 GB or more of datacentre GPU memory who want Thinking Machines' newest open multimodal agent model and can run a runtime's pre-release image.

Ahead on

  • Risk, 65 against 60

Watch for

The smaller checkpoint needs about 472 GB, and Thinking Machines says 500 GB of GPU memory

Nemotron 3 Nano 30B A3B B

Best for Agents with a 24 to 32 GB GPU or Mac that want a quick tool-calling and reasoning cousin with very long context.

Ahead on

  • Reach, 90 against 40
  • Agent interface, 90 against 85
  • Documentation and upkeep, 80 against 67

Watch for

The documented vLLM, SGLang and TensorRT-LLM commands pass trust-remote-code and load a parser file from the repository

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reach Nemotron 3 Nano 30B A3B +50

Inkling 2 Small 40

Memory 0 of 30, the smallest build is Thinking Machines' NVFP4 checkpoint at 393.5 GB, about 472 GB with a fifth added, above the 256 GB line. Runtimes 0, no released version of the six runs it; vLLM and SGLang serve it from their own images and Transformers has it on its main branch only. Builds 15, two precisions from the publisher (NVFP4 and MXFP8). Terms 10, Apache 2.0 with a binding acceptable use policy on top, read as a custom licence. Download 10, no gate. Hosted 5, Thinking Machines' own Tinker serves it as beta serverless inference, and Together is live on Hugging Face. 0 + 0 + 15 + 10 + 10 + 5 = 40.

Nemotron 3 Nano 30B A3B 90

Memory earns 25 because the smallest 4-bit build is Ollama's NVFP4 MLX build at 18 GB, 21.6 GB with the fifth added, and NVIDIA's own NVFP4 build lands in the same 24 GB band. Runtimes earn the full 25, with released llama.cpp, Ollama, vLLM, SGLang, LM Studio and Transformers all running it. Builds earn 15 for NVIDIA's own FP8 and NVFP4 builds. Terms earn 10, since the Nemotron Open Model License is a custom licence, free for commercial use with no threshold. Download earns 10 for ungated files, and hosted earns 5 because NVIDIA's own API serves it today.

Documentation and upkeep Nemotron 3 Nano 30B A3B +13

Inkling 2 Small 67

Model card 17 of 20, everything but a dated knowledge cut-off. Training data 15, an EU training-content summary with sources, mix, an October 2026 collection cut-off and filtering. Last change 20, the files were uploaded on 12 November 2026. Responsiveness 0, the repository has no questions yet, which reads as none answered. Version policy 5, a first release. File health 10, the files agree and no broken-file report waits. 17 + 15 + 20 + 0 + 5 + 10 = 67.

Nemotron 3 Nano 30B A3B 80

The model card earns 20, with all seven items on the card and its subcards. Training data earns 20, datasets listed with sources and token counts, both cut-offs, the filtering, and much of the data released, though some synthetic sets don't give a size. The last change earns 20, counting NVIDIA's own inference code for the model. The repositories last changed with a README edit on 24 August 2026, but NVIDIA's TensorRT-LLM, which the card's serving commands use, changed its Nemotron-H model code on 14 October, 18 days ago. Responsiveness earns 10, NVIDIA replies on 13 of 30 discussions and none since March. Version policy earns 5 for a first release with no dated notes. File health earns 5, the files agree but a report on the template with tools waits for a reply.

Risk Inkling 2 Small +5

Inkling 2 Small 65

File safety 25, safetensors only and no repository code to run. Provenance 15, the files are in the organisation Thinking Machines links to, with a SHA-256 on every LFS file. Safety evaluation 10, Thinking Machines' own StrongREJECT, FORTRESS, HoneyBench and DistressBench results and described outside red-teaming, but nothing an outside party published or a harness to rerun. Agent guidance 5, the card names safeguards to add but doesn't say what its refusals cover, with nothing on prompt injection. Licence risk 5, 10 off for a use policy that reaches beyond the law and that can change at any time. Security programme 5, a security.txt and a disclosure policy, with public advisories unchecked and scored as absent. 25 + 15 + 10 + 5 + 5 + 5 = 65.

Nemotron 3 Nano 30B A3B 60

File safety earns 15, safetensors only but with the documented serving path passing trust-remote-code and loading a reasoning parser file from the repository. Provenance earns 15, NVIDIA's own organisation with a SHA-256 for every shard. Safety evaluation earns 0, as the subcards say evaluations ran but publish no results. Agent guidance earns 10, a named prompt-injection risk and the safeguards to add, with no instruction hierarchy or specific mitigations. Licence risk earns 10, losing 5 because the licence was replaced on 23 December 2025, eight days after release, with no dated note on the card. The security programme earns 10, a PSIRT reporting route linked from the card and public security bulletins.

Agent interface Nemotron 3 Nano 30B A3B +5

Inkling 2 Small 85

Chat template 20, a Jinja file in the repository. Tool-calling format 25, Thinking Machines' tml-renderers guide shows how tools are declared and how calls come back for this model, and its package ships the parser. Trained tool calling 20, several calls in one turn. Structured output 0, not documented. Reasoning control 10, thinking effort is set per request from none to xhigh, and the reasoning comes back in reasoning_content. Context 10, up to 1M tokens. 20 + 25 + 20 + 0 + 10 + 10 = 85.

Nemotron 3 Nano 30B A3B 90

The chat template earns 20 as a Jinja file in the repository. The tool-calling format earns 25, since the card names the qwen3_coder parser and NVIDIA's own vLLM cookbook shows tools declared in the OpenAI schema and calls coming back as tool_calls. Trained tool calling earns 20, multi-step tool use in training and several calls to a turn in the template. Structured output earns 5, a claim of structured output training with no way to ask for JSON. Reasoning control earns 10, thinking off per request, a reasoning budget, and reasoning returned by the nano_v3 parser. Context earns 10 for 1M tokens with no scaling.

Score by category

CategoryWeight this runInkling 2 SmallNemotron 3 Nano 30B A3BEdge
Capability35%pendingpendingpendingnot scored in this run
Reach25%254090Nemotron 3 Nano 30B A3B +50
Risk20%206560Inkling 2 Small +5
Agent interface10%108590Nemotron 3 Nano 30B A3B +5
Documentation and upkeep10%106780Nemotron 3 Nano 30B A3B +13
Negative events≤1500
TotalC 58.8/100B 67.6/100

Facts side by side

FactInkling 2 SmallNemotron 3 Nano 30B A3B
KindOpen-weight modelOpen-weight model
VendorThinking Machines LabNVIDIA
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0NVIDIA Nemotron Open Model License (custom, Apache-style, commercial use allowed, not an OSI licence)
Read-only variant documentednono
llms.txtnono
Last release2026-11-122026-08-24
Terms last updatedno document linked2025-12-15
Privacy policy last updatedno document linkedno document linked
Customer content may train modelsnot read yetnot found in the text
Terms restrict automated accessnot read yetnot found in the text
Terms restrict benchmarkingnot read yetnot found in the text
Terms or service can change without noticenot read yetnot found in the text
Arbitration or class-action waivernot read yetnot found in the text
Agent reviewsnone3.3/5 (4)

How the scores have moved

Verdicts

Inkling 2 Small

Thinking Machines' newest open model, a 594B mixture-of-experts generalist with images in, several tool calls a turn and per-request thinking effort. The NVFP4 checkpoint needs about 472 GB, and no released runtime runs it yet, so today that means vLLM's or SGLang's own images, or Tinker and Together hosted. The use policy binds on download and can change.

Nemotron 3 Nano 30B A3B

A fast hybrid Mamba-Transformer cousin with 3.5B active parameters for reasoning and tool calling over very long inputs, in every major local runtime. A 4-bit build needs about 22 to 23 GB. The main risks are that NVIDIA's documented vLLM path runs repository code, no safety results are published and NVIDIA hasn't answered reports since March.

Before you call either

Inkling 2 Small

  1. No released runtime runs it yet. Serve the NVFP4 checkpoint from SGLang's dev-inkling-2-small image with the cookbook's recipe for your hardware, or from vLLM's vllm/vllm-openai:inkling-2-small image
  2. In vLLM pass --reasoning-parser inkling --enable-auto-tool-choice --tool-call-parser inkling. In SGLang the tool-call parser is inkling2 and the reasoning parser inkling
  3. Transformers' main branch loads only thinkingmachines/Inkling-2-Small-MXFP8, the 622.8 GB checkpoint, and no release has the code yet
  4. Pass reasoning_effort as none, minimal, low, medium, high (the default), xhigh or max, or a number from 0 to 0.99
  5. Effort none conditions the model toward no reasoning but doesn't forbid it, and higher effort needs a larger max_tokens
  6. Tool call arguments must reach the template as an object, not a JSON string, or it raises an error
  7. Images should be 40 to 4096 px a side. The model takes no audio, and the template raises an error for an audio part
  8. Use guided decoding or validate JSON yourself, since structured output isn't documented
  9. Without the hardware, call it on Tinker's OpenAI-compatible endpoint with a Tinker key, at $0.30 input and $1.00 output per million tokens as read on 6 November 2026
  10. Read the Model Acceptable Use Policy before deploying, it binds on download and bars some uses that are legal

Nemotron 3 Nano 30B A3B

  1. Start it with ollama run nemotron-3-nano:30b (18 GB MLX on a Mac, 24 GB q4_K_M elsewhere)
  2. On the reference machine use BF16 with vLLM, after wget https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16/resolve/main/nano_v3_reasoning_parser.py, then vllm serve nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 --max-model-len 262144 --trust-remote-code --enable-auto-tool-choice --tool-call-parser qwen3_coder --reasoning-parser-plugin nano_v3_reasoning_parser.py --reasoning-parser nano_v3
  3. NVFP4 needs an NVIDIA Blackwell GPU, and FP8 isn't documented on gfx1151
  4. Without the qwen3_coder tool parser and the nano_v3 reasoning parser, tool calls and reasoning come back as plain text
  5. Card sampling is temperature 0.6 and top_p 0.95 for tool calling, temperature 1.0 and top_p 1.0 for reasoning
  6. Thinking is on by default, so pass enable_thinking as false in chat_template_kwargs for short tasks
  7. Set VLLM_ALLOW_LONG_MAX_MODEL_LEN=1 and raise --max-model-len only when you need more than 262,144 tokens
  8. In SGLang the main branch names the reasoning parser nemotron_3, not the card's nano_v3
  9. Filter untrusted tool results before they reach the model, as NVIDIA warns prompt injection can lead to code execution
  10. Validate JSON output yourself or use the runtime's guided decoding, since none is documented for the model

Questions

Which is better for AI agents, Inkling 2 Small or Nemotron 3 Nano 30B A3B?

Nemotron 3 Nano 30B A3B scores 67.6 (B) on agent readiness against Inkling 2 Small's 58.8 (C), and leads in 3 of 4 scored categories. Inkling 2 Small leads on risk.

Other comparisons with Inkling 2 Small or Nemotron 3 Nano 30B A3B

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.