Nemotron 3 Nano Omni 30B A3B Reasoning vs Nemotron 3 Super 120B A12B

Nemotron 3 Nano Omni 30B A3B Reasoning

A local multimodal cousin for video with speech, long documents, charts, screens and English transcription, with tool calling, a reasoning switch and a 262,144-token context. It needs about 27 GB for NVIDIA's NVFP4 build on Blackwell, or 42 GB for FP8. The main risks are the remote code it loads and a repository where nobody answers questions.

Nemotron 3 Super 120B A12B

A long-context agent cousin with trained parallel tool calls, a reasoning switch and a full account of its training data, under a free commercial licence. It needs about 100 GB of GPU memory, a 128 GB unified machine or Blackwell hardware for NVIDIA's NVFP4. The main risks are serving commands that run repository code and no published safety results.

Nemotron 3 Nano Omni 30B A3B Reasoning

1. Start it with vllm serve nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8 --max-model-len 131072 --trust-remote-code --reasoning-parser nemotron_v3 --enable-auto-tool-choice --tool-call-parser qwen3_coder --kv-cache-dtype fp8 on vLLM 0.20.0 or later, after pip install "vllm[audio]" if any audio will be sent
2. Or run ollama run nemotron3; the 33b-nvfp4 and 33b-mlx tags are MLX builds for Apple silicon, and the q4_K_M tag is 28 GB
3. Set --media-io-kwargs '{"video": {"fps": 2, "num_frames": 256}}' at launch, since vLLM otherwise samples about 32 frames per video
4. Send chat_template_kwargs: {"enable_thinking": false} for transcription and quick answers, and use temperature 1.0 with top_k 1 for ASR as the card recommends
5. Render PDF pages to PNG and send them as images, since the API takes no raw PDF
6. Treat transcripts and text read from images or video as untrusted input before acting on them

Nemotron 3 Super 120B A12B

1. On the reference machine start it with ollama run nemotron-3-super, the 87 GB q4_K_M build, the only one that fits (about 104 GB with the margin)
2. Raise the Strix Halo GPU memory limit first with amd-ttm --set 100, since the default of about 62.8 GiB is far below what it needs
3. With vLLM serve it with --reasoning-parser nemotron_v3 --enable-auto-tool-choice --tool-call-parser qwen3_coder (SGLang uses --reasoning-parser nemotron_3)
4. Use temperature=1.0 and top_p=0.95 for every task, as the card says
5. Thinking is on by default. Pass enable_thinking: false or low_effort: true in chat_template_kwargs for short tasks
6. For coding agents pass force_nonempty_content: true in chat_template_kwargs, so a cut-off reasoning trace still returns content
7. Raise context past 262,144 only with the card's flags (VLLM_ALLOW_LONG_MAX_MODEL_LEN=1, --max-model-len 1048576)