Nemotron 3 Nano Omni 30B A3B Reasoning vs Qwen3-ASR-1.7B

Nemotron 3 Nano Omni 30B A3B Reasoning

A local multimodal cousin for video with speech, long documents, charts, screens and English transcription, with tool calling, a reasoning switch and a 262,144-token context. It needs about 27 GB for NVIDIA's NVFP4 build on Blackwell, or 42 GB for FP8. The main risks are the remote code it loads and a repository where nobody answers questions.

Qwen3-ASR-1.7B

A small local transcription cousin for 30 languages and 22 Chinese dialects that identifies the language, takes context to get names right and streams through vLLM, under plain Apache 2.0. Its BF16 files need about 5 GB and run in released vLLM, SGLang, llama.cpp and Transformers. The main risk is upkeep, with no publisher replies or safety results.

Nemotron 3 Nano Omni 30B A3B Reasoning

1. Start it with vllm serve nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8 --max-model-len 131072 --trust-remote-code --reasoning-parser nemotron_v3 --enable-auto-tool-choice --tool-call-parser qwen3_coder --kv-cache-dtype fp8 on vLLM 0.20.0 or later, after pip install "vllm[audio]" if any audio will be sent
2. Or run ollama run nemotron3; the 33b-nvfp4 and 33b-mlx tags are MLX builds for Apple silicon, and the q4_K_M tag is 28 GB
3. Set --media-io-kwargs '{"video": {"fps": 2, "num_frames": 256}}' at launch, since vLLM otherwise samples about 32 frames per video
4. Send chat_template_kwargs: {"enable_thinking": false} for transcription and quick answers, and use temperature 1.0 with top_k 1 for ASR as the card recommends
5. Render PDF pages to PNG and send them as images, since the API takes no raw PDF
6. Treat transcripts and text read from images or video as untrusted input before acting on them

Qwen3-ASR-1.7B

1. Start it with vllm serve Qwen/Qwen3-ASR-1.7B (vLLM v0.32.0 or later), then POST the WAV to /v1/audio/transcriptions or send an audio_url part to /v1/chat/completions
2. Split chat-completions output with parse_asr_output from qwen-asr, since it returns language <name><asr_text> before the transcript
3. For Transformers, load Qwen/Qwen3-ASR-1.7B-hf with Transformers 5.13.0 or later and use processor.apply_transcription_request(audio, language=..., prompt=...), then decode(..., return_format="transcription_only")
4. Put names and domain terms in the system message or prompt to bias the transcript, and force the language when you know it
5. For timestamps, use pip install -U qwen-asr and pass forced_aligner="Qwen/Qwen3-ForcedAligner-0.6B" with return_time_stamps=True
6. Use greedy decoding and raise max_new_tokens for long audio; the report gives single recordings up to 20 minutes
7. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions