Nemotron 3.5 ASR Streaming 0.6B vs Parakeet TDT 0.6B v3

Nemotron 3.5 ASR Streaming 0.6B

A small streaming transcription cousin for live audio in about 32 languages, with language detection and 80 ms to 1.12 s latency. It runs in under 8 GB in Transformers or as a 0.74 GB GGUF in NeMo-Speech.cpp, and several providers host it. The main gaps are no documented timestamps and weak accuracy outside the top 19 locales.

Parakeet TDT 0.6B v3

A small, fast transcription cousin for 25 European languages that detects the language and returns punctuated text with word timestamps. It fits in under 1 GB as NVIDIA's GGUF and runs in Transformers, NeMo or NVIDIA's C++ runtime, under CC BY 4.0. Few other runtimes load it, and it takes no language hint.

Nemotron 3.5 ASR Streaming 0.6B

1. Quickest local run, pip install "transformers>=5.13.0", then pipeline("automatic-speech-recognition", model="nvidia/nemotron-3.5-asr-streaming-0.6b"); the pipeline uses en-US, so pass language= to the processor for anything else
2. With NeMo-Speech.cpp, nemo-speech transcribe audio.wav --model nemotron-3.5-asr-streaming-0.6b.q8_0.gguf --language auto
3. Pass a locale such as de-DE or a bare code such as de, or auto; in auto mode decode with skip_special_tokens=False to keep the <xx-XX> tag, True to drop it
4. Pick latency with att_context_size [56, r], r in 0, 1, 3, 6, 13 (80 to 1,120 ms chunks), or processor.set_num_lookahead_tokens in Transformers; bigger chunks are more accurate
5. Use nvidia/nemotron-speech-streaming-en-0.6b instead for English only, as NVIDIA recommends
6. Prefer model.safetensors or the GGUF over the .nemo file, which is a pickle
7. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions

Parakeet TDT 0.6B v3

1. For the smallest setup, hf download nvidia/parakeet-tdt-0.6b-v3 parakeet-tdt-0.6b-v3.q8_0.gguf --local-dir models, then nemo-speech transcribe speech.wav --model models/parakeet-tdt-0.6b-v3.q8_0.gguf with NeMo-Speech.cpp
2. In Python, pipeline('automatic-speech-recognition', model='nvidia/parakeet-tdt-0.6b-v3') works on Transformers 5.10.0 or later, despite the card's note to install from source
3. Resample to 16 kHz mono first; it takes wav or flac
4. Ask for timestamps with timestamps=True in NeMo, or pass durations=output.durations to processor.decode in Transformers
5. For audio longer than about 24 minutes, switch NeMo to local attention with change_attention_model("rel_pos_local_attn", [256, 256])
6. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions