Ming-3.0-audio-flash vs Nemotron 3.5 ASR Streaming 0.6B

Ming-3.0-audio-flash

Ming-3.0-audio-flash is a cousin for Chinese and English transcription, questions about long audio and spoken replies in built-in or cloned voices, under MIT. It needs about 260 GB on a multi-GPU server, with inclusionAI's own runtime branches or Transformers remote code. The main risks are running repository code to load it and no published safety results.

Nemotron 3.5 ASR Streaming 0.6B

A small streaming transcription cousin for live audio in about 32 languages, with language detection and 80 ms to 1.12 s latency. It runs in under 8 GB in Transformers or as a 0.74 GB GGUF in NeMo-Speech.cpp, and several providers host it. The main gaps are no documented timestamps and weak accuracy outside the top 19 locales.

Ming-3.0-audio-flash

1. Start it with inclusionAI's recipe, hf download inclusionAI/Ming-3.0-audio-flash --local-dir inclusionAI/Ming-3.0-audio-flash && export MODEL_PATH="$PWD/inclusionAI/Ming-3.0-audio-flash" && pip install -r requirements-vllm-omni.txt && MING_OUTPUT_MODE=asr ./scripts/serve_vllm_omni.sh "$MODEL_PATH", run from a clone of github.com/inclusionAI/Ming-3.0-audio-flash
2. The 128K profile uses tensor parallelism over eight 80 GB H800 GPUs, the SGLang profile four and SGLang-Omni's cookbook two. It doesn't fit the 107.4 GB reference machine
3. Use MING_OUTPUT_MODE=asr with the validated prompt and greedy decoding for transcripts, and split the language label from the text at the tab
4. Use MING_OUTPUT_MODE=text for audio questions and the Talker profile with modalities=["text", "audio"] for spoken replies
5. Send audio as a base64 data URL in an audio_url item for vLLM-Omni, or as input_audio for SGLang
6. Pick a voice with audio.voice and an id, or clone one with ref_audio and its exact prompt_text, never both
7. Turn thinking on per request with chat_template_kwargs {"enable_thinking": true}, it's off by default and the reasoning comes back in think tags
8. Tool calls follow the template's <tool_call> with <arg_key> and <arg_value> pairs, and no parser is named, so parse them yourself
9. Review the repository's Python and the talker/ code, .pyc files included, before loading with trust_remote_code

Nemotron 3.5 ASR Streaming 0.6B

1. Quickest local run, pip install "transformers>=5.13.0", then pipeline("automatic-speech-recognition", model="nvidia/nemotron-3.5-asr-streaming-0.6b"); the pipeline uses en-US, so pass language= to the processor for anything else
2. With NeMo-Speech.cpp, nemo-speech transcribe audio.wav --model nemotron-3.5-asr-streaming-0.6b.q8_0.gguf --language auto
3. Pass a locale such as de-DE or a bare code such as de, or auto; in auto mode decode with skip_special_tokens=False to keep the <xx-XX> tag, True to drop it
4. Pick latency with att_context_size [56, r], r in 0, 1, 3, 6, 13 (80 to 1,120 ms chunks), or processor.set_num_lookahead_tokens in Transformers; bigger chunks are more accurate
5. Use nvidia/nemotron-speech-streaming-en-0.6b instead for English only, as NVIDIA recommends
6. Prefer model.safetensors or the GGUF over the .nemo file, which is a pickle
7. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions