Ming-3.0-audio-flash vs Parakeet TDT 0.6B v3

Ming-3.0-audio-flash

Ming-3.0-audio-flash is a cousin for Chinese and English transcription, questions about long audio and spoken replies in built-in or cloned voices, under MIT. It needs about 260 GB on a multi-GPU server, with inclusionAI's own runtime branches or Transformers remote code. The main risks are running repository code to load it and no published safety results.

Parakeet TDT 0.6B v3

A small, fast transcription cousin for 25 European languages that detects the language and returns punctuated text with word timestamps. It fits in under 1 GB as NVIDIA's GGUF and runs in Transformers, NeMo or NVIDIA's C++ runtime, under CC BY 4.0. Few other runtimes load it, and it takes no language hint.

Ming-3.0-audio-flash

1. Start it with inclusionAI's recipe, hf download inclusionAI/Ming-3.0-audio-flash --local-dir inclusionAI/Ming-3.0-audio-flash && export MODEL_PATH="$PWD/inclusionAI/Ming-3.0-audio-flash" && pip install -r requirements-vllm-omni.txt && MING_OUTPUT_MODE=asr ./scripts/serve_vllm_omni.sh "$MODEL_PATH", run from a clone of github.com/inclusionAI/Ming-3.0-audio-flash
2. The 128K profile uses tensor parallelism over eight 80 GB H800 GPUs, the SGLang profile four and SGLang-Omni's cookbook two. It doesn't fit the 107.4 GB reference machine
3. Use MING_OUTPUT_MODE=asr with the validated prompt and greedy decoding for transcripts, and split the language label from the text at the tab
4. Use MING_OUTPUT_MODE=text for audio questions and the Talker profile with modalities=["text", "audio"] for spoken replies
5. Send audio as a base64 data URL in an audio_url item for vLLM-Omni, or as input_audio for SGLang
6. Pick a voice with audio.voice and an id, or clone one with ref_audio and its exact prompt_text, never both
7. Turn thinking on per request with chat_template_kwargs {"enable_thinking": true}, it's off by default and the reasoning comes back in think tags
8. Tool calls follow the template's <tool_call> with <arg_key> and <arg_value> pairs, and no parser is named, so parse them yourself
9. Review the repository's Python and the talker/ code, .pyc files included, before loading with trust_remote_code

Parakeet TDT 0.6B v3

1. For the smallest setup, hf download nvidia/parakeet-tdt-0.6b-v3 parakeet-tdt-0.6b-v3.q8_0.gguf --local-dir models, then nemo-speech transcribe speech.wav --model models/parakeet-tdt-0.6b-v3.q8_0.gguf with NeMo-Speech.cpp
2. In Python, pipeline('automatic-speech-recognition', model='nvidia/parakeet-tdt-0.6b-v3') works on Transformers 5.10.0 or later, despite the card's note to install from source
3. Resample to 16 kHz mono first; it takes wav or flac
4. Ask for timestamps with timestamps=True in NeMo, or pass durations=output.durations to processor.decode in Transformers
5. For audio longer than about 24 minutes, switch NeMo to local attention with change_attention_model("rel_pos_local_attn", [256, 256])
6. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions