Ming-3.0-audio-tiny vs Parakeet TDT 0.6B v3

Ming-3.0-audio-tiny

A small MIT-licensed audio-language model that transcribes Chinese and English, answers questions about audio and replies in a built-in or cloned voice. It needs about 25 GB and SGLang-Omni from main or inclusionAI's own vLLM-Omni and SGLang branches. The main risk is that every loading path runs repository code, with nothing published on safety.

Parakeet TDT 0.6B v3

A small, fast transcription cousin for 25 European languages that detects the language and returns punctuated text with word timestamps. It fits in under 1 GB as NVIDIA's GGUF and runs in Transformers, NeMo or NVIDIA's C++ runtime, under CC BY 4.0. Few other runtimes load it, and it takes no language hint.

Ming-3.0-audio-tiny

1. Fastest start is SGLang-Omni from main, sgl-omni serve --model-path inclusionAI/Ming-3.0-audio-tiny --talker.gpu 0, which exposes OpenAI-style /v1/audio/transcriptions, /v1/audio/speech and /v1/chat/completions
2. For transcripts use greedy decoding with 10-gram blocking and the validated ASR prompt, and expect a language label, a tab, then the text
3. Parse tool calls yourself from <tool_call>name with <arg_key> and <arg_value> pairs, since no runtime parser is named
4. Thinking is off by default, turn it on with chat_template_kwargs enable_thinking true and strip the <think> block from the reply yourself
5. In vLLM-Omni pick a voice with audio.voice id from docs/voices.md, and don't combine it with a reference recording
6. Review the repository's Python before passing trust_remote_code, and consider deleting the __pycache__ folders under talker/ so only readable source runs

Parakeet TDT 0.6B v3

1. For the smallest setup, hf download nvidia/parakeet-tdt-0.6b-v3 parakeet-tdt-0.6b-v3.q8_0.gguf --local-dir models, then nemo-speech transcribe speech.wav --model models/parakeet-tdt-0.6b-v3.q8_0.gguf with NeMo-Speech.cpp
2. In Python, pipeline('automatic-speech-recognition', model='nvidia/parakeet-tdt-0.6b-v3') works on Transformers 5.10.0 or later, despite the card's note to install from source
3. Resample to 16 kHz mono first; it takes wav or flac
4. Ask for timestamps with timestamps=True in NeMo, or pass durations=output.durations to processor.decode in Transformers
5. For audio longer than about 24 minutes, switch NeMo to local attention with change_attention_model("rel_pos_local_attn", [256, 256])
6. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions