Ming-3.0-audio-tiny vs Underdog Bark 3.0

Ming-3.0-audio-tiny

A small MIT-licensed audio-language model that transcribes Chinese and English, answers questions about audio and replies in a built-in or cloned voice. It needs about 25 GB and SGLang-Omni from main or inclusionAI's own vLLM-Omni and SGLang branches. The main risk is that every loading path runs repository code, with nothing published on safety.

Underdog Bark 3.0

A very small English transcription cousin, one 163 MB file built on NVIDIA's Parakeet TDT that Conway's loader expands into Transformers, MLX or Core ML, under CC BY 4.0. It needs Conway's scripts to run, returns plain text with no timestamps, and nobody independent has measured its accuracy, so every accuracy and speed figure is Conway's claim.

Ming-3.0-audio-tiny

1. Fastest start is SGLang-Omni from main, sgl-omni serve --model-path inclusionAI/Ming-3.0-audio-tiny --talker.gpu 0, which exposes OpenAI-style /v1/audio/transcriptions, /v1/audio/speech and /v1/chat/completions
2. For transcripts use greedy decoding with 10-gram blocking and the validated ASR prompt, and expect a language label, a tab, then the text
3. Parse tool calls yourself from <tool_call>name with <arg_key> and <arg_value> pairs, since no runtime parser is named
4. Thinking is off by default, turn it on with chat_template_kwargs enable_thinking true and strip the <think> block from the reply yourself
5. In vLLM-Omni pick a voice with audio.voice id from docs/voices.md, and don't combine it with a reference recording
6. Review the repository's Python before passing trust_remote_code, and consider deleting the __pycache__ folders under talker/ so only readable source runs

Underdog Bark 3.0

1. Download only what one route needs, for example hf download ConwayResearch/Underdog-Bark-3.0 --include "model.bark" --include "bark_loader.py" --include "bark_mlx.py" --include "mlx/*" --include "NOTICE"
2. With transformers 5.19.0 and constriction 0.5.0, python bark_loader.py model.bark recording.wav, or load_model("model.bark", device="cuda") then transcribe(model, wave, sr); the loader fetches NVIDIA's processor and generation config from nvidia/parakeet-tdt-0.6b-v3 on first use, so the first run needs the network
3. On Apple silicon, python bark_mlx.py recording.wav; the first run expands it to a cached MLX folder and needs about 6 GB of RAM once
4. Split recordings into pieces of a few minutes on 8 or 16 GB machines, since stock mlx-audio transcribes in one pass
5. Read bark_loader.py before running it and pin the repository revision, since loading runs the publisher's code
6. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions
7. Plan memory for the recording, not the file. Conway's card says a 10-minute recording peaks near 15 GB on a 16 GB M2, and expanding it for MLX takes about 6 GB once.