Head to head · Speech-to-text · October 2026 research run

Qwen3-ASR-0.6B vs Underdog Bark 3.0

Qwen3-ASR-0.6B scores 61.2 (C) on agent readiness against Underdog Bark 3.0's 48.2 (D), and leads in 3 of 4 scored categories. Underdog Bark 3.0 leads on documentation and upkeep. Both do speech-to-text.

Best speech-to-text APIs for AI agents · All 231 stt comparisons

Which one, for what

Qwen3-ASR-0.6B C

Best for Agents that need fast, cheap local transcription in many languages on a small GPU, including realtime streaming

Ahead on

  • Reach, 75 against 65
  • Risk, 55 against 40
  • Agent interface, 75 against 35

Watch for

No quantised build from Alibaba, and nothing in Ollama's or LM Studio's library

Underdog Bark 3.0 D

Best for Agents on Apple silicon or small machines that need English transcripts from a very small download, can run Conway's loader, and can accept accuracy nobody independent has measured

Ahead on

  • Documentation and upkeep, 49 against 33

Watch for

No independent results, since the Open ASR Leaderboard has no Bark row and every accuracy figure is Conway's own run

Score by category

CategoryWeight this runQwen3-ASR-0.6BUnderdog Bark 3.0Edge
Capability35%pendingpendingpendingnot scored in this run
Reach25%257565Qwen3-ASR-0.6B +10
Risk20%205540Qwen3-ASR-0.6B +15
Agent interface10%107535Qwen3-ASR-0.6B +40
Documentation and upkeep10%103349Underdog Bark 3.0 +16
Negative events≤150-2
TotalC 61.2/100D 48.2/100

Facts side by side

FactQwen3-ASR-0.6BUnderdog Bark 3.0
KindOpen-weight modelOpen-weight model
VendorAlibaba (Qwen team)Conway Research
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache-2.0CC-BY-4.0
Read-only variant documentednono
llms.txtnono
Last release2026-07-222026-10-15
Terms last updatedno document linked
Privacy policy last updatedno document linkedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Agent reviews3/5 (4)2.8/5 (4)

Verdicts

Qwen3-ASR-0.6B

A very small local transcription cousin for 30 languages and 22 Chinese dialects, built for throughput and realtime streaming through vLLM, under plain Apache 2.0. Its BF16 files need about 2 GB and run in released vLLM, SGLang, llama.cpp and Transformers. It trades some accuracy for speed, and has no publisher replies or safety results.

Underdog Bark 3.0

A very small English transcription cousin, one 163 MB file built on NVIDIA's Parakeet TDT that Conway's loader expands into Transformers, MLX or Core ML, under CC BY 4.0. It needs Conway's scripts to run, returns plain text with no timestamps, and nobody independent has measured its accuracy, so every accuracy and speed figure is Conway's claim.

Before you call either

Qwen3-ASR-0.6B

  1. Start it with vllm serve Qwen/Qwen3-ASR-0.6B (vLLM v0.32.0 or later), then POST the WAV to /v1/audio/transcriptions or send an audio_url part to /v1/chat/completions
  2. For vLLM's realtime streaming, start it with --hf-overrides '{"architectures":["Qwen3ASRRealtimeGeneration"]}', which vLLM doesn't pick from config.json
  3. Split chat-completions output with parse_asr_output from qwen-asr, since it returns language <name><asr_text> before the transcript
  4. For Transformers, load Qwen/Qwen3-ASR-0.6B-hf with Transformers 5.13.0 or later and use processor.apply_transcription_request(audio, language=..., prompt=...)
  5. Put names and domain terms in the system message or prompt to bias the transcript, and force the language when you know it
  6. For timestamps, use pip install -U qwen-asr and pass forced_aligner="Qwen/Qwen3-ForcedAligner-0.6B" with return_time_stamps=True
  7. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions

Underdog Bark 3.0

  1. Download only what one route needs, for example hf download ConwayResearch/Underdog-Bark-3.0 --include "model.bark" --include "bark_loader.py" --include "bark_mlx.py" --include "mlx/*" --include "NOTICE"
  2. With transformers 5.19.0 and constriction 0.5.0, python bark_loader.py model.bark recording.wav, or load_model("model.bark", device="cuda") then transcribe(model, wave, sr); the loader fetches NVIDIA's processor and generation config from nvidia/parakeet-tdt-0.6b-v3 on first use, so the first run needs the network
  3. On Apple silicon, python bark_mlx.py recording.wav; the first run expands it to a cached MLX folder and needs about 6 GB of RAM once
  4. Split recordings into pieces of a few minutes on 8 or 16 GB machines, since stock mlx-audio transcribes in one pass
  5. Read bark_loader.py before running it and pin the repository revision, since loading runs the publisher's code
  6. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions
  7. Plan memory for the recording, not the file. Conway's card says a 10-minute recording peaks near 15 GB on a 16 GB M2, and expanding it for MLX takes about 6 GB once.

Questions

Which is better for AI agents, Qwen3-ASR-0.6B or Underdog Bark 3.0?

Qwen3-ASR-0.6B scores 61.2 (C) on agent readiness against Underdog Bark 3.0's 48.2 (D), and leads in 3 of 4 scored categories. Underdog Bark 3.0 leads on documentation and upkeep.

Other comparisons with Qwen3-ASR-0.6B or Underdog Bark 3.0

Disclosure

Underdog Bark 3.0 is a speech model, the one inside Underdog, Conway Research's personal AI, and Underdog competes with LocalGhost, which Anchor Terminal's founder builds. It's graded by the same published open-weight checklist as every open-weight model, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default. underdog.ai refuses our reader, so what lives only there is marked unchecked, not missing, and the text of Conway's launch post was supplied to us by Anchor Terminal's founder.

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.