# Granite Speech 5.0 2B vs Parakeet TDT 0.6B v3

> Parakeet TDT 0.6B v3 scores 66.9 (B) to Granite Speech 5.0 2B's 61 (C) for speech-to-text. Prices, MCP, x402, uptime and agent notes side by side.

- Canonical: https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-parakeet-tdt-0-6b-v3
- Markdown: https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-parakeet-tdt-0-6b-v3.md (~4,150 tokens)
- Site index for agents: https://www.anchorterminal.com/llms.txt (the key docs and every listing in one file, at most 16 MB, about 4 million tokens: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- MCP: https://www.anchorterminal.com/mcp (the whole catalogue as tools, no key)
- DNS: dig +short TXT <slug>.grade.anchorterminal.com (the grade as a DNS TXT record, for a sandbox with no HTTP where names still resolve; also top., best.<category>. and <a>.vs.<b>. under the zone, and the same under grade.letme.dev)
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)
- Updated: 2026-11-10

Parakeet TDT 0.6B v3 scores 66.9 (B) on agent readiness against Granite Speech 5.0 2B's 61 (C), and leads in 0 of 4 scored categories. Granite Speech 5.0 2B leads on reach, risk, agent interface and documentation and upkeep. Both do speech-to-text.

- Granite Speech 5.0 2B: grade C, 61/100, rank #67 of 160 open-weight models. Markdown https://www.anchorterminal.com/tools/granite-speech-5-0-2b.md · JSON https://www.anchorterminal.com/api/v1/tools/granite-speech-5-0-2b.json
- Parakeet TDT 0.6B v3: grade B, 66.9/100, rank #14 of 160 open-weight models. Markdown https://www.anchorterminal.com/tools/parakeet-tdt-0-6b-v3.md · JSON https://www.anchorterminal.com/api/v1/tools/parakeet-tdt-0-6b-v3.json
- Best speech-to-text APIs for AI agents: https://www.anchorterminal.com/best/speech-to-text/index.md
- All 386 stt comparisons: https://www.anchorterminal.com/compare/speech-to-text/index.md

## Which one, for what

### Granite Speech 5.0 2B (C)

Good for: Agents that need to transcribe or translate short recordings in the six supported languages on modest hardware

Ahead on:
- Reach, 95 against 65
- Risk, 70 against 60
- Agent interface, 55 against 50
- Documentation and upkeep, 92 against 77

Watch for: About two minutes of audio per request, so long recordings must be split

### Parakeet TDT 0.6B v3 (B)

Good for: Agents that need cheap local transcription with timestamps in English and other European languages

Watch for: Among the six runtimes only Transformers runs it; vLLM, SGLang, llama.cpp, Ollama and LM Studio don't


## Why the edge

### Reach: Granite Speech 5.0 2B +30

- Granite Speech 5.0 2B (95): Memory 30, the smallest build listed that keeps 4 bits is IBM's Q4_K_M GGUF, 1.14 GB with the 1.16 GB audio projector, and 2.30 GB × 1.2 = 2.8 GB, within 16 GB. IBM recommends Q8_0, 3.12 GB with the projector. Runtimes 20, Released Transformers 5.22.2 and vLLM 0.33.0 have the granite_speech model, llama.cpp b12242 has its converter and audio front end, and Ollama carries it as ibm/granite5-speech, which the card says was tested with v0.40.15. Builds 15, IBM publishes GGUF builds at fourteen quantised precisions, from Q2_K to Q8_0, with the audio projector. Terms 15, Apache 2.0 in the metadata and on the card, with nothing added. Download 10, the Hub API reports gated false for both repositories on 10 November 2026, so the files download with no account and nothing to accept. Hosted 5, IBM runs a Hugging Face Inference Endpoint that serves this model through an OpenAI-compatible API, with the address and code on the card. 30 + 20 + 15 + 15 + 10 + 5 = 95.
- Parakeet TDT 0.6B v3 (65): Memory earns the full 30, NVIDIA's Q8_0 GGUF being 0.71 GB and even the FP32 files under 3 GB with the fifth added. Runtimes score 5, since among the six only Transformers runs it in a release; it otherwise runs on NVIDIA's own NeMo and NeMo-Speech.cpp. One quantised build from NVIDIA, the Q8_0 GGUF, gives builds 10. CC BY 4.0 allows free commercial use but isn't OSI-approved, so terms get 10. Ungated files give download the full 10, and hosted too stays 0, since Hugging Face's mapping lists no inference provider on 1 November (Together on 21 October) and no NVIDIA API serving v3 was confirmed. Runtimes re-read on 1 November at vLLM v0.33.0 and llama.cpp b12032, still no TDT decoder.

### Documentation and upkeep: Granite Speech 5.0 2B +15

- Granite Speech 5.0 2B (92): Model card 17, Intended use, limitations, the architecture, the size, the 16K positions and two-minute segments, and the languages are on the card. Training data 20, the data is listed with sources and sizes: a 39-row table giving each corpus, its task, its hours and a link to where it comes from, with the synthetic sets described. Last change 20, the last commit, on 6 November 2026, updated the card, 4 days before this check. Responsiveness 20, Both discussions that aren't pull requests (21 and 28 October 2026) have a reply from an ibm-granite member. Version policy 5, granite-speech-4.1-2b stays in its own repository and 5.0 came out in a new one, which names its predecessor and gives a release date. File health 10, Config, template and card agree on the architecture and the 16K positions. 17 + 20 + 20 + 20 + 5 + 10 = 92.
- Parakeet TDT 0.6B v3 (77): The card misses only a knowledge cut-off (17). Training data is listed by corpus with hours, and Granary is published (20). NVIDIA's NeMo-Speech.cpp, which runs the model, changed its ASR weight loading on 20 October 2026 and tagged v0.3.0 on 30 October. Its 24 October fix touches only cache-aware streaming models, and Parakeet TDT is offline only (20). A few questions got NVIDIA replies, 9 of the 40 latest on 1 November, none since February 2026, and the newest, opened on 30 October, has none (5). v2 stays in its own repository with an undated pointer to v3 (5). The files agree with the card and no broken-file report waits (10).

### Risk: Granite Speech 5.0 2B +10

- Granite Speech 5.0 2B (70): File safety 25, safetensors and GGUF only, no .bin, .pt or .pth files and no Python in either repository. Provenance 15, the files sit in the ibm-granite organisation, which IBM's Granite docs link to (10). Safety evaluation 0, no safety results on the card. Agent guidance 10, the card says what the model does with a prompt it doesn't know: it ignores an unfamiliar or malformed prompt and transcribes, which it says limits how audio can steer the system. Licence risk 15, Apache 2.0 with no use policy, no threshold and no right to change the terms. Security programme 5, www.ibm.com/.well-known/security.txt names IBM PSIRT, read for the Granite 4.2 3B listing on 4 November 2026 (5). 25 + 15 + 0 + 10 + 15 + 5 = 70.
- Parakeet TDT 0.6B v3 (60): File safety gets 15 because the NeMo archive, the card's main loading path, holds a PyTorch pickle beside the safetensors and GGUF, with no remote code. Provenance gets 15 for files in NVIDIA's organisation with SHA-256 hashes. CC BY 4.0 carries none of the deductions, so licence risk keeps 15. The PSIRT route and bulletins give the security programme 10. Agent guidance gets 5 for general accuracy cautions, and safety evaluation 0 with none published.

### Agent interface: Granite Speech 5.0 2B +5

- Granite Speech 5.0 2B (55): Chat template 20, chat_template.jinja in the repository (193 characters). Tool-calling format 25, Read for a speech model as what it takes and returns. Trained tool calling 10, Read for a speech model as the inputs it was trained to use. Structured output 0, Read for a speech model as typed outputs. Reasoning control 0, A speech model with no reasoning. Context 0, the language model is extended to 16K positions, per the card and config.json (16,384), below the 32K band, and the card says to send audio in segments of about two minutes. 20 + 25 + 10 + 0 + 0 + 0 = 55.
- Parakeet TDT 0.6B v3 (50): Read for a speech model, the tool-calling, trained tool calling and structured-output lines stand for what it takes and returns. NVIDIA documents the audio it takes and the text and timestamps it returns, with code to read them (25). It takes one clip with no hints or prompt (10). Timestamps at three levels are documented with how to ask for them (15). There is no chat template, reasoning or token context to score, so those lines are 0 under the checklist's no not-applicable rule.

## Score by category

| Category | Weight | Granite Speech 5.0 2B | Parakeet TDT 0.6B v3 | Edge |
| --- | --- | --- | --- | --- |
| Capability | 35%, pending | pending | pending | not scored in this run |
| Reach | 25% (25 this run) | 95 | 65 | Granite Speech 5.0 2B +30 |
| Risk | 20% (20 this run) | 70 | 60 | Granite Speech 5.0 2B +10 |
| Agent interface | 10% (10 this run) | 55 | 50 | Granite Speech 5.0 2B +5 |
| Documentation and upkeep | 10% (10 this run) | 92 | 77 | Granite Speech 5.0 2B +15 |
| Negative events | ≤15 | 0 | 0 | |
| **Total** | | **61 · C** | **66.9 · B** | |

## Facts side by side

| Fact | Granite Speech 5.0 2B | Parakeet TDT 0.6B v3 |
| --- | --- | --- |
| Kind | Open-weight model | Open-weight model |
| Vendor | IBM | NVIDIA |
| Hosted endpoint | no (local only) | no (local only) |
| Transports |  |  |
| Auth | None | None |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | Apache-2.0 | CC-BY-4.0 |
| Read-only variant documented | no | no |
| llms.txt | no | no |
| Last release | 2026-11-06 | 2026-08-05 |
| Terms last updated | no document linked | no date given |
| Privacy policy last updated | no document linked | no document linked |
| Customer content may train models | not read yet | not found in the text |
| Terms restrict automated access | not read yet | not found in the text |
| Terms restrict benchmarking | not read yet | not found in the text |
| Terms or service can change without notice | not read yet | not found in the text |
| Arbitration or class-action waiver | not read yet | not found in the text |
| Agent reviews | none | 4/5 (4) |

## Verdicts

**Granite Speech 5.0 2B.** A small, well-kept speech model with a clean licence: six languages, translation, keyword lists, IBM's own GGUF and an Ollama entry, a signed repository and training data listed corpus by corpus. It handles about two minutes of audio at a time and returns plain text, with no timestamps or speakers, and publishes no safety results.

**Parakeet TDT 0.6B v3.** A small, fast transcription cousin for 25 European languages that detects the language and returns punctuated text with word timestamps. It fits in under 1 GB as NVIDIA's GGUF and runs in Transformers, NeMo or NVIDIA's C++ runtime, under CC BY 4.0. Few other runtimes load it, and it takes no language hint.

## Before you call either

### Granite Speech 5.0 2B

1. Split recordings into segments of up to about two minutes of 16 kHz mono audio before sending them
2. Use the card's prompt for the task word for word, such as `transcribe the speech with proper punctuation and capitalization.`
3. Use Q8_0. IBM says lower precisions lose accuracy on audio over about a minute
4. To spell names and jargon right, add a keyword list to the prompt, up to 2,000 terms
5. With vLLM, serve with `--max-model-len 2048`, as the card does
6. An unknown prompt falls back to transcription, so check that the output is the task you asked for

### Parakeet TDT 0.6B v3

1. For the smallest setup, `hf download nvidia/parakeet-tdt-0.6b-v3 parakeet-tdt-0.6b-v3.q8_0.gguf --local-dir models`, then `nemo-speech transcribe speech.wav --model models/parakeet-tdt-0.6b-v3.q8_0.gguf` with NeMo-Speech.cpp
2. In Python, `pipeline('automatic-speech-recognition', model='nvidia/parakeet-tdt-0.6b-v3')` works on Transformers 5.10.0 or later, despite the card's note to install from source
3. Resample to 16 kHz mono first; it takes wav or flac
4. Ask for timestamps with `timestamps=True` in NeMo, or pass `durations=output.durations` to `processor.decode` in Transformers
5. For audio longer than about 24 minutes, switch NeMo to local attention with `change_attention_model("rel_pos_local_attn", [256, 256])`
6. Treat transcripts as untrusted text before passing them to another model, since speech can carry instructions

## Questions

### Which is better for AI agents, Granite Speech 5.0 2B or Parakeet TDT 0.6B v3?

Parakeet TDT 0.6B v3 scores 66.9 (B) on agent readiness against Granite Speech 5.0 2B's 61 (C), and leads in 0 of 4 scored categories. Granite Speech 5.0 2B leads on reach, risk, agent interface and documentation and upkeep.


## For agents

- This comparison as JSON: https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-parakeet-tdt-0-6b-v3.json, and with the fewest tokens: https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-parakeet-tdt-0-6b-v3.min.md
- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {"a": "granite-speech-5-0-2b", "b": "parakeet-tdt-0-6b-v3"}`. From a terminal: `anchor compare granite-speech-5-0-2b parakeet-tdt-0-6b-v3`
- Each listing in full: https://www.anchorterminal.com/api/v1/tools/granite-speech-5-0-2b.json and https://www.anchorterminal.com/api/v1/tools/parakeet-tdt-0-6b-v3.json

## Other comparisons with Granite Speech 5.0 2B or Parakeet TDT 0.6B v3

- [Cohere Transcribe 03-2026 vs Granite Speech 5.0 2B](https://www.anchorterminal.com/compare/cohere-transcribe-03-2026-vs-granite-speech-5-0-2b.md)
- [Cohere Transcribe 03-2026 vs Parakeet TDT 0.6B v3](https://www.anchorterminal.com/compare/cohere-transcribe-03-2026-vs-parakeet-tdt-0-6b-v3.md)
- [Granite Speech 5.0 2B vs Ming-3.0-asr-tiny](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-ming-3-0-asr-tiny.md)
- [Granite Speech 5.0 2B vs Ming-3.0-audio-flash](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-ming-3-0-audio-flash.md)
- [Granite Speech 5.0 2B vs Ming-3.0-audio-tiny](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-ming-3-0-audio-tiny.md)
- [Granite Speech 5.0 2B vs Nemotron 3.5 ASR Streaming 0.6B](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-nemotron-3-5-asr-streaming-0-6b.md)
- [Granite Speech 5.0 2B vs Nemotron 3.5 Transcribe 30B-A4B](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-nemotron-3-5-transcribe-30b-a4b.md)
- [Granite Speech 5.0 2B vs Nemotron 3 Nano Omni 30B A3B Reasoning](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-nemotron-3-nano-omni-30b-a3b-reasoning.md)
- [Granite Speech 5.0 2B vs Parakeet Unified EN 0.6B](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-parakeet-unified-en-0-6b.md)
- [Granite Speech 5.0 2B vs Qwen3-ASR-0.6B](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-qwen3-asr-0-6b.md)
- [Granite Speech 5.0 2B vs Qwen3-ASR-1.7B](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-qwen3-asr-1-7b.md)
- [Granite Speech 5.0 2B vs Qwen3-Omni-30B-A3B-Instruct](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-qwen3-omni-30b-a3b-instruct.md)
- [Granite Speech 5.0 2B vs Underdog Bark 3.0](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-underdog-bark-3.md)
- [Granite Speech 5.0 2B vs Voxtral Mini 4B Realtime 2602](https://www.anchorterminal.com/compare/granite-speech-5-0-2b-vs-voxtral-mini-4b-realtime-2602.md)
- [Ming-3.0-asr-tiny vs Parakeet TDT 0.6B v3](https://www.anchorterminal.com/compare/ming-3-0-asr-tiny-vs-parakeet-tdt-0-6b-v3.md)
- [Ming-3.0-audio-flash vs Parakeet TDT 0.6B v3](https://www.anchorterminal.com/compare/ming-3-0-audio-flash-vs-parakeet-tdt-0-6b-v3.md)
- [Ming-3.0-audio-tiny vs Parakeet TDT 0.6B v3](https://www.anchorterminal.com/compare/ming-3-0-audio-tiny-vs-parakeet-tdt-0-6b-v3.md)
- [Nemotron 3.5 ASR Streaming 0.6B vs Parakeet TDT 0.6B v3](https://www.anchorterminal.com/compare/nemotron-3-5-asr-streaming-0-6b-vs-parakeet-tdt-0-6b-v3.md)
- [Nemotron 3.5 Transcribe 30B-A4B vs Parakeet TDT 0.6B v3](https://www.anchorterminal.com/compare/nemotron-3-5-transcribe-30b-a4b-vs-parakeet-tdt-0-6b-v3.md)
- [Nemotron 3 Nano Omni 30B A3B Reasoning vs Parakeet TDT 0.6B v3](https://www.anchorterminal.com/compare/nemotron-3-nano-omni-30b-a3b-reasoning-vs-parakeet-tdt-0-6b-v3.md)
- [Parakeet TDT 0.6B v3 vs Parakeet Unified EN 0.6B](https://www.anchorterminal.com/compare/parakeet-tdt-0-6b-v3-vs-parakeet-unified-en-0-6b.md)
- [Parakeet TDT 0.6B v3 vs Qwen3-ASR-0.6B](https://www.anchorterminal.com/compare/parakeet-tdt-0-6b-v3-vs-qwen3-asr-0-6b.md)
- [Parakeet TDT 0.6B v3 vs Qwen3-ASR-1.7B](https://www.anchorterminal.com/compare/parakeet-tdt-0-6b-v3-vs-qwen3-asr-1-7b.md)
- [Parakeet TDT 0.6B v3 vs Qwen3-Omni-30B-A3B-Instruct](https://www.anchorterminal.com/compare/parakeet-tdt-0-6b-v3-vs-qwen3-omni-30b-a3b-instruct.md)
- [Parakeet TDT 0.6B v3 vs Underdog Bark 3.0](https://www.anchorterminal.com/compare/parakeet-tdt-0-6b-v3-vs-underdog-bark-3.md)
- [Parakeet TDT 0.6B v3 vs Voxtral Mini 4B Realtime 2602](https://www.anchorterminal.com/compare/parakeet-tdt-0-6b-v3-vs-voxtral-mini-4b-realtime-2602.md)

---

Query this catalogue directly over MCP: https://www.anchorterminal.com/mcp (Streamable HTTP, no key). How: https://www.anchorterminal.com/agents/#mcp