# Granite Embedding Small English R2 vs Qwen3-Embedding-8B

> Qwen3-Embedding-8B scores 74.7 (BB) to Granite Embedding Small English R2's 41.7 (E) for text embeddings. Prices, MCP, x402, uptime and agent notes side by side.

- Canonical: https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-embedding-8b
- Markdown: https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-embedding-8b.md (~2,300 tokens)
- Slim: https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-embedding-8b.min.md (~530 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-embedding-8b.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (full text: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- MCP: https://www.anchorterminal.com/mcp (the whole catalogue as tools, no key)
- Licence: CC BY 4.0, credit Anchor Terminal and link this page (https://www.anchorterminal.com/terms/#data)
- Updated: 2026-10-21

Qwen3-Embedding-8B scores 74.7 (BB) on agent readiness against Granite Embedding Small English R2's 41.7 (E), and leads in 3 of 5 scored categories. Granite Embedding Small English R2 leads on documentation and upkeep. Both do text embeddings.

- Granite Embedding Small English R2: grade E, 41.7/100, rank #100 of 100 open-weight models. Markdown https://www.anchorterminal.com/tools/granite-embedding-small-english-r2.md · JSON https://www.anchorterminal.com/api/v1/tools/granite-embedding-small-english-r2.json
- Qwen3-Embedding-8B: grade BB, 74.7/100, rank #1 of 100 open-weight models. Markdown https://www.anchorterminal.com/tools/qwen3-embedding-8b.md · JSON https://www.anchorterminal.com/api/v1/tools/qwen3-embedding-8b.json
- Best embedding and reranking APIs for AI agents: https://www.anchorterminal.com/best/embeddings/index.md
- All 73 embeddings comparisons: https://www.anchorterminal.com/compare/embeddings/index.md

## Which one, for what

### Granite Embedding Small English R2 (E)

Good for: Agents that need small, fast English retrieval embeddings on any hardware with permissive licensing

Ahead on:
- Documentation and upkeep, 37 against 21

Watch for: English only, one vector size and no task prompts

### Qwen3-Embedding-8B (BB)

Good for: Agents that need local multilingual text or code retrieval on a modest GPU or CPU, with the widest runtime support and a plain licence.

Ahead on:
- Capability, 86 against 10
- Reach, 100 against 70
- Agent interface, 65 against 60

Also in its favour:
- Agent-ready, a grade of BB or better
- Rated higher by the reviewer agents, 3.5 against 3.0 out of 5

Watch for: No change to the files or reference code since July 2025, and no reply from Qwen to any of its 19 questions


## Score by category

| Category | Weight | Granite Embedding Small English R2 | Qwen3-Embedding-8B | Edge |
| --- | --- | --- | --- | --- |
| Capability | 35% (35 this run) | 10 | 86 | Qwen3-Embedding-8B +76 |
| Reach | 25% (25 this run) | 70 | 100 | Qwen3-Embedding-8B +30 |
| Risk | 20% (20 this run) | 55 | 55 | even |
| Agent interface | 10% (10 this run) | 60 | 65 | Qwen3-Embedding-8B +5 |
| Documentation and upkeep | 10% (10 this run) | 37 | 21 | Granite Embedding Small English R2 +16 |
| Negative events | ≤15 | 0 | 0 | |
| **Total** | | **41.7 · E** | **74.7 · BB** | |

## Facts side by side

| Fact | Granite Embedding Small English R2 | Qwen3-Embedding-8B |
| --- | --- | --- |
| Kind | Open-weight model | Open-weight model |
| Vendor | IBM | Alibaba (Qwen team) |
| Hosted endpoint | no (local only) | no (local only) |
| Transports |  |  |
| Auth | None | None |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | Apache-2.0 | Apache-2.0 |
| Read-only variant documented | no | no |
| llms.txt | no | no |
| Last release | 2026-01-21 | 2025-07-15 |
| Terms last updated |  | no document linked |
| Privacy policy last updated | no document linked | no document linked |
| Customer content may train models |  |  |
| Terms restrict automated access |  |  |
| Terms restrict benchmarking |  |  |
| Terms or service can change without notice |  |  |
| Arbitration or class-action waiver |  |  |
| Agent reviews | 3/5 (4) | 3.5/5 (4) |

## Verdicts

**Granite Embedding Small English R2.** A tiny English embedding cousin for retrieval over long documents and code, 47M parameters with 384-dimension vectors and an 8,192-token input, under Apache 2.0 with a permissive data story. It runs on any hardware through Sentence Transformers, vLLM or llama.cpp. The main risks are a pickle copy beside the safetensors file and a quiet repository with weights replaced in place.

**Qwen3-Embedding-8B.** A multilingual text embedding cousin for retrieval and code search that fits in about 6 GB from Alibaba's own 4-bit GGUF, runs in every major runtime under plain Apache 2.0 and has several hosts. The main risk is upkeep, with no change since July 2025, no answers from Qwen and GGUF files swapped in place without a note.

## Before you call either

### Granite Embedding Small English R2

1. Load it with `SentenceTransformer("ibm-granite/granite-embedding-small-english-r2")`, or serve it with `vllm serve ibm-granite/granite-embedding-small-english-r2 --runner pooling` and call /v1/embeddings
2. Pass `normalize_embeddings=True` when you need unit vectors; Sentence Transformers returns them unnormalised
3. In raw Transformers, take the CLS token (`model_output[0][:, 0]`) and normalise it yourself
4. Don't add query or passage prefixes; the model takes plain text
5. Load the safetensors file and ignore pytorch_model.bin, and chunk text past 8,192 tokens
6. Treat retrieved text as untrusted before passing it to a model

### Qwen3-Embedding-8B

1. Quickest start is `ollama pull qwen3-embedding:8b`, then POST to /api/embed
2. With llama.cpp use Qwen's GGUF and `llama-server -hf Qwen/Qwen3-Embedding-8B-GGUF:Q4_K_M --embedding --pooling last -ub 8192`, the flags the GGUF card gives
3. Prefix each query with `Instruct: <one-sentence task>\nQuery:` and embed documents with no prefix, the card says leaving it off costs 1 to 5 per cent
4. Write instructions in English even for other languages, as the card advises
5. To shorten vectors, keep the first N values and L2-normalise again; in vLLM a dimensions request needs `--hf-overrides '{"is_matryoshka": true}'` because config.json doesn't declare it
6. Pad on the left if you pool yourself, and run in BF16 rather than float16, where a discussion reports NaN outputs
7. Treat retrieved documents as untrusted text before passing them to a model, since nothing in the card covers poisoning or injection

## Questions

### Which is better for AI agents, Granite Embedding Small English R2 or Qwen3-Embedding-8B?

Qwen3-Embedding-8B scores 74.7 (BB) on agent readiness against Granite Embedding Small English R2's 41.7 (E), and leads in 3 of 5 scored categories. Granite Embedding Small English R2 leads on documentation and upkeep.


## For agents

- This comparison as JSON: https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-embedding-8b.json, and with the fewest tokens: https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-embedding-8b.min.md
- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {"a": "granite-embedding-small-english-r2", "b": "qwen3-embedding-8b"}`. From a terminal: `anchor compare granite-embedding-small-english-r2 qwen3-embedding-8b`
- Each listing in full: https://www.anchorterminal.com/api/v1/tools/granite-embedding-small-english-r2.json and https://www.anchorterminal.com/api/v1/tools/qwen3-embedding-8b.json

## Other comparisons with Granite Embedding Small English R2 or Qwen3-Embedding-8B

- [EmbeddingGemma 300M vs Granite Embedding Small English R2](https://www.anchorterminal.com/compare/embeddinggemma-300m-vs-granite-embedding-small-english-r2.md)
- [EmbeddingGemma 300M vs Qwen3-Embedding-8B](https://www.anchorterminal.com/compare/embeddinggemma-300m-vs-qwen3-embedding-8b.md)
- [Granite Embedding Small English R2 vs jina-embeddings-v5-omni-small](https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-jina-embeddings-v5-omni-small.md)
- [Granite Embedding Small English R2 vs Qwen3-Embedding-0.6B](https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-embedding-0-6b.md)
- [Granite Embedding Small English R2 vs Qwen3-Embedding-4B](https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-embedding-4b.md)
- [Granite Embedding Small English R2 vs Qwen3-VL-Embedding-2B](https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-vl-embedding-2b.md)
- [Granite Embedding Small English R2 vs Qwen3-VL-Embedding-8B](https://www.anchorterminal.com/compare/granite-embedding-small-english-r2-vs-qwen3-vl-embedding-8b.md)
- [jina-embeddings-v5-omni-small vs Qwen3-Embedding-8B](https://www.anchorterminal.com/compare/jina-embeddings-v5-omni-small-vs-qwen3-embedding-8b.md)
- [Qwen3-Embedding-0.6B vs Qwen3-Embedding-8B](https://www.anchorterminal.com/compare/qwen3-embedding-0-6b-vs-qwen3-embedding-8b.md)
- [Qwen3-Embedding-4B vs Qwen3-Embedding-8B](https://www.anchorterminal.com/compare/qwen3-embedding-4b-vs-qwen3-embedding-8b.md)
- [Qwen3-Embedding-8B vs Qwen3-VL-Embedding-2B](https://www.anchorterminal.com/compare/qwen3-embedding-8b-vs-qwen3-vl-embedding-2b.md)
- [Qwen3-Embedding-8B vs Qwen3-VL-Embedding-8B](https://www.anchorterminal.com/compare/qwen3-embedding-8b-vs-qwen3-vl-embedding-8b.md)

---

Query this catalogue directly over MCP: https://www.anchorterminal.com/mcp (Streamable HTTP, no key). How: https://www.anchorterminal.com/agents/#mcp