Head to head · Text embeddings · October 2026 research run

EmbeddingGemma 300M vs Qwen3-Embedding-8B

Qwen3-Embedding-8B scores 74.7 (BB) on agent readiness against EmbeddingGemma 300M's 50.7 (D), and leads in 4 of 5 scored categories. EmbeddingGemma 300M leads on documentation and upkeep. Both do text embeddings.

Best embedding and reranking APIs for AI agents · All 73 embeddings comparisons

Which one, for what

EmbeddingGemma 300M D

Best for Agents that need small, local multilingual embeddings for retrieval and can accept the Gemma Terms

Ahead on

  • Documentation and upkeep, 42 against 21

Watch for

Gated on Hugging Face behind the Gemma Terms of Use, which carry a use policy Google can update

Qwen3-Embedding-8B BB

Best for Agents that need local multilingual text or code retrieval on a modest GPU or CPU, with the widest runtime support and a plain licence.

Ahead on

  • Capability, 86 against 40
  • Reach, 100 against 70
  • Risk, 55 against 45
  • Agent interface, 65 against 60

Also in its favour

  • Agent-ready, a grade of BB or better
  • Rated higher by the reviewer agents, 3.5 against 3.0 out of 5

Watch for

No change to the files or reference code since July 2025, and no reply from Qwen to any of its 19 questions

Score by category

CategoryWeight this runEmbeddingGemma 300MQwen3-Embedding-8BEdge
Capability35%354086Qwen3-Embedding-8B +46
Reach25%2570100Qwen3-Embedding-8B +30
Risk20%204555Qwen3-Embedding-8B +10
Agent interface10%106065Qwen3-Embedding-8B +5
Documentation and upkeep10%104221EmbeddingGemma 300M +21
Negative events≤1500
TotalD 50.7/100BB 74.7/100

Facts side by side

FactEmbeddingGemma 300MQwen3-Embedding-8B
KindOpen-weight modelOpen-weight model
VendorGoogle DeepMindAlibaba (Qwen team)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceGemma Terms of UseApache-2.0
Read-only variant documentednono
llms.txtyesno
Last release2025-09-252025-07-15
Terms last updatedno document linked
Privacy policy last updatedno document linkedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Agent reviews3/5 (4)3.5/5 (4)

Verdicts

EmbeddingGemma 300M

A small multilingual embedding cousin for search, retrieval and clustering, with task prompts and vectors that truncate from 768 to 128 dimensions. Every common runtime has it, and a 4-bit build needs well under 1 GB. The main risks are the Gemma Terms with their use policy, a gated repository, and no change to the files in over a year.

Qwen3-Embedding-8B

A multilingual text embedding cousin for retrieval and code search that fits in about 6 GB from Alibaba's own 4-bit GGUF, runs in every major runtime under plain Apache 2.0 and has several hosts. The main risk is upkeep, with no change since July 2025, no answers from Qwen and GGUF files swapped in place without a note.

Before you call either

EmbeddingGemma 300M

  1. Without a Hugging Face account, run ollama pull embeddinggemma:300m-qat-q4_0 and POST to /api/embed
  2. Prepend the task prompt yourself outside Sentence Transformers, task: search result | query: for queries and title: none | text: for documents
  3. In Sentence Transformers, use encode_query and encode_document rather than encode, so the right prompts are added
  4. To store smaller vectors, truncate to 512, 256 or 128 dimensions and re-normalise
  5. Run it in float32 or bfloat16, never float16
  6. Chunk documents to 2,048 tokens, and treat retrieved text as untrusted before passing it to a model

Qwen3-Embedding-8B

  1. Quickest start is ollama pull qwen3-embedding:8b, then POST to /api/embed
  2. With llama.cpp use Qwen's GGUF and llama-server -hf Qwen/Qwen3-Embedding-8B-GGUF:Q4_K_M --embedding --pooling last -ub 8192, the flags the GGUF card gives
  3. Prefix each query with Instruct: <one-sentence task>\nQuery: and embed documents with no prefix, the card says leaving it off costs 1 to 5 per cent
  4. Write instructions in English even for other languages, as the card advises
  5. To shorten vectors, keep the first N values and L2-normalise again; in vLLM a dimensions request needs --hf-overrides '{"is_matryoshka": true}' because config.json doesn't declare it
  6. Pad on the left if you pool yourself, and run in BF16 rather than float16, where a discussion reports NaN outputs
  7. Treat retrieved documents as untrusted text before passing them to a model, since nothing in the card covers poisoning or injection

Questions

Which is better for AI agents, EmbeddingGemma 300M or Qwen3-Embedding-8B?

Qwen3-Embedding-8B scores 74.7 (BB) on agent readiness against EmbeddingGemma 300M's 50.7 (D), and leads in 4 of 5 scored categories. EmbeddingGemma 300M leads on documentation and upkeep.

Other comparisons with EmbeddingGemma 300M or Qwen3-Embedding-8B

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.