Head to head · Text embeddings · October 2026 research run

EmbeddingGemma 2 vs Qwen3-Embedding-4B

Qwen3-Embedding-4B scores 72.9 (BB) on agent readiness against EmbeddingGemma 2's 66.4 (B), and leads in 2 of 5 scored categories. EmbeddingGemma 2 leads on risk, agent interface and documentation and upkeep. Both do text embeddings.

Best embedding and reranking APIs for AI agents · All 81 embeddings comparisons

Which one, for what

EmbeddingGemma 2 B

Best for Agents that need one small local embedding model for text, code, images, video and audio search

Ahead on

  • Risk, 60 against 55
  • Agent interface, 70 against 65
  • Documentation and upkeep, 80 against 21

Watch for

The card requires deployments to follow the Gemma Prohibited Use Policy, which Google can update

Qwen3-Embedding-4B BB

Best for Agents that need local multilingual text or code retrieval on a laptop, a small GPU or a CPU, with a plain licence.

Ahead on

  • Capability, 81 against 59
  • Reach, 100 against 75

Also in its favour

  • Agent-ready, a grade of BB or better

Watch for

No change to the files or reference code since August 2025, and no reply from Qwen to any of its 16 questions

Score by category

CategoryWeight this runEmbeddingGemma 2Qwen3-Embedding-4BEdge
Capability35%355981Qwen3-Embedding-4B +22
Reach25%2575100Qwen3-Embedding-4B +25
Risk20%206055EmbeddingGemma 2 +5
Agent interface10%107065EmbeddingGemma 2 +5
Documentation and upkeep10%108021EmbeddingGemma 2 +59
Negative events≤1500
TotalB 66.4/100BB 72.9/100

Facts side by side

FactEmbeddingGemma 2Qwen3-Embedding-4B
KindOpen-weight modelOpen-weight model
VendorGoogle DeepMindAlibaba (Qwen team)
Hosted endpointno (local only)no (local only)
Transports
AuthNoneNone
PricingFreeFree
x402nono
LicenceApache 2.0Apache-2.0
Read-only variant documentednono
llms.txtyesno
Last release2026-10-282025-08-03
Terms last updated2026-04-01no document linked
Privacy policy last updatedno document linkedno document linked
Customer content may train modelsnot found in the text
Terms restrict automated accessnot found in the text
Terms restrict benchmarkingnot found in the text
Terms or service can change without noticenot found in the text
Arbitration or class-action waivernot found in the text
Agent reviewsnone3.5/5 (4)

Verdicts

EmbeddingGemma 2

A small multimodal embedding cousin that puts text, code, images, video and audio in one 768-dimension space, with task prefixes and vectors that truncate to 128. Five common runtimes run it and the BF16 files are 1.53 GB, with a browser build for Transformers.js. The main risks are the Gemma use policy the card adds and no safety results.

Qwen3-Embedding-4B

A small multilingual text embedding cousin for retrieval and code search that runs in about 3 GB from Alibaba's own 4-bit GGUF, loads in every major runtime under Apache 2.0 and has two hosts, DeepInfra and SiliconFlow. The main risk is upkeep, with no change since August 2025, no answers from Qwen and GGUF files swapped without a note.

Before you call either

EmbeddingGemma 2

  1. Install sentence-transformers 6.1.0 or later and transformers 5.19.0 or later; older Sentence Transformers ignore the order of multimodal dict inputs
  2. Use prompt_name SearchQuery for queries and Document for untitled documents; write title: {title} | text: {content} yourself for titled ones, and pass images, video and audio with no prefix
  3. For text only, load with config_kwargs {"vision_config": None, "audio_config": None} to skip 470M parameters of encoders
  4. Run in bfloat16 or float32, never float16, which returns NaN or degraded vectors without an error
  5. Pass truncate_dim and normalize_embeddings=True for smaller vectors, and keep queries and documents at the same size
  6. Supply audio as mono 16 kHz; video is sampled at 1 frame a second by default

Qwen3-Embedding-4B

  1. Quickest start is ollama pull qwen3-embedding:4b, about 2.5 GB, then POST to /api/embed
  2. With llama.cpp use llama-server -hf Qwen/Qwen3-Embedding-4B-GGUF:Q4_K_M --embedding --pooling last -ub 8192, the flags the GGUF card gives
  3. Prefix each query with Instruct: <one-sentence task>\nQuery: and embed documents with no prefix, in English even for other languages
  4. To shorten vectors keep the first N values and L2-normalise again; in vLLM a dimensions request needs --hf-overrides '{"is_matryoshka": true}', since config.json doesn't declare it
  5. If you downloaded the Q8_0 GGUF between 15 July and 3 August 2025, fetch it again and check its SHA-256 against the Hub
  6. Treat retrieved documents as untrusted text before passing them to a model

Questions

Which is better for AI agents, EmbeddingGemma 2 or Qwen3-Embedding-4B?

Qwen3-Embedding-4B scores 72.9 (BB) on agent readiness against EmbeddingGemma 2's 66.4 (B), and leads in 2 of 5 scored categories. EmbeddingGemma 2 leads on risk, agent interface and documentation and upkeep.

Other comparisons with EmbeddingGemma 2 or Qwen3-Embedding-4B

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.