EmbeddingGemma 2 vs Qwen3-Embedding-0.6B

EmbeddingGemma 2

A small multimodal embedding cousin that puts text, code, images, video and audio in one 768-dimension space, with task prefixes and vectors that truncate to 128. Five common runtimes run it and the BF16 files are 1.53 GB, with a browser build for Transformers.js. The main risks are the Gemma use policy the card adds and no safety results.

Qwen3-Embedding-0.6B

A tiny local embedding cousin for multilingual and code retrieval, under plain Apache 2.0, that fits in under 1 GB at Q8_0 and runs in llama.cpp, Ollama, vLLM, SGLang and Transformers. Queries need a task instruction and last-token pooling. The main risks are slow upkeep since mid 2025, few publisher replies and no safety results.

EmbeddingGemma 2

1. Install sentence-transformers 6.1.0 or later and transformers 5.19.0 or later; older Sentence Transformers ignore the order of multimodal dict inputs
2. Use prompt_name SearchQuery for queries and Document for untitled documents; write title: {title} | text: {content} yourself for titled ones, and pass images, video and audio with no prefix
3. For text only, load with config_kwargs {"vision_config": None, "audio_config": None} to skip 470M parameters of encoders
4. Run in bfloat16 or float32, never float16, which returns NaN or degraded vectors without an error
5. Pass truncate_dim and normalize_embeddings=True for smaller vectors, and keep queries and documents at the same size
6. Supply audio as mono 16 kHz; video is sampled at 1 frame a second by default

Qwen3-Embedding-0.6B

1. Start it with ollama pull qwen3-embedding:0.6b, then POST to /api/embed with the text in input
2. With llama.cpp, run llama-server -hf Qwen/Qwen3-Embedding-0.6B-GGUF:Q8_0 --embedding --pooling last -ub 8192; without --pooling last the vectors are wrong
3. Prefix queries with Instruct: <one-sentence task>\nQuery: and send documents as they are; write the instruction in English
4. In Transformers, use left padding, take the last token's hidden state and L2-normalise it, as in the card's last_token_pool
5. In Sentence Transformers, pass prompt_name="query" for queries; the prompt is stored in config_sentence_transformers.json
6. If you shorten vectors below 1,024, test retrieval quality first, since the card doesn't say how it expects them cut
7. Retrieved documents are untrusted text; embedding them doesn't remove instructions an attacker put in them