Niches · Embeddings & rerankers

Embed a large corpus in bulk and keep the index small

Two or three companies' docs show a full fit.

2companies, full fit
16companies, fit with a limit
35companies carry the tag
12share of the category's work
11first-hand accounts

What counts as done

A batch or async route takes the corpus and returns precisely one vector per input in input order, its price per million tokens (and any batch discount) is published, and vectors can be shortened or returned as int8 or binary through a documented parameter that the chosen route honours.

Measured, for our own tests: 1M tokens embedded without an unhandled 429, and wall-clock time for that job. No docs we read state these figures, so they don't count against a listing here.

How agents ask for it: embed all 10 million records, backfill embeddings for the whole archive, cut our vector storage bill, give me int8 or binary vectors

Does the job 2

The docs show it meets the test above, and nothing we read says otherwise.

ListingWhy
Jina Embeddings and Reranker B
Jina AI GmbH
POST /v1/batch/embeddings takes OpenAI-style JSONL keyed by custom_id; binary, ubinary and dimensions are request fields; the model catalogue prices v5-small at $0.05 and nano at $0.02 per million tokens. The 1M-token 429 test is unmeasured. source
Voyage AI embeddings and rerankers B
Voyage AI Innovations, Inc.
Up to 1,000 texts a call within per-model token caps, a Batch API at a 33 per cent discount, published per-token prices, and output_dtype int8, uint8, binary or ubinary with output_dimension. An account found it the fastest service for 250M tokens. source

Does the job, with a limit 17

It does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.

ListingWhy
Amazon Nova Multimodal Embeddings BB
Amazon Web Services, Inc.
Bedrock batch inference lists the model in us-east-1 and embeddingDimension shortens to 256, 384 or 1024, but a synchronous call embeds one item, there is no int8 or binary output, and the batch price wasn't on a page read here. source
Cohere Embed and Rerank BB
Cohere Inc.
int8, uint8, binary, ubinary and output_dimension are documented, but calls cap at 96 inputs and 2,000 inputs a minute, Embed Jobs isn't listed for Embed 5, and the client once dropped int8 vectors from later batches. source
EmbeddingGemma 2 B
Google LLC (RDAP registrant of gemma.ai; the card names Google DeepMind as author)
Batches encode locally and truncate_dim gives 512, 256 or 128 dimensions with a quality table; an account stored 49.3M items as 256-bit binary codes. No batch route or price exists; the cost and wall-clock time are the owner's hardware. source
EmbeddingGemma 300M D
Google LLC (RDAP registrant of gemma.ai; the card names Google DeepMind as author)
Batches encode locally and MRL truncation to 512, 256 or 128 is documented with scores per size, but there is no batch route or price; cost and wall-clock time are the owner's hardware. source
Gemini Embedding B
Google LLC
batchEmbedContents and a Batch API at half price ($0.20 standard per million text tokens) with output_dimensionality down to 128, but float output only, standard rate limits only in AI Studio, and the SDK merged N inputs into one vector. source
Granite Embedding Small English R2 E
International Business Machines Corporation
Fast to run locally (about 199 documents a second on one H100 per the card), but there is no batch route or price, and no documented way to shorten vectors or return int8 or binary. source
jina-embeddings-v5-omni-small D
Jina AI GmbH, a subsidiary of Elastic N.V. (per the jina-embeddings listing's 2 October 2026 check)
Lists encode in one call and truncate_dim gives Matryoshka sizes from 32 to 1,024, but there is no batch route or price beyond the hardware, and the non-commercial licence limits who may backfill with it. source
Mistral Embed and Codestral Embed B
Mistral AI (RCS Paris 952 418 325)
The Batch API accepts /v1/embeddings with custom_id, and codestral-embed takes output_dimension and output_dtype int8, uint8, binary or ubinary; mistral-embed has no output options, and rate limits are only in the admin panel. source
Nomic Embed E
Nomic, Inc.
dimensionality shortens nomic-embed-text-v1.5 to 64 to 768, but no public page prices the endpoint, there is no batch route or int8 or binary output, and the Python client sends at most 10 texts a request. source
NVIDIA NeMo Retriever Embedding and Reranking NIMs B
NVIDIA Corporation
Lists of inputs per call with dynamic batching, int8 and uint8 output, and free reduced dimensions from 128 to 2,048 on Nemotron 3.5, but no batch route or per-token price; cost is GPUs plus the per-GPU licence. source
OpenAI embeddings BB
OpenAI OpCo, LLC
Up to 2,048 inputs a request returned with index, and dimensions shortens text-embedding-3 vectors, but output is float or base64 only, and an account found text containing special-token strings failed text-embedding-3-small with HTTP 500. source
Qwen3-Embedding-0.6B B
Alibaba Cloud (the registrant of qwen.ai per RDAP, carried from the Qwen3.8-27B check)
Batches encode locally, but custom dimensions from 32 to 1024 are claimed without saying how to request them, there is no int8 or binary output, and no batch route or price beyond the hardware. source
Qwen3-Embedding-4B BB
Alibaba Cloud (named in the copyright line of the 8B sibling's Apache 2.0 licence; this repository has no LICENSE file)
Batches encode locally, but custom dimensions from 32 to 2560 are claimed without saying how to request them, there is no int8 or binary output, and no batch route or price beyond the hardware. source
Qwen3-Embedding-8B BB
Alibaba Cloud (named in the licence's copyright line)
Batches encode locally, but custom dimensions up to 4,096 are claimed without instructions, an account found LM Studio ignored the dimensions parameter and returned 4,096 values, and there is no int8 or binary output. source
Qwen3-VL-Embedding-2B C
Alibaba Cloud (RDAP names Alibaba Cloud (Singapore) Private Limited as the registrant of qwen.ai)
Batches encode locally and custom dimensions from 64 to 2048 and output quantisation are marked supported, but the card doesn't say how to request either, and there is no batch route or price beyond the hardware. source
Qwen3-VL-Embedding-8B B
Alibaba Group (Tongyi Lab, named in the copyright line of the GitHub repository's Apache 2.0 licence)
Batches encode locally and custom dimensions from 64 to 4096 and output quantisation are marked supported, but the card doesn't say how to request either, and there is no batch route or price beyond the hardware. source
ZeroEntropy zerank and zembed F
ZeroEntropy, Inc.
No hosted batch route remains. The zembed-1 card claims dimensions from 40 to 2,560 and quantisation to binary but doesn't show the parameter, and self-hosting has no published price. source

What stops agents finishing

  • SDK merges batches wrongly (Cohere dropped int8 vectors; Gemini returned one vector for N inputs)
  • dimensions parameter ignored by the serving route, so every vector is full size
  • small per-call caps (Cohere 96 inputs, Nomic client 10 texts) with rate limits only visible in a dashboard
  • special-token strings in the text fail the whole request

Around it

Before: document-extraction.pdf-to-text, data.export-table. After: vector-search.ingest-sync, embeddings.index-docs-for-rag.

Where this comes from

Weight 12 of 100 in Embeddings & rerankers: 11 of 62 accounts (91 account-use-case tags, accounts counted in each use case they fit, scaled to 100 and rounded by hand); GitHub issues on four SDKs are about batching, plus HN accounts of 49M-item and 250M-token jobs

The same as data: /api/v1/use-cases/embeddings.bulk-backfill.json, or the MCP tool get_use_case with id embeddings.bulk-backfill. Other jobs in this category: /api/v1/niches?category=embeddings.

Draft, read 2026-11-15 from public docs and first-hand accounts, not yet reviewed by a person. A mark says what the docs show, not what a run measured.

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.