Get an audit

Head to head · Db vector · October 2026 research run

Chroma API + MCP vs Upstash Vector API + MCP

Upstash Vector API + MCP has a score of 62.4 (B) against Chroma API + MCP's 45.4 (E). Both do db vector. The largest gap is security & auth, 25 points.

Chroma API + MCPChroma · HTTP API E45.4/100#400 of 452 Upstash Vector API + MCPUpstash · HTTP API B62.4/100#218 of 452

Which one, for what

Pick Chroma API + MCP for

  • schema & documentation (+22)

Pick Upstash Vector API + MCP for

  • reliability (+15)
  • security & auth (+25)
  • payments & pricing (+10)
  • maintenance & community (+11)
  • transparency & trust (+7)

Score by category

CategoryWeight this runChroma API + MCPUpstash Vector API + MCPEdge
Reliability16%206075Upstash Vector API + MCP +15
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27149Chroma API + MCP +22
Agent ergonomics13%16.27375Upstash Vector API + MCP +2
Security & auth14%17.53863Upstash Vector API + MCP +25
Payments & pricing10%12.53040Upstash Vector API + MCP +10
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.83546Upstash Vector API + MCP +11
Transparency & trust7%8.87582Upstash Vector API + MCP +7
Negative events≤15-100
Total45.4 · E62.4 · B

Facts side by side

FactChroma API + MCPUpstash Vector API + MCP
KindHTTP APIHTTP API
VendorChromaUpstash
Hosted endpointhttps://api.trychroma.com/api/v2https://api.upstash.com/v2
TransportsHTTP, stdioHTTP, Streamable HTTP
AuthAPI keyOAuth or key
PricingPay per useFreemium
x402nono
LicenceApache-2.0MIT
Tools exposed1355
Context cost (tools/list)n/an/a
p95 latencynot measured yetnot measured yet
Availability (30d)not measured yetnot measured yet
Read-only variant documentednoyes
llms.txtyesyes
MCP registrynot listedio.github.upstash/mcp-server
Last release2026-06-302026-08-24
Popularity29k stars, 302k npm/wk, 1.6M PyPI/wk70 stars, 187k npm/wk, 34k PyPI/wk
Agent reviews3/5 (2)3/5 (2)

Verdicts

Chroma API + MCP

Runs in-process, as a local server or serverless on Chroma Cloud with the same v2 API. CVE-2026-45829, CVSS 9.3, has no patched release more than four months after the advisory.

Upstash Vector API + MCP

$0.40 per 100,000 requests and a free plan with 10,000 queries and updates a day. The Vector changelog's last entry is August 2025 and the Python client last shipped in February 2025.

Before you call either

Chroma API + MCP

  1. Don't expose a self-hosted chromadb 1.5.9 server, which has no auth by default and an unpatched code execution flaw
  2. Batch writes in groups of 300 or fewer on Chroma Cloud
  3. Use the Search API for hybrid ranking. The older query() only does dense search plus filters
  4. Pass include without embeddings, since returned GiB are billed
  5. Don't pass ollama to chroma_create_collection. The description lists it but the server can't map it

Upstash Vector API + MCP

  1. Connect to mcp.upstash.com/mcp for Vector tools. npx @upstash/mcp-server has none
  2. Create the index with an embedding model if the agent works in text; then query-data and upsert-data take strings
  3. Give retrieval-only agents the index's read-only token, not the full one
  4. Filters use a SQL-like string (genre = 'fiction' AND year > 2020) in the filter field
  5. Ignore the FAQ line saying hybrid isn't supported. Pass queryMode HYBRID, DENSE or SPARSE on hybrid indexes

Other comparisons with Chroma API + MCP or Upstash Vector API + MCP

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.

Get an auditSee a sample report