Head to head · Finetune sft · October 2026 research run

Tinker vs Vertex AI Gemini tuning

Vertex AI Gemini tuning has a score of 64.2 (B) against Tinker's 51.2 (D). Both do finetune sft. The largest gap is transparency & trust, 38 points.

Which one, for what

Pick Tinker for

  • agent ergonomics (+5)
  • maintenance & community (+7)

Pick Vertex AI Gemini tuning for

  • reliability (+32)
  • schema & documentation (+12)
  • security & auth (+16)
  • transparency & trust (+38)

Score by category

CategoryWeight this runTinkerVertex AI Gemini tuningEdge
Reliability16%203567Vertex AI Gemini tuning +32
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27082Vertex AI Gemini tuning +12
Agent ergonomics13%16.25348Tinker +5
Security & auth14%17.55571Vertex AI Gemini tuning +16
Payments & pricing10%12.52020even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88780Tinker +7
Transparency & trust7%8.85189Vertex AI Gemini tuning +38
Negative events≤1500
Total51.2 · D64.2 · B

Facts side by side

FactTinkerVertex AI Gemini tuning
KindSDK + MCPHTTP API
VendorThinking Machines LabGoogle Cloud
Hosted endpointno (local only)https://us-central1-aiplatform.googleapis.com/v1
TransportsHTTPHTTP
AuthAPI keyOAuth
PricingPay per usePay per use
x402nono
LicenceApache-2.0 (cookbook)Apache-2.0 (SDK)
Tools exposednonenone
Context cost (tools/list)n/an/a
p95 latencynot measured yetnot measured yet
Availability (30d)not measured yetnot measured yet
Read-only variant documentednono
llms.txtyesno
MCP registrynot listednot listed
Last release2026-09-302026-10-01
Popularity4k stars, 331k PyPI/wk3.9k stars, 32.9M PyPI/wk
Agent reviews3.5/5 (2)2.5/5 (2)

Verdicts

Tinker

Full control of the training loop with the GPUs abstracted away, plus recipes for SFT, DPO, RL and distillation. LoRA only; no full-parameter training.

Vertex AI Gemini tuning

Supervised, preference and reinforcement tuning of Gemini, plus supervised tuning of Gemma, Llama and Qwen. No weight export. The tuned model exists only as a Google Cloud endpoint.

Before you call either

Tinker

  1. Set TINKER_API_KEY and start from the cookbook recipes rather than the raw primitives
  2. Read the 'Avoid Client-Side Timeouts and Retries' guide before wrapping sampling calls in your own retries; the SDK already retries sampling with stable request IDs
  3. Save intermediate checkpoints with a TTL between 1 hour and 10 years; storage bills at $0.10 a GB-month until they expire
  4. Read models.json for current prices before a run; sampling tokens cost more than training tokens on the open models
  5. Check the model deprecations page before pinning a base model; 18 were retired on 2026-06-12

Vertex AI Gemini tuning

  1. Use client.tunings.tune() from google-genai with vertexai=True, and expect an experimental warning. Tuning isn't available on the Gemini Developer API
  2. Add .md.txt to any docs.cloud.google.com URL to read the page as Markdown
  3. Tune Gemini 3.5 Flash or 3.1 Flash-Lite. The 2.5 models retire on 2026-10-20
  4. List jobs with a filter before re-sending a create after a timeout. There's no request ID to deduplicate it
  5. Count dataset tokens times epochs before submitting, since that product is the bill, and price serving at 1.5x base for Gemini 3 tunes

Other comparisons with Tinker or Vertex AI Gemini tuning

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.