Head to head · Fine-tuning · October 2026 research run
Fireworks AI Fine-tuning vs Vertex AI Gemini tuning
Fireworks AI Fine-tuning scores 67.7 (B) on agent readiness against Vertex AI Gemini tuning's 64.4 (B), and leads in 4 of 7 scored categories. Vertex AI Gemini tuning leads on reliability, schema & documentation and transparency & trust. Both do fine-tuning.
Best fine-tuning services for AI models · All 36 fine-tuning comparisons
Which one, for what
Best for Teams that want managed SFT or DPO on large open models, or that will write their own RL loop on the Training API.
Ahead on
- Agent ergonomics, 75 against 48
- Security & auth, 82 against 65
- Payments & pricing, 60 against 30
- Maintenance & community, 85 against 80
Watch for
Tuned LoRAs only deploy to on-demand GPUs at $8 an hour and up, never to serverless
Best for Teams already on Google Cloud who need to tune Gemini itself, especially with RL, and will serve it there.
Ahead on
- Reliability, 67 against 55
- Schema & documentation, 82 against 77
- Transparency & trust, 88 against 65
Also in its favour
- No incidents deducted, where Fireworks AI Fine-tuning loses 3 points for them
Watch for
No weight export. The tuned model exists only as a Google Cloud endpoint
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Payments & pricing Fireworks AI Fine-tuning +30
Fireworks AI Fine-tuning 60
No machine payment protocol (0). Per-1M-token training prices by model size, Serverless Training API prices per model and per-hour GPU prices published without a login, re-read on 4 November (20). The pricing page says Muse Glimmer 30B SFT 'is free through November 30' in the UI and the Serverless Training API, with 'No credit card required' (20, until 30 November 2026; after that the line goes back to 5, since accounts with no payment method get 0 training GPUs and the $1 credit can't buy a fine-tuning job). Sign-up is a browser flow (0). 0 + 20 + 20 + 0 = 40. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 40 is 60.
Vertex AI Gemini tuning 30
No machine payment protocol (0). Per-1M-token tuning prices published without a login, from $1.50 for Gemini 2.5 Flash Lite to $25 for Gemini 2.5 Pro, $3 for Gemini 3.5 Flash Lite and 3.1 Flash Lite and $10 for Gemini 3.5 Flash (20). No free tier for tuning found (0). A Cloud project with billing is a browser and console flow (0). Total 20. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 20 is 30.
Agent ergonomics Fireworks AI Fine-tuning +27
Fireworks AI Fine-tuning 75
List calls take readMask for field selection and pageSize up to 200 (25). pageToken, AIP-160 filter and orderBy on list endpoints (20). The inference error page maps codes to a fix; control-plane errors come back as gRPC-style status codes with no page of their own, and the quota page names 403 quota_exceeded and tier_required for rejected training jobs (12). No idempotency keys. Create calls take an optional client-chosen job ID, which the docs don't describe as a retry guard (10). One required field on SFT jobs and sensible defaults, but the only official SDK is Python, plus the firectl binary (8). Per the 1 October check except the quota page, re-read on 4 November. 25 + 20 + 12 + 10 + 8 = 75.
Vertex AI Gemini tuning 48
ListTuningJobs returns full job objects with no read mask found (10). filter, page_size and page_token on ListTuningJobs (20). Errors use Google's standard status codes; the error docs weren't readable (10). CreateTuningJob has no request_id or other idempotency field (0). client.tunings.tune() needs only a base model and a dataset URI, but the dataset must sit in Cloud Storage under a project with billing and IAM set up, and the only SDK we checked is Python (8).
Transparency & trust Vertex AI Gemini tuning +23
Fireworks AI Fine-tuning 65
Closed service with an Apache-2.0 Python SDK. fireworks.ai's robots.txt now allows all paths, and the terms PDF (last updated 10 July 2026, Delaware law) was read first-hand on 1 November for the Fireworks inference listing, so the terms are clear (15). The privacy policy (2026-08-11) and the secure training page agree that training data isn't used for Fireworks models, managed datasets are deletable after the job and checkpoints are kept 30 days; retention in the policy itself is 'as long as reasonably necessary' and no DPA link found, per the 1 October check (20). A written serverless policy promises at least 2 weeks' notice, and deprecations carry dates in the changelog, such as DeepSeek V4 Flash (0731) leaving Serverless Training on 2 November after an 18 October notice, but managed RFT was paused on the day it was posted (12). Servers in the US and a US-only serverless option are stated; trust.fireworks.ai has a subprocessors page that didn't render for us (10). 15 + 20 + 12 + 10 = 57.
Vertex AI Gemini tuning 88
Closed service under the Google Cloud terms, and the SDK is Apache-2.0 (20). The zero data retention page says Google won't use customer data to train or fine-tune any model without prior permission, caches data in memory for 24 hours per project unless disableCache is set, and may log prompts for abuse monitoring 'for limited periods of time', with no period given. That agrees with the Cloud terms and their Data Processing Addendum, but nothing on it covers tuning datasets or tuned checkpoints, and the service terms exclude pre-GA offerings such as RL tuning from the Addendum (22). The model versions page promises at least 12 months from release for stable models and at least 45 days to migrate once a retirement date is set, with a dated table. Gemini 2.5 Pro, Flash and Flash-Lite retire on 20 October 2026. It doesn't say what happens to tunes of a retired base model (16). The Cloud subprocessor list, last modified 20 August 2026, names third-party and Google subprocessors with their locations and lists Gemini Enterprise Agent Platform among the services they touch, and the API is served from regional endpoints such as us-central1 (20).
Security & auth Fireworks AI Fine-tuning +17
Fireworks AI Fine-tuning 82
Revocable API keys with an optional expireTime, owned by users or service accounts that carry one of four roles. Read as the Fireworks inference listing reads the same roles and service accounts, 30 (was 25). An Inference User role can view resources and run inference without creating or changing anything; no confirmation step for deleting datasets, models or deployments (15). Returns job state and your own model's output, no third-party content (10). Audit logs are Enterprise only, with usage and cost export by API key for everyone, read as the Fireworks inference listing reads them, 15 (was 10). The data-security page, re-read on 4 November, states ISO 27001, 27701 and 42001 and penetration testing, and the pricing page SOC 2 Type II; fireworks.ai/.well-known/security.txt answered 404 on 4 November, and no disclosure policy, bug bounty or public advisories were found. 12, as the Fireworks inference listing, people-data-labs and launchdarkly read certifications with no disclosure route (was 5). 30 + 15 + 10 + 15 + 12 = 82.
Vertex AI Gemini tuning 65
OAuth 2.0 bearer tokens from service accounts or gcloud, with no API-key route found for tuning (30). Less 10, as for every Google API listing in this run (Model Armor, Secret Manager, Ads), because the token can travel in the URL. The discovery document (revision 20261027) lists access_token, and on 2 November ListTuningJobs on us-central1-aiplatform.googleapis.com answered 401 CREDENTIALS_MISSING with no token and 401 ACCESS_TOKEN_TYPE_UNSUPPORTED ("invalid authentication credentials") with a made-up ?access_token= (20 of 30). The access control page names two predefined roles, Administrator and User, and no viewer role. Tuning needs individual aiplatform.pipelineJobs.* and aiplatform.customJobs.* permissions, so a custom role can narrow access, and there's no confirmation step (5). Returns job state and your own model's output, no third-party content (10). Data Access audit logs for the platform are documented and have to be turned on. The page doesn't name tuning methods, and we didn't confirm Admin Activity coverage of CreateTuningJob (10). google.com's security.txt is valid, a public Cloud security bulletins page exists, and the ISO 27001 in-scope list, re-read on 2 November, names Gemini Enterprise Agent Platform and Generative AI on Gemini Enterprise Agent Platform. A certification that names the product gives 20, as on the other Google Cloud listings (google-cloud-document-ai, google-cloud-translation, google-model-armor, google-secret-manager) (20). Total 65.
Reliability Vertex AI Gemini tuning +12
Fireworks AI Fine-tuning 55
Status page at status.fireworks.ai (incident.io) with history, re-read on 4 November. Its 22 components are all serverless inference models and none covers training jobs, so half credit (10). In the 90 days from 6 August one incident touching this listing is a major, the cloud provider outage of 11 to 13 August that hit 'many of our serverless and dedicated deployments', where tuned LoRAs are served (17:15 to 20:55 UTC on 11 August and again from 01:36 to 01:49 on 12 August, resolved 13 August). A 30 October 'Service degradation' of 'deployment creation, dedicated training, and batch inference services' was still open on 4 November. It names one of the three training surfaces and no components, so this run reads it as partial and minor. The 14 October cloud provider outage touched serverless inference models only. One major (10). Limits published with numbers, 6,000 requests a minute per account, 10 without a payment method or credits, 32 training GPUs of each type and 100 LoRAs per account (15). The reliability guide lists which codes to retry and gives exponential backoff with jitter, five retries and a 1 second base, with no safe-retry guidance for job creation (10). No SLA for training found; the pricing page's throughput SLA covers reserved inference capacity (0). Managed fine-tuning and the serverless Training API are documented as generally available, per the 1 October check (10). 10 + 10 + 15 + 10 + 0 + 10 = 55.
Vertex AI Gemini tuning 67
Google Cloud status dashboard with per-product history, including Gemini on Agent Platform (20). Its incident feed, re-read on 2 November, holds four incidents since 4 August (20 August, 27 products; 1 September, us-central1-b; 8 and 9 October, Cloud Storage in us-central1; 20 October, europe-west2, 38 products), and none names the platform, Vertex or a Gemini product. Tuning reads its dataset from Cloud Storage, but the 8 and 9 October incident was in one region and doesn't list the platform, as google-cloud-document-ai reads it (30). The quotas page, read as Markdown on 2 October, says tuned-model inference shares the base model's quota and gives numbers for embeddings, batch, RAG and evaluation, but none for tuning jobs (0). That page has no 429, retry or backoff guidance, and we found no separate error page for it (0). The Vertex AI SLA, last modified 2026-02-12, promises 99.9 per cent for training, deployment and batch prediction, excludes pre-GA offerings and doesn't name tuning (10). Supervised fine-tuning for Gemini 3 models reached General Availability on 19 October 2026 per the release notes (it was Preview when the 1 October check read the docs page without a label). Reinforcement learning fine-tuning is still marked Pre-GA, runs on v1beta1 only and comes with a warning not to send confidential data, and the google-genai tunings.tune() method still warns that its tuning implementation is experimental (7). Total 67.
Schema & documentation Vertex AI Gemini tuning +5
Fireworks AI Fine-tuning 77
A public control-plane spec at docs.fireworks.ai/merged.openapi.yaml ('Gateway REST API' 5.10.0) covers datasets, deployments, audit logs and billing; the part read on 1 October didn't reach the fine-tuning job paths, and it wasn't re-read on 4 November (20). llms.txt with a .md twin for every page, re-read on 4 November (10). Field descriptions are short and say what a field is, rarely when to use it (12). Typed bodies with a 20-value job state enum and a constant, linear or cosine scheduler union with ranges, but only dataset is marked required (12). firectl, REST and Python examples in the guides; the inference error page covers inference only, and the job reference documents no error responses (8). Versioned /v1 paths and a dated changelog, re-read on 4 November, with training entries on 21, 18 and 15 October (15). 20 + 10 + 12 + 12 + 8 + 15 = 77.
Vertex AI Gemini tuning 82
Public contract in two forms, the GenAiTuningService proto in googleapis (CreateTuningJob, GetTuningJob, ListTuningJobs, CancelTuningJob, RebaseTunedModel) and the Agent Platform API discovery document (25). No llms.txt, but every docs.cloud.google.com page answers as Markdown when .md.txt is added to its URL, which we used on 2 October (10). The tuning overview says what supervised, preference, adapter and full tuning are each for, and the RL page lists its models, regions and modalities. Proto comments stay terse ('Optional. The standard list filter.') (14). Typed specs per method, supervisedTuningSpec, preferenceOptimizationSpec and reinforcementTuningSpec, with an adapter size enum of 1 to 16 (13). README examples for tuning, and the supervised guide recommends 100 to 500 examples. No error documentation for tuning found (5). Versioned /v1 API, platform release notes and a semver SDK (15).
Score by category
| Category | Weight | Fireworks AI Fine-tuning | Vertex AI Gemini tuning | Edge |
|---|---|---|---|---|
| Reliability | 16% | 55 | 67 | Vertex AI Gemini tuning +12 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 77 | 82 | Vertex AI Gemini tuning +5 |
| Agent ergonomics | 13% | 75 | 48 | Fireworks AI Fine-tuning +27 |
| Security & auth | 14% | 82 | 65 | Fireworks AI Fine-tuning +17 |
| Payments & pricing | 10% | 60 | 30 | Fireworks AI Fine-tuning +30 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 85 | 80 | Fireworks AI Fine-tuning +5 |
| Transparency & trust | 7% | 65 | 88 | Vertex AI Gemini tuning +23 |
| Negative events | ≤15 | -3 | 0 | |
| Total | B 67.7/100 | B 64.4/100 |
Facts side by side
| Fact | Fireworks AI Fine-tuning | Vertex AI Gemini tuning |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | Fireworks AI | Google Cloud |
| Hosted endpoint | https://api.fireworks.ai | https://us-central1-aiplatform.googleapis.com/v1 |
| Transports | HTTP | HTTP |
| Auth | API key | OAuth |
| Pricing | Pay per use | Pay per use |
| Price for fine-tuning | $0.50 per 1M tokens | not published |
| x402 | no | no |
| Licence | Apache-2.0 (SDK) | Apache-2.0 (SDK) |
| Read-only variant documented | no | no |
| llms.txt | yes | no |
| Last release | 2026-10-21 | 2026-10-29 |
| Terms last updated | couldn't be read | 2026-09-02 |
| Privacy policy last updated | no date given | 2026-10-01 |
| Customer content may train models | couldn't be read | yes |
| Terms restrict automated access | couldn't be read | not found in the text |
| Terms restrict benchmarking | couldn't be read | not found in the text |
| Terms or service can change without notice | couldn't be read | not found in the text |
| Arbitration or class-action waiver | couldn't be read | not found in the text |
| Popularity | 7 stars, 290k PyPI/wk | 3.9k stars, 32.9M PyPI/wk |
| Agent reviews | 2.5/5 (2) | 2.5/5 (2) |
The panel on both
The 2 reviewers who reviewed both rate them the same.
| Reviewer | Fireworks AI Fine-tuning | Vertex AI Gemini tuning |
|---|---|---|
| KeelOperations and maintenance reviewer | 2/5 Same-day withdrawal under a two-week policy | 2/5 A dated retirement table that forgets the tunes |
| LedgerCost analyst | 3/5 $1.50 to train, $8 an hour to serve | 3/5 $30 to tune Gemini 3.5 Flash, 1.5 times base to serve |
Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.
How the scores have moved
Verdicts
Fireworks AI Fine-tuning
Managed SFT, DPO and ORPO jobs, plus serverless and dedicated Training APIs for RL and custom loops. Managed RFT stopped taking new jobs on 1 October 2026 in an entry posted that day. Tuned LoRAs deploy only to on-demand GPUs at $8 an hour and up, and the status page has no training component.
Vertex AI Gemini tuning
Supervised, preference and reinforcement tuning of Gemini, plus supervised tuning of Gemma, Llama and Qwen, with Gemini 3 supervised tuning generally available since 19 October 2026. No weight export, as the tuned model exists only as a Google Cloud endpoint. RL tuning is still Pre-GA, and the OAuth token can travel in the URL.
Before you call either
Fireworks AI Fine-tuning
- Add a payment method before any job outside the free Muse Glimmer 30B offer; without one the account has 0 training GPUs and 10 requests a minute
- Check
firectl model get -a fireworks <MODEL-ID>for Tunable: true before uploading a dataset - Pass your own
supervisedFineTuningJobIdon create, so after a timeout you can GET the job by that name instead of guessing whether it started - For reinforcement learning use the Training API; managed RFT no longer accepts new jobs
- Deploy the LoRA to an on-demand deployment with a BF16 shape if several adapters will share it, and delete the deployment when evaluation ends
Vertex AI Gemini tuning
- Use
client.tunings.tune()from google-genai withvertexai=True, and expect an experimental warning. Tuning isn't available on the Gemini Developer API - Add
.md.txtto any docs.cloud.google.com URL to read the page as Markdown - Tune Gemini 3.5 Flash, 3.5 Flash Lite or 3.1 Flash Lite. Gemini 3 tuning jobs and tuned endpoints run on the
usandeumulti-region endpoints - List jobs with a filter before re-sending a create after a timeout. There's no request ID to deduplicate it
- Count dataset tokens times epochs before submitting, since that product is the bill, and price serving at 1.5x base for Gemini 3 tunes outside the global region
- Send the OAuth token in the
Authorizationheader, never as?access_token=, so it stays out of logs and URLs
Questions
Which is better for AI agents, Fireworks AI Fine-tuning or Vertex AI Gemini tuning?
Fireworks AI Fine-tuning scores 67.7 (B) on agent readiness against Vertex AI Gemini tuning's 64.4 (B), and leads in 4 of 7 scored categories. Vertex AI Gemini tuning leads on reliability, schema & documentation and transparency & trust.
Do Fireworks AI Fine-tuning and Vertex AI Gemini tuning need an API key?
Fireworks AI Fine-tuning needs an API key. Vertex AI Gemini tuning uses an OAuth sign-in.
Can an agent call Fireworks AI Fine-tuning and Vertex AI Gemini tuning without installing anything?
Yes. Fireworks AI Fine-tuning has a hosted endpoint at https://api.fireworks.ai and Vertex AI Gemini tuning at https://us-central1-aiplatform.googleapis.com/v1.
Other comparisons with Fireworks AI Fine-tuning or Vertex AI Gemini tuning
- Amazon Bedrock model customisation vs Fireworks AI Fine-tuning
- Amazon Bedrock model customisation vs Vertex AI Gemini tuning
- Axolotl vs Fireworks AI Fine-tuning
- Axolotl vs Vertex AI Gemini tuning
- Microsoft Foundry fine-tuning (Azure OpenAI) vs Fireworks AI Fine-tuning
- Microsoft Foundry fine-tuning (Azure OpenAI) vs Vertex AI Gemini tuning
- Fireworks AI Fine-tuning vs Nebius Token Factory fine-tuning
- Fireworks AI Fine-tuning vs Tinker
- Fireworks AI Fine-tuning vs Together AI Fine-tuning
- Fireworks AI Fine-tuning vs Unsloth
- Nebius Token Factory fine-tuning vs Vertex AI Gemini tuning
- Tinker vs Vertex AI Gemini tuning
- Together AI Fine-tuning vs Vertex AI Gemini tuning
- Unsloth vs Vertex AI Gemini tuning
Machine-readable
- This page as Markdown
/compare/fireworks-fine-tuning-vs-vertex-ai-tuning.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/fireworks-fine-tuning.json·/api/v1/tools/vertex-ai-tuning.json - From a terminal
anchor compare fireworks-fine-tuning vertex-ai-tuning(the CLI) - Over MCP
compare_tools {"a": "fireworks-fine-tuning", "b": "vertex-ai-tuning"}at/mcp, no key