Keep a rarely used tuned model callable without paying for idle time
No company's docs show a full fit yet. The listings below do the job with a limit, or not at all.
What counts as done
The docs state the hourly hosting fee, storage fee and idle-deletion rule for a tuned model, and either offer per-token serving with no idle charge or a deploy that can be scripted and is ready within a stated time.
How agents ask for it: what does it cost to keep my fine-tune deployed
, serve my LoRA per token
, can I undeploy it when it's not in use
Does the job, with a limit 6
It does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.
| Listing | Why |
|---|---|
| Amazon Bedrock model customisation A Amazon Web Services, Inc. | On-demand deployment bills only for use and is created by API with a client request token, but it covers four Nova models and Llama 3.3 70B; acc-25 found imported models keep billing storage after clean-up. source |
| Microsoft Foundry fine-tuning (Azure OpenAI) C Microsoft Corporation | The cost guide states the hourly hosting fee (720 hours a month in its example) and that Developer deployments vanish after 24 hours, but no idle-free per-token option lasts, and acc-26 and acc-27 found no pause and minutes-long redeploys. source |
| Fireworks AI Fine-tuning B Fireworks.ai, Inc. | Serverless LoRA has no deployment to pay for and loads in under five minutes, but only for GLM 5.3 Flash; every other tuned model goes to on-demand GPUs billed by the hour. source |
| Nebius Token Factory fine-tuning D Nebius B.V. | Tuned models run only on dedicated endpoints, which bill while replicas are ready; the hosting price sits in a console page robots.txt disallows, so the docs state no hourly fee or idle rule. source |
| Together AI Fine-tuning C Together Computer, Inc. | The docs state that dedicated inference bills per minute per running replica even when idle and that scaling to zero stops billing, but no per-token serving exists for tuned models and no time to scale back up was found. source |
| Vertex AI Gemini tuning B Google LLC | Tuned endpoints bill per prediction token with no hosting fee on the pricing page, but neither page read states a storage fee or whether idle tuned endpoints are deleted. source |
Couldn't check 1
The docs were closed to us, or silent. These carry no mark either way.
| Listing | Why |
|---|---|
| Tinker D Thinking Machines Labs, Inc. | Sampling and checkpoint storage prices are on the docs site, which was not read because the Service Terms bar automated scraping of the documentation. |
What stops agents finishing
- hourly hosting fee charged whether or not the model is called
- deployment deleted after an idle period
- redeploy takes minutes, too slow for on-demand use
Around it
Before: fine-tuning.managed-job. After: inference.tool-loop.
Where this comes from
Weight 12 of 100 in Fine-tuning: 6 of 47 accounts: two Microsoft Q&A threads on Azure hosting fees, a Bedrock imported-model storage issue, a Tinker user for whom the economics failed, and two Together users citing serverless LoRA at the base price
The same as data: /api/v1/use-cases/fine-tuning.idle-serving-cost.json, or the MCP tool get_use_case with id fine-tuning.idle-serving-cost. Other jobs in this category: /api/v1/niches?category=fine-tuning.
For companies
Do agents find, use and choose your tools?
An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.