Replace an expensive model call with a small tuned model
No company's docs show a full fit yet. The listings below do the job with a limit, or not at all.
What counts as done
Teacher outputs or traces can be turned into a training set in the documented format, the tuned small model is served at a published per-token price below the model it replaces, and the docs show how to evaluate it against the teacher on held-out cases before switching.
How agents ask for it: make a cheaper model that does this step as well
, distil our judge into a small model
, train a small model on GPT outputs for this task
Does the job, with a limit 7
It does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.
| Listing | Why |
|---|---|
| Amazon Bedrock model customisation A Amazon Web Services, Inc. | Distillation generates teacher responses from your prompts and tunes the student, and on-demand serving bills per use, but only Nova models and Llama 3.3 70B deploy on demand, each in one Region; others need Provisioned Throughput. source |
| Microsoft Foundry fine-tuning (Azure OpenAI) C Microsoft Corporation | Distillation is documented as SFT on teacher-generated data, but Standard and Global Standard serving add an hourly hosting fee to base-model token rates, and fee-free Developer deployments are removed after 24 hours. source |
| Fireworks AI Fine-tuning B Fireworks.ai, Inc. | A distillation cookbook exists and serverless LoRA serves adapters per token at the base price, but only on GLM 5.3 Flash with three adapters per account; adapters on other bases need an on-demand deployment. source |
| Nebius Token Factory fine-tuning D Nebius B.V. | SFT on chat JSONL suits teacher traces and acc-02 plans precisely this, but tuned models deploy only to dedicated endpoints (custom weights in beta on request) and no per-token price for a tuned model is published. source |
| Tinker D Thinking Machines Labs, Inc. | Cookbook recipes cover on- and off-policy distillation, but per-token serving prices and an evaluation-against-teacher guide sit in the docs, which were not read this time. source |
| Together AI Fine-tuning C Together Computer, Inc. | Conversational JSONL with loss on assistant turns fits teacher traces, but tuned models are served on dedicated endpoints billed per minute even when idle; acc-19 and acc-45 describe serverless LoRA the current docs no longer offer. source |
| Vertex AI Gemini tuning B Google LLC | SFT on Flash-Lite from teacher outputs is served per token at the base price in the global region (1.5 times elsewhere for Gemini 3), below a Pro teacher, but no guide to evaluating the student against the teacher was found. source |
Doesn't do this job 2
Listings in the category that do something else, with the reason.
| Listing | Why |
|---|---|
| Axolotl B Axolotl AI | Trains a student from chat datasets, but serves nothing, so the per-token price and side-by-side switch the success needs lie outside the tool. source |
| Unsloth C Unsloth | It can train a student on teacher traces, but it serves nothing, so the per-token price and swap-over the success needs lie outside the tool. source |
What stops agents finishing
- tuned model served only on a dedicated endpoint, so it costs more than the call it replaces
- traces need cleaning the service does not do
Around it
Before: agent-observability.coding-agent-sessions, agent-observability.offline-eval-regression. After: inference.fast-small-calls, open-weights.sub-task-cousin.
Where this comes from
Weight 12 of 100 in Fine-tuning: 6 of 47 accounts: an agent picking and tuning a replacement model, a judge distilled on Token Factory, a Fireworks tune for consistent output, an email sorter, a forum design for a trace-trained coding adapter and one vendor benchmark
The same as data: /api/v1/use-cases/fine-tuning.distil-to-small.json, or the MCP tool get_use_case with id fine-tuning.distil-to-small. Other jobs in this category: /api/v1/niches?category=fine-tuning.
For companies
Do agents find, use and choose your tools?
An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.