Take the tuned weights out and serve them elsewhere
No company's docs show a full fit yet. The listings below do the job with a limit, or not at all.
What counts as done
The adapter and a merged checkpoint can be downloaded in a documented format (safetensors, PEFT, GGUF) under a stated licence, and the docs show the export loading in at least one named runtime, including for vision and MoE models.
How agents ask for it: export my fine-tune to GGUF
, load my LoRA in vLLM
, run my tuned model in Ollama
, download the weights
Does the job, with a limit 6
It does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.
| Listing | Why |
|---|---|
| Axolotl B Axolotl AI | axolotl merge-lora then axolotl export writes f16 and llama.cpp quantised GGUF files, with preflight checks, but it needs a separately built llama.cpp and refuses pre-quantised checkpoints; licence is the base model's. source |
| Fireworks AI Fine-tuning B Fireworks.ai, Inc. | firectl model download writes a model to a local directory, but the reference states no format or licence and no page read shows the export loading in a named runtime. source |
| Nebius Token Factory fine-tuning D Nebius B.V. | Every checkpoint's result_files can be downloaded, the models page states each base model's licence, and a guide merges MoE LoRA weights; but no page read names the file format or shows it loading in vLLM or llama.cpp. source |
| Tinker D Thinking Machines Labs, Inc. | save_weights_external and weights.download fetch trained weights, but the README names no file format, licence or runtime that loads the export. source |
| Together AI Fine-tuning C Together Computer, Inc. | Download merged, adapter or raw output as a .tar.zst by job ID or step, but the example archive shows pytorch_model.bin, and no page read shows the export loading in a named runtime such as vLLM or llama.cpp. source |
| Unsloth C Unsloth | save_pretrained_merged writes merged 16-bit or LoRA files, GGUF export and a vLLM guide are documented, but acc-14 and acc-15 hit GGUF conversion failures, acc-16 and acc-17 vLLM refusing tuned models, and acc-18 undocumented MoE LoRA packing. source |
Doesn't do this job 3
Listings in the category that do something else, with the reason.
| Listing | Why |
|---|---|
| Amazon Bedrock model customisation A Amazon Web Services, Inc. | Custom models are served inside Bedrock through on-demand deployments or Provisioned Throughput; no weight download appears in the customisation pages read. source |
| Microsoft Foundry fine-tuning (Azure OpenAI) C Microsoft Corporation | The pages read deploy tuned models to Serverless, Managed Compute or Fireworks on Foundry; job result_files carry a metrics CSV, and no weight download is offered. source |
| Vertex AI Gemini tuning B Google LLC | Tuned Gemini models exist as endpoints, with adapters stored by Google; no weight download is offered for Gemini tunes. source |
What stops agents finishing
- GGUF conversion fails inside the vendor's own image
- vLLM cannot load the saved vision or MoE checkpoint
- hosted service keeps the weights
Around it
Before: fine-tuning.local-lora, fine-tuning.managed-job. After: local-ai.private-offline-run, gpu-compute.serverless-model-endpoint, open-weights.local-coding-agent.
Where this comes from
Weight 12 of 100 in Fine-tuning: 6 of 47 accounts: five Unsloth issues on GGUF conversion, vLLM loading of vision tunes and MoE-LoRA layouts, plus a Together integration that serves and registers the result
The same as data: /api/v1/use-cases/fine-tuning.export-and-serve.json, or the MCP tool get_use_case with id fine-tuning.export-and-serve. Other jobs in this category: /api/v1/niches?category=fine-tuning.
For companies
Do agents find, use and choose your tools?
An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.