{
  "data": null,
  "kind": "anchor.page",
  "links": {
    "api": "https://www.anchorterminal.com/api/v1/index.json",
    "html": "https://www.anchorterminal.com/niches/fine-tuning.export-and-serve/",
    "json": "https://www.anchorterminal.com/niches/fine-tuning.export-and-serve/index.json",
    "llms": "https://www.anchorterminal.com/llms.txt",
    "markdown": "https://www.anchorterminal.com/niches/fine-tuning.export-and-serve/index.md",
    "mcp": "https://www.anchorterminal.com/mcp",
    "slim": "https://www.anchorterminal.com/niches/fine-tuning.export-and-serve/index.min.md"
  },
  "markdown": "No company's docs show a full fit yet. The listings below do the job with a limit, or not at all.\n\n| Companies, full fit | With a limit | Carry the tag | Share of the category's work | First-hand accounts |\n| --- | --- | --- | --- | --- |\n| 0 | 6 | 10 | 12 | 6 |\n\n## What counts as done\n\nThe adapter and a merged checkpoint can be downloaded in a documented format (safetensors, PEFT, GGUF) under a stated licence, and the docs show the export loading in at least one named runtime, including for vision and MoE models.\n\nHow agents ask for it: export my fine-tune to GGUF; load my LoRA in vLLM; run my tuned model in Ollama; download the weights\n\n## Does the job, with a limit\n\nIt does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.\n\n- **Axolotl (Axolotl AI)**: axolotl merge-lora then axolotl export writes f16 and llama.cpp quantised GGUF files, with preflight checks, but it needs a separately built llama.cpp and refuses pre-quantised checkpoints; licence is the base model's.\n- **Fireworks AI Fine-tuning (Fireworks.ai, Inc.)**: firectl model download writes a model to a local directory, but the reference states no format or licence and no page read shows the export loading in a named runtime.\n- **Nebius Token Factory fine-tuning (Nebius B.V.)**: Every checkpoint's result_files can be downloaded, the models page states each base model's licence, and a guide merges MoE LoRA weights; but no page read names the file format or shows it loading in vLLM or llama.cpp.\n- **Tinker (Thinking Machines Labs, Inc.)**: save_weights_external and weights.download fetch trained weights, but the README names no file format, licence or runtime that loads the export.\n- **Together AI Fine-tuning (Together Computer, Inc.)**: Download merged, adapter or raw output as a .tar.zst by job ID or step, but the example archive shows pytorch_model.bin, and no page read shows the export loading in a named runtime such as vLLM or llama.cpp.\n- **Unsloth (Unsloth)**: save_pretrained_merged writes merged 16-bit or LoRA files, GGUF export and a vLLM guide are documented, but acc-14 and acc-15 hit GGUF conversion failures, acc-16 and acc-17 vLLM refusing tuned models, and acc-18 undocumented MoE LoRA packing.\n\n- not this job: Amazon Bedrock model customisation (Amazon Web Services, Inc.): Custom models are served inside Bedrock through on-demand deployments or Provisioned Throughput; no weight download appears in the customisation pages read.\n- not this job: Microsoft Foundry fine-tuning (Azure OpenAI) (Microsoft Corporation): The pages read deploy tuned models to Serverless, Managed Compute or Fireworks on Foundry; job result_files carry a metrics CSV, and no weight download is offered.\n- not this job: Vertex AI Gemini tuning (Google LLC): Tuned Gemini models exist as endpoints, with adapters stored by Google; no weight download is offered for Gemini tunes.\n\n## What stops agents finishing\n\n- GGUF conversion fails inside the vendor's own image\n- vLLM cannot load the saved vision or MoE checkpoint\n- hosted service keeps the weights\n\n## Around it\n\nBefore: fine-tuning.local-lora, fine-tuning.managed-job. After: local-ai.private-offline-run, gpu-compute.serverless-model-endpoint, open-weights.local-coding-agent.\n\n## Where this comes from\n\nWeight 12 of 100 in Fine-tuning: 6 of 47 accounts: five Unsloth issues on GGUF conversion, vLLM loading of vision tunes and MoE-LoRA layouts, plus a Together integration that serves and registers the result\n\nAs data: https://www.anchorterminal.com/api/v1/use-cases/fine-tuning.export-and-serve.json, or the MCP tool get_use_case with id fine-tuning.export-and-serve. Draft, read 2026-11-15 from public docs and first-hand accounts, not yet reviewed by a person.\n",
  "meta": {
    "attribution": "Anchor Terminal (https://www.anchorterminal.com)",
    "attributionRequired": true,
    "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)",
    "docs": "https://www.anchorterminal.com/docs/",
    "generatedAt": "2026-11-16",
    "license": "CC-BY-4.0",
    "method": "https://www.anchorterminal.com/benchmark/",
    "methodology": "0.8",
    "openapi": "https://www.anchorterminal.com/openapi.json",
    "preview": false,
    "run": "2026-10-01",
    "runLabel": "October 2026 research run",
    "terms": "https://www.anchorterminal.com/terms/#data"
  },
  "page": {
    "breadcrumbs": [
      {
        "name": "Home",
        "url": "https://www.anchorterminal.com/"
      },
      {
        "name": "For agents",
        "url": "https://www.anchorterminal.com/agents/"
      },
      {
        "name": "Niches",
        "url": "https://www.anchorterminal.com/niches/"
      },
      {
        "name": "Take the tuned weights out and serve them elsewhere",
        "url": ""
      }
    ],
    "description": "Take the tuned weights out and serve them elsewhere: 0 companies fully do it, 6 with a limit, 10 carry the tag. Every listing in Fine-tuning with the reason and a source.",
    "facts": null,
    "h1": "Take the tuned weights out and serve them elsewhere",
    "image": "https://www.anchorterminal.com/assets/og/default.png",
    "path": "/niches/fine-tuning.export-and-serve/",
    "published": "",
    "section": "agents",
    "title": "Take the tuned weights out and serve them elsewhere | Anchor Terminal",
    "toc": null,
    "updated": "2026-11-15",
    "url": "https://www.anchorterminal.com/niches/fine-tuning.export-and-serve/"
  },
  "tokens": {
    "markdown": 1100,
    "slim": 280
  },
  "version": 1
}
