Niches · Local AI

Text, speech, image and music models behind one local executable

One company's docs show a full fit.

1companies, full fit
4companies, fit with a limit
110companies carry the tag
2share of the category's work
3first-hand accounts

What counts as done

One executable serves a chat completion, a speech-to-text request and an image generation through documented routes, with the owner choosing which to load.

Measured, for our own tests: each returns within the time the vendor states. No docs we read state these figures, so they don't count against a listing here.

How agents ask for it: try a bit of everything locally, an AI radio station that writes, speaks and plays its own music, generate an image and a voice line from the same server

Does the job 1

The docs show it meets the test above, and nothing we read says otherwise.

ListingWhy
LocalAI B
Ettore Di Giacinto and the LocalAI team
One server with per-modality backends serves chat, audio-to-text, text-to-audio, image and video generation through OpenAI, Anthropic and ElevenLabs shaped routes, each backend pulled when a model needs it. source

Does the job, with a limit 4

It does the job, but something in the docs or a user's account will get in an agent's way. The limit is named in each row.

ListingWhy
Berth B
Trevin Tindall (T-Crypt on GitHub)
Lets llama.cpp, ComfyUI and others take turns on one card with a priority queue, which answers the shared-GPU blocker, but it serves no speech route of its own and ComfyUI's API is proxied, not unified. source
KoboldCpp B
LostRuins (Concedo)
One executable serves chat, /v1/audio/transcriptions, /v1/audio/speech, /v1/images/generations and music generation, each loaded by flag. --password covers text routes only; the help text says image endpoints are not secured. source
Lemonade B
Advanced Micro Devices, Inc.
One server does chat, /v1/audio/transcriptions, text-to-speech and image generation (omni collections and MCP tools). Images arrive through tool calls or MCP rather than a plain images route, and one GPU is shared. source
TextGen E
oobabooga
Chat, vision input and /v1/images/generations with a loaded image model are documented; speech routes are not in the API doc. source

Couldn't check 1

The docs were closed to us, or silent. These carry no mark either way.

ListingWhy
Docker Model Runner C
Docker, Inc.
The image.generate tag could not be checked: the README shows no image route and the docs site is paused for automated reading.

Doesn't do this job 18

Listings in the category that do something else, with the reason.

ListingWhy
AnythingLLM E
Mintplex Labs, Inc.
Chat and document app; image generation and transcription route to providers rather than being served. source
BitRun E
Abhishek Khanra (IshekKhal on GitHub)
Text only. source
Foundry Local B
Microsoft Corporation
Chat and audio transcription only; no image or speech generation. source
Core F
ZMJ, Inc., doing business as Ghost, 325 9th Street, San Francisco, CA 94103, United States
No image, speech or music generation is claimed. source
GPT4All F
Nomic, Inc.
Text chat only. source
HyperQwen C
syv.ai (Copenhagen, CVR DK44671247)
Text only. source
Jan C
Menlo Research Pte Ltd
Text models only through llama.cpp; no image, speech or music routes. source
Khoj E
Khoj Inc.
Image generation and voice route to configured providers; nothing is served locally beyond chat and search. source
llama.cpp D
ggml.ai, part of Hugging Face since 2026
Speech output (/v1/audio/speech), realtime transcription and multimodal input are served, but there is no image generation route. source
LM Studio C
Element Labs, Inc.
Text and embeddings only; no image, speech or music routes. source
LocalGhost F
LocalGhost.ai Ltd (company number 17213100, registered in England and Wales, incorporated 12 May 2026)
No generation routes. source
MLX LM C
Apple Inc.
Text generation only. source
Ollama D
Ollama Inc.
Text, vision input and embeddings only. No image generation, speech or music routes in the API docs. source
Open WebUI D
Open WebUI Inc.
Routes image, speech and search to configured providers; serves none of them itself. source
PrivateGPT C
PriBAI Technology Spain S.L.
Messages and embeddings; no image or speech routes. source
screenpipe C
Negentropy Labs, Inc. (dba Screenpipe)
Not a generation server. source
Underdog F
Conway Research
No generation server. source
vLLM D
The Linux Foundation (vLLM is a PyTorch Foundation project)
Chat, embeddings, reranking and transcription; no image generation or speech output. source

What stops agents finishing

  • password covers text routes only, image endpoints are not secured
  • one GPU shared between models with no queue, so the second request waits or fails

Around it

After: speech-to-text.self-hosted-local.

Where this comes from

Weight 2 of 100 in Local AI: 3 of 50 accounts, all KoboldCpp or Lemonade; kept because four listings in the category advertise it

The same as data: /api/v1/use-cases/local-ai.multimodal-local-studio.json, or the MCP tool get_use_case with id local-ai.multimodal-local-studio. Other jobs in this category: /api/v1/niches?category=local-ai.

Draft, read 2026-11-12 from public docs and first-hand accounts, not yet reviewed by a person. A mark says what the docs show, not what a run measured.

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.