Audio8-TTS-Realistic 0.6B vs Fish Audio Drama 3

Audio8-TTS-Realistic 0.6B

A small local voice-cloning cousin for 23 languages under Apache 2.0, cloning from one clip and its exact transcript. It needs about 3 GB on a CUDA GPU through Transformers with Edge0's remote code, or Edge0's SGLang Omni plugin for a speech endpoint. The main risks are remote code and a pickled codec, and no independent benchmark yet.

Fish Audio Drama 3

A local voice cousin for directed speech, multi-character scenes, voice cloning and word-level edits in about 80 languages. It needs an NVIDIA GPU, about 29 GB for the int4 build or at least 48 GB for FP8, through SGLang-Omni or fish-speech. The main risk is the licence, revocable, capped at USD 500,000 revenue for commercial use and barring hosted services.

Audio8-TTS-Realistic 0.6B

1. Pin transformers>=4.57.0,<5; Transformers 5 can produce all-zero codes with this custom code
2. Load with AutoProcessor.from_pretrained('Edge0/Audio8-TTS-Realistic-0.6b', trust_remote_code=True) and AutoModel.from_pretrained(..., trust_remote_code=True, dtype=torch.bfloat16); review the four .py files first
3. Clone with processor(text=[...], reference_audio=['ref.wav'], reference_text=['exact transcript'], return_tensors='pt'); a transcript that doesn't match the clip lowers stability
4. Decode with model.decode_audio(output.codes) and write at model.config.codec_sample_rate (44,100 Hz)
5. Split long text into short utterances; reference, transcript and text share 2,048 positions
6. For an HTTP endpoint, install Edge0's SGLang Omni adapter at the pinned SGLang Omni 0.1.0 and call /v1/audio/speech; start the server with AUDIO8_TTS_STREAM_ENABLED=1 for streaming
7. Only clone a voice you have permission to use, and disclose synthetic audio

Fish Audio Drama 3

1. Install SGLang-Omni from source with uv pip install --prerelease=allow -e ".[fishaudio]", then sgl-omni serve --model-path fishaudio/drama-3-int4 --port 8000 (or fishaudio/drama-3 for FP8 on 48 GB or more)
2. POST JSON to /v1/audio/speech with input, optional references (audio_path and its transcript) and previous_takes; set response_format and stream for the output
3. Start each line with <|speaker:N|> (N from 0 to 15) for several voices, and separate lines with <|audio_separator|>
4. Direct with point tags like [sighs], scoped tags like <whisper>...</whisper>, a bracketed style prefix, or Direction: and Line: for a director's note
5. The int4 build needs compute capability 8.0 or newer; only the triton attention backend is accepted
6. Keep each reference clip under 60 seconds and the prompt under 8,192 rows, about 21.5 rows per second of reference audio
7. Check the licence before commercial use or exposing it to other users, and only clone voices with consent
8. Treat text from untrusted sources as a script that can carry directions and speaker tags