#1111th of 51 in VoiceFor voice, speech and music

fish-speech

Expressive multi-speaker text-to-speech models with voice cloning

Stars
33.4k
License
custom license
Last commit
Oct 2026
Last release
May 2025
Language
Python

Missed the latest GitHub check; these facts may be older.

Overview

Fish Speech is the code and weights for Fish Audio's TTS models: Drama 3 (35B-A3B, 3B active per token) and S2-Pro (4B parameters). Both clone voices from reference audio, accept inline tags such as [whisper] and [angry], and share one command line and API server. Drama 3 adds infilling and multi-turn revision of earlier takes.

Who it is for: Developers who need self-hosted expressive TTS and voice cloning

Strengths

  • Voice cloning from 10-30 seconds of reference audio (S2-Pro)
  • Inline tags like [whisper], [excited], [laughing] control emotion and prosody
  • Drama 3 can replace single words in audio and revise earlier takes
  • S2-Pro reports RTF 0.195 and about 100 ms to first audio on one H200

Weaknesses

  • Custom Fish Audio community license; S2-Pro weights under a separate research license
  • Drama 3 is 35B total parameters; hardware requirements are not stated in the README
  • Last tagged release is 2025-05-31, older than the current models
  • README recommends SGLang-Omni or vLLM-Omni for efficient serving

What it needs

  • Docker + Compose
  • Needs PyTorch, Hugging Face model weights
  • Models: Drama 3 (35B-A3B), S2-Pro (4B)

Also in Voice

See all 51
Also in Voice
RankProjectScore
1voicestudioDesktop app for voice cloning, dubbing and dictation with local speech models80.5k starsAGPL-3.083 out of 100
2xiaozhi-esp32ESP32 firmware for a voice chatbot with MCP device and cloud tool control31.7k starsMIT80 out of 100
3whisper.cppC/C++ port of OpenAI Whisper for local speech-to-text transcription54.5k starsMIT78 out of 100
#4VoiceboxLocal voice studio for cloning, TTS, dictation and agent speech58.2k starsMIT71 out of 100
#5buzzOffline desktop app for transcribing and translating audio with Whisper22.1k starsMIT71 out of 100