#3131st of 38 in VoiceFor voice, speech and music
cosyvoice
Zero-shot multilingual text-to-speech with voice cloning and streaming output
- Stars
- 24.1k
- License
- Apache-2.0
- Last commit
- May 2026
- Language
- Python
20,060 on 31 Mar 202624,083 on 20 Oct 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
CosyVoice is an LLM-based text-to-speech system from the FunAudioLLM team. Fun-CosyVoice 3.0 (0.5B) clones voices zero-shot across 9 languages and 18+ Chinese dialects, and supports text-in and audio-out streaming with latency as low as 150ms. The repo includes inference and training scripts, a web demo, gRPC and FastAPI servers, and vLLM and TensorRT-LLM runtimes.
Who it is for: Engineers self-hosting multilingual TTS and voice cloning
Strengths
- Covers 9 languages and 18+ Chinese dialects, with cross-lingual zero-shot voice cloning
- Bi-streaming (text in, audio out) with latency as low as 150ms
- Pinyin and CMU phoneme inpainting; instructions for emotion, speed and volume
- Ships training scripts, FastAPI and gRPC servers, plus vLLM and TensorRT-LLM runtimes
Weaknesses
- Setup is manual: conda env, git submodules, separate model downloads, sox install
- README gives no RAM or VRAM requirements
- vLLM supported only on 0.9.0 and 0.11.x+; versions in between are untested
- No tagged releases; install commands default to Chinese PyPI mirrors
What it needs
- Docker
- Needs Python 3.10, conda, sox, vLLM (optional), TensorRT-LLM (optional), ttsfrd (optional)
- Models: Fun-CosyVoice3-0.5B-2512, CosyVoice2-0.5B, CosyVoice-300M, CosyVoice-300M-SFT, CosyVoice-300M-Instruct
- port 50000
Also in Voice
See all 38| Rank | Project | Score |
|---|---|---|
| 1 | voicestudioDesktop app for voice cloning, dubbing and dictation with local speech models | 83 out of 100 |
| 2 | whisper.cppC/C++ port of OpenAI Whisper for local speech-to-text transcription | 77 out of 100 |
| 3 | VoiceboxLocal voice studio for cloning, TTS, dictation and agent speech | 71 out of 100 |
| #4 | buzzOffline desktop app for transcribing and translating audio with Whisper | 69 out of 100 |
| #5 | meetilyDesktop app that records, transcribes and summarizes meetings locally | 68 out of 100 |