#6262nd of 67 in VoiceFor voice, speech and music

megatts3

Zero-shot Chinese and English voice-cloning TTS with a 0.45B diffusion transformer

Stars
6.1k
License
Apache-2.0
Last commit
Jun 2026
Language
Python
Stars, last 30 weeks+116
3 Apr 2026: 6,002 stars10 Apr 2026: 6,007 stars17 Apr 2026: 6,014 stars24 Apr 2026: 6,017 stars1 May 2026: 6,021 stars8 May 2026: 6,026 stars15 May 2026: 6,030 stars22 May 2026: 6,033 stars29 May 2026: 6,037 stars5 Jun 2026: 6,040 stars12 Jun 2026: 6,044 stars19 Jun 2026: 6,046 stars26 Jun 2026: 6,051 stars3 Jul 2026: 6,055 stars10 Jul 2026: 6,060 stars17 Jul 2026: 6,061 stars24 Jul 2026: 6,061 stars31 Jul 2026: 6,064 stars7 Aug 2026: 6,068 stars14 Aug 2026: 6,071 stars21 Aug 2026: 6,075 stars28 Aug 2026: 6,075 stars4 Sept 2026: 6,079 stars11 Sept 2026: 6,085 stars18 Sept 2026: 6,088 stars25 Sept 2026: 6,091 stars2 Oct 2026: 6,091 stars9 Oct 2026: 6,093 stars16 Oct 2026: 6,096 stars23 Oct 2026: 6,113 stars30 Oct 2026: 6,118 stars

6,002 on 3 Apr 20266,118 on 30 Oct 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

MegaTTS 3 is ByteDance's PyTorch implementation of a latent diffusion transformer for zero-shot speech synthesis in Chinese, English and code-switched text. It ships a CLI and a Gradio web UI, plus an aligner, a Qwen2.5-0.5B grapheme-to-phoneme model and a WaveVAE that can be used on their own. The WaveVAE encoder is not released, so cloning needs pre-extracted .npy latents for each voice.

Who it is for: Speech researchers testing zero-shot voice cloning in Chinese and English

Strengths

  • Diffusion Transformer backbone is only 0.45B parameters
  • Accent strength adjustable through p_w and t_w inference weights
  • Aligner, G2P and WaveVAE submodules are reusable outside TTS
  • CPU inference works, about 30 seconds for 10 steps

Weaknesses

  • WaveVAE encoder withheld; custom voices need .npy latents supplied by the authors
  • Only Chinese and English supported
  • Windows and Docker setups are marked as under testing
  • Fine-grained pronunciation and duration control is listed as coming soon

What it needs

  • GPU optional
  • Docker
  • Needs Python 3.10, PyTorch 2.6.0, Gradio, ffmpeg, WeTextProcessing
  • Models: MegaTTS3 checkpoints (Hugging Face, Google Drive), Qwen2.5-0.5B G2P, WaveVAE
  • port 7860

Quick answers

Is megatts3 open source?

Yes. Its code is on GitHub under the Apache-2.0 license.

Can you run megatts3 with Docker?

Yes. Its repository has a Docker setup: a Dockerfile, a Compose file or a published image.

Does megatts3 need a GPU?

No. It runs on a CPU and can use a GPU when you have one.

Also in Voice

See all 67
Also in Voice
RankProjectScore
1voicestudioDesktop app for voice cloning, dubbing, dictation and audiobooks97.4k starsAGPL-3.097 out of 100
2whisper.cppC/C++ port of OpenAI Whisper for local speech-to-text transcription54.8k starsMIT89 out of 100
3handyOffline push-to-talk dictation app that pastes transcripts into any text field36.1k starsMIT89 out of 100
#4xiaozhi-esp32ESP32 firmware for a voice chatbot with MCP device and cloud tool control32.4k starsMIT82 out of 100
#5buzzOffline desktop app for transcribing and translating audio with Whisper22.3k starsMIT81 out of 100