#3434th of 67 in VoiceFor voice, speech and music

retrieval-based-voice-conversion-webui

Web UI for training and running retrieval-based voice conversion models

Stars
39k
License
MIT
Last commit
Aug 2026
Last release
Jul 2026
Language
Python
Stars, last 29 weeks+4,331
10 Apr 2026: 34,667 stars17 Apr 2026: 34,771 stars24 Apr 2026: 34,882 stars1 May 2026: 34,982 stars8 May 2026: 35,085 stars15 May 2026: 35,201 stars22 May 2026: 35,293 stars29 May 2026: 35,412 stars5 Jun 2026: 35,537 stars12 Jun 2026: 35,653 stars19 Jun 2026: 35,770 stars26 Jun 2026: 35,886 stars3 Jul 2026: 35,996 stars10 Jul 2026: 36,116 stars17 Jul 2026: 36,235 stars24 Jul 2026: 36,402 stars31 Jul 2026: 36,580 stars7 Aug 2026: 36,913 stars14 Aug 2026: 37,105 stars21 Aug 2026: 37,501 stars28 Aug 2026: 37,655 stars4 Sept 2026: 37,822 stars11 Sept 2026: 37,977 stars18 Sept 2026: 38,145 stars25 Sept 2026: 38,299 stars2 Oct 2026: 38,414 stars9 Oct 2026: 38,539 stars16 Oct 2026: 38,683 stars23 Oct 2026: 38,826 stars30 Oct 2026: 38,998 stars

34,667 on 10 Apr 202638,998 on 30 Oct 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

Gradio web UI for training RVC voice models and converting speech or singing to a target voice. It replaces input features with top-1 retrieved training-set features to reduce timbre leakage, and uses RMVPE for pitch extraction. It includes a real-time voice changer GUI, vocal/accompaniment separation via pymss/MSST, and checkpoint merging. The README recommends at least 10 minutes of clean voice data.

Who it is for: Hobbyists and developers training voice-conversion or AI singer models

Strengths

  • Trains usable models from about 10 minutes of low-noise audio, per the README
  • Separate real-time GUI: 170 ms end-to-end latency, 90 ms with ASIO devices
  • Includes vocal separation (pymss/MSST) and ckpt-merge in the same tool
  • CPU, DirectML (Windows) and CUDA 11.8/12.8 install paths

Weaknesses

  • Manual setup: Python 3.12 venv, separate Torch install, and several model downloads
  • No Docker or compose files in the repo
  • Main README is in Chinese; English docs live in docs/en
  • Low latency depends on ASIO hardware drivers; RVCv3 base models are not released yet

What it needs

  • GPU optional
  • Needs Python 3.12, PyTorch, FFmpeg, Gradio, Hugging Face model weights (hubert_base, rmvpe, pretrained)
  • Models: RVC v1/v2 .pth, RMVPE, HuBERT/ContentVec, FAISS .index, pymss/MSST
  • port 7865

Quick answers

Is retrieval-based-voice-conversion-webui open source?

Yes. Its code is on GitHub under the MIT license.

Does retrieval-based-voice-conversion-webui need a GPU?

No. It runs on a CPU and can use a GPU when you have one.

Also in Voice

See all 67
Also in Voice
RankProjectScore
1voicestudioDesktop app for voice cloning, dubbing, dictation and audiobooks97.4k starsAGPL-3.097 out of 100
2whisper.cppC/C++ port of OpenAI Whisper for local speech-to-text transcription54.8k starsMIT89 out of 100
3handyOffline push-to-talk dictation app that pastes transcripts into any text field36.1k starsMIT89 out of 100
#4xiaozhi-esp32ESP32 firmware for a voice chatbot with MCP device and cloud tool control32.4k starsMIT82 out of 100
#5buzzOffline desktop app for transcribing and translating audio with Whisper22.3k starsMIT81 out of 100