pyvideotrans
Video translation and AI dubbing pipeline with ASR, subtitle translation and TTS
pyVideoTrans translates videos between languages by chaining speech recognition, subtitle translation, speech synthesis and audio-video merging. It runs as a PySide6 desktop GUI, a CLI, or a Gradio WebUI, and works with local models (Faster-Whisper, Ollama, F5-TTS) or online APIs. Pipeline stages can be paused for manual proofreading, and speaker diarization allows different dubbing voices per speaker.
Strengths
- Full pipeline in one tool: ASR, translation, TTS and video merge
- Mixes local engines (Faster-Whisper, Ollama) with many commercial APIs
- Pause and edit between recognition, translation and dubbing stages
- GUI, CLI for batch jobs, WebUI, and a prebuilt Windows exe
Weaknesses
- GPU acceleration is NVIDIA only; AMD needs the Whisper.NET route
- Windows GPU use requires manually installing CUDA 12.8 and cuDNN 9.11
- WebUI is an optional extra and Docker image must be built locally
- GPL-3.0 license; README lists no RAM or VRAM requirements
- GPU optional
- Docker
- Needs FFmpeg, Python 3.10, uv, CUDA 12.8 and cuDNN 9.11 (NVIDIA GPU only)
- Models: Faster-Whisper, WhisperX, OpenAI Whisper, Ollama, DeepSeek
- port 7860