A developer in our community recently built VoiceGate
using VoxCPM2 + ComfyUI for cross-lingual video dubbing and localization.💥

You can upload a video, and it automatically:
🎬 Extract speech and generate subtitles (ASR)
🌍 Translate content using LLMs
🗣 Synthesize multilingual speech with VoxCPM2
(30+ languages + 9 dialects support, plus voice cloning & timbre design)
⏱ Align audio with timestamp-aware SRT scheduling
🎧 Separate and remix voice / background audio for natural output

👍Core innovation
The VoiceBridge plugin introduces SRT timestamp-driven TTS alignment into ComfyUI for the first time, enabling fine-grained subtitle-level control over speech generation.
📊SRT-driven audio splitting + TTS generation
📊Timestamp-based audio merging for precise sync
📊ASR + forced alignment for structured subtitles
📊Solves audio-video desynchronization in AI dubbing workflows

💬 Applications
🔷Turn Chinese videos into global languages (EN/JP/KO…)
🔷Bring global videos into Chinese & dialects
🔷Multilingual versions of docs, museums & education

📦Try it now：https://github.com/YanTianlong-01/VoiceGate

More info
https://huggingface.co/spaces/openbmb/VoxCPM-Demo
https://github.com/OpenBMB/VoxCPM/

#VoxCPM2 #OpenBMB #VoiceSynthesis #SpeechModel #AIVoiceCloning