ElevenLabs 研究团队发布强制对齐模型 Cue,能将每个字符精确放到音频时间轴上,精度高于其测试过的所有开源对齐器,覆盖基准测试全部 29 种语言。Cue 单模型可一次处理任意长度的录音,在单张 GPU 上约半秒对齐一小时音频,已用于 ElevenLabs 全部 Speech to Text 转写,并可通过 Forced Alignment API 单独使用。
New from ElevenLabs research: Today we’re sharing more about Cue, our new forced alignment model. It places every character on the audio timeline with more precision than any other aligner we tested. That means the right words show up at the right time.
Forced alignment is the step that turns a transcript into timestamps. It’s how subtitles land on time, how dubbed lines match the speaker, and how clicking a word in a transcript jumps to the moment it was said. Most open-source aligners are built for short, clean clips in a limited set of languages. Cue is one model that handles recordings of any length in a single pass. On real-world audio, it was more accurate than every open-source aligner we tested in all 29 languages of our benchmark. It aligns an hour of audio in about half a second on one GPU.
Cue already powers every Speech to Text transcription on ElevenLabs, and it’s available on its own through the Forced Alignment API.
Read the full post: https://elevenlabs.io/blog/cue-aligner
来源:ElevenLabs · x.com