Home / Companies / ElevenLabs / Blog / Post Details
Content Deep Dive

Forced alignment with Cue: Character-level audio timing

Blog post from ElevenLabs

Post Details
Company
Date Published
Author
Mike Murphy
Word Count
1,494
Company Posts That Month
49
Language
English
Hacker News Points
-
Post removed?
No
Summary

ElevenLabs introduces Cue, a forced-alignment model that precisely maps every character in an audio recording to its timing, improving synchronization for transcripts, subtitles, dubbing, and lyric displays. Used in every request to the company’s Scribe speech-to-text models and available through a Forced Alignment API, Cue supports more than 90 languages and can process audio files of any length in a single pass, avoiding accumulated errors caused by chunking long recordings. ElevenLabs reports that Cue outperformed tested open-source aligners across 29 benchmark languages, with lower timing errors on long and noisy recordings and the ability to align an hour of audio in roughly half a second on production hardware. The model is smaller than ElevenLabs’ previous aligner but is designed for real-world audio conditions such as background noise, overlapping speakers, and music, and its character-level approach offers finer precision than standard word-level benchmarks measure. Cue also showed strong performance on multilingual songs, aligning lyrics more accurately than competing tools in tests, while rapid updates following user feedback helped improve support for lower-resource languages.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
Real-time 1 4,153 1,091 236 -14%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.