Where Words Begin and End
Not on the map. Why?
Abstract (arXiv)
Forced aligners locate each word of a known transcript in the audio, and many speech pipelines depend on them. In our own data, a widely used CTC aligner inserts a pause at nearly every word boundary, and we found almost no aligner evaluated on telephone audio. We compare nine aligner configurations against human word boundaries on read, conversational and telephone English. The Montreal Forced Aligner (MFA) is the most precise, while CTC aligners consistently start words late, because most frames inside a word go to the blank token. We then fine-tune Whisper with LoRA to predict each word's start and end as timestamp tokens, training only on boundaries placed by people: 47 hours in 87 languages. The resulting aligner is more precise than MFA on every English test condition, and than MFA's own Korean and Dutch models. With FA-Bench's protocol and code on TIMIT, its word-boundary error is 11.6 ms, against 18.2 ms for the best published system. Two choices matter most on telephone conversations: placing the timestamp slots after the word they time, and training on noisy transcripts, which also makes the aligner nearly insensitive to errors in the transcript. The released model reaches 16.0 ms on real landline calls, against 36.5 ms for MFA. The models are available at https://huggingface.co/collections/Scicom-intl/force-alignment
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
17 of 38 references.
References · 17
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2023Scaling Speech Technology to 1,000+ Languagescited by 411
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
- 2020CTC-Segmentation of Large Corpora for German End-to-end Speech Recognitioncited by 76
- 2021Why does CTC result in peaky behavior?cited by 33
- 2023TorchAudio 2.1: Advancing speech recognition, self-supervised learning, and audio processing components for PyTorchcited by 27
- 2021Phone-to-audio alignment without text: A Semi-supervised Approachcited by 26
- 2024Tradition or Innovation: A Comparison of Modern ASR Methods for Forced Alignmentcited by 21
- 2023Achieving Timestamp Prediction While Recognizing with Non-Autoregressive End-to-End ASR Modelcited by 10
- 2022NeuFA: Neural Network Based End-to-End Forced Alignment with Bidirectional Attention Mechanismcited by 9
- 2026LLM-ForcedAligner: A Non-Autoregressive and Accurate LLM-Based Forced Aligner for Multilingual and Long-Form Speechcited by 9
- 2025Whisper Has an Internal Word Alignercited by 7
5 more
- 2023The Mason-Alberta Phonetic Segmenter: A forced alignment system based on deep neural networks and interpolationcited by 5
- 2026Transcription Policy as a Latent Variable: Activating Controllable Verbatim ASR with Word-Level Timingcited by 3
- 2026Gradient-Based Speech-to-Text Alignment for Any ASR Model: From CTC to Speech LLMscited by 1
- 2026Phoneme- and Word-Level Metrics Using Self-Supervised Speech Representations for Forced Alignment Evaluationcited by 1
- 2026Word Timestamps and Speaker Attribution with a Non-Autoregressive LLMcited by 1
Built on by
Not cited yet.