From Detection To Anticipation: Continuous Onset Forecasting For Stuttered Speech
Not on the map. Why?
Abstract (arXiv)
Automatic stuttering systems primarily detect dysfluencies after they have occurred, limiting their use for anticipatory intervention. We address this gap by formulating stuttering prediction as continuous causal time-to-event forecasting, where a model estimates the risk of an upcoming stuttering onset every 100 ms using only preceding speech. To support this task, we augment FluencyBank Timestamped for 36 speakers with manually reviewed repetitions, prolongations, and blocks, yielding 2,872 forecasting events. We then model the temporal evolution of frozen Whisper-large-v3 speech representations using a compact causal Conformer with 3.67M trainable parameters. The proposed approach achieves an AUROC of 0.63. Temporal analysis further shows that explicitly modeling preceding speech states outperforms simply increasing the static acoustic window, while a discrete-time survival formulation provides coherent forecasts from 300 ms to 1.5 s using a single model. These results provide initial evidence that stuttering onset is preceded by measurable temporal information in speech and establish a framework for future anticipatory stuttering systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
12 of 29 references.
References · 12
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2018A Scalable Discrete-Time Survival Model for Neural Networkscited by 72
- 2022Voice Activity Projection: Self-supervised Learning of Turn-taking Eventscited by 60
- 2021SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stuttercited by 52
- 2024CrisperWhisper: Accurate Timestamps on Verbatim Speech Transcriptionscited by 34
- 2022Detecting Dysfluencies in Stuttering Therapy Using wav2vec 2.0cited by 27
- 2020Stuttering Speech Disfluency Prediction using Explainable Attribution Vectors of Facial Muscle Movementscited by 4
- 2024Self-supervised Speech Models for Word-Level Stuttered Speech Detectioncited by 4
- 2026Predicting Upcoming Stuttering Events from Three-Second Audio: Stratified Evaluation Reveals Severity-Selective Precursors, and the Model Deploys Fully On-Devicecited by 1
Built on by
Not cited yet.