mlsanityData to 14 Oct 2026

YOLO-Stutter: End-to-end Region-Wise Speech Dysfluency Detection

arXiv 2408.15297 ↗First posted 27 Aug 2024eess.AS cs.AI cs.CLcited by 16

Not on the map. Why?

Abstract (arXiv)

Dysfluent speech detection is the bottleneck for disordered speech analysis and spoken language learning. Current state-of-the-art models are governed by rule-based systems which lack efficiency and robustness, and are sensitive to template design. In this paper, we propose YOLO-Stutter: a first end-to-end method that detects dysfluencies in a time-accurate manner. YOLO-Stutter takes imperfect speech-text alignment as input, followed by a spatial feature aggregator, and a temporal dependency extractor to perform region-wise boundary and class predictions. We also introduce two dysfluency corpus, VCTK-Stutter and VCTK-TTS, that simulate natural spoken dysfluencies including repetition, block, missing, replacement, and prolongation. Our end-to-end method achieves state-of-the-art performance with a minimum number of trainable parameters for on both simulated data and real aphasia speech. Code and datasets are open-sourced at https://github.com/rorizzz/YOLO-Stutter

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 23 of its 34 references that are in the map. First posted on arXiv 27 Aug 2024.

Builds on

23 of 34 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  5. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  6. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  7. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
  8. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 231
  9. 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 74
  10. 2021SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stuttercited by 52
  11. 2022NANSY++: Unified Voice Synthesis with Neural Analysis and Synthesiscited by 38
  12. 2022Robust Disentangled Variational Speech Representation Learning for Zero-shot Voice Conversioncited by 28
11 more
  1. 2023AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representationscited by 27
  2. 2023Unconstrained Dysfluency Modeling for Dysfluent Speech Transcription and Detectioncited by 21
  3. 2023Self-Supervised Models of Speech Infer Universal Articulatory Kinematicscited by 16
  4. 2023Speaker-Independent Acoustic-to-Articulatory Speech Inversioncited by 15
  5. 2024Towards Hierarchical Spoken Language Dysfluency Modelingcited by 15
  6. 2022Deep Neural Convolutive Matrix Factorization for Articulatory Representation Decompositioncited by 12
  7. 2023Deep Speech Synthesis from MRI-Based Articulatory Representationscited by 12
  8. 2022Articulatory Representation Learning Via Joint Factor Analysis and Neural Matrix Factorizationcited by 11
  9. 2022Towards Improved Zero-shot Voice Conversion with Conditional DSVAEcited by 10
  10. 2022Unsupervised TTS Acoustic Modeling for TTS with Conditional Disentangled Sequential VAEcited by 7
  11. 2023Weakly-supervised forced alignment of disfluent speech using phoneme-level modelingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 9; 2026: 4.

16 papers.

Sort:

By area:

  1. 2024SSDM: Scalable Speech Dysfluency Modelingcited by 13
  2. 2024Stutter-Solver: End-to-end Multi-lingual Dysfluency Detectioncited by 8
  3. 2025Analysis and Evaluation of Synthetic Data Generation in Speech Dysfluency Detectioncited by 8
  4. 2025Whisper Has an Internal Word Alignercited by 7
  5. 2024Time and Tokens: Benchmarking End-to-End Speech Dysfluency Detectioncited by 5
  6. 2025Dysfluent WFST: A Framework for Zero-Shot Speech Dysfluency Transcription and Detectioncited by 5
  7. 2025Seamless Dysfluent Speech Text Alignment for Disordered Speech Analysiscited by 4
  8. 2026Multilingual Dysarthric Speech Assessment Using Universal Phone Recognition and Language-Specific Phonemic Contrast Modelingcited by 4
  9. 2025Smooth Operators: LLMs Translating Imperfect Hints into Disfluency-Rich Transcriptscited by 1
  10. 2025K-Function: Joint Pronunciation Transcription and Feedback for Evaluating Kids Language Functioncited by 1
  11. 2025Revisiting Rule-Based Stuttering Detection: A Comprehensive Analysis of Interpretable Models for Clinical Applicationscited by 0
  12. 2025A Comparative Study of Controllability, Explainability, and Performance in Dysfluency Detection Modelscited by 0
4 more
  1. 2025Deploying UDM Series in Real-Life Stuttered Speech Applications: A Clinical Evaluation Frameworkcited by 0
  2. 2026HASS: Hierarchical Simulation of Logopenic Aphasic Speech for Scalable PPA Detectioncited by 0
  3. 2026Multilingual Stutter Event Detection for English, German, and Mandarin Speechcited by 0
  4. 2026Aligning Stuttered-Speech Research with End-User Needs: Scoping Review, Survey, and Guidelinescited by 0