mlsanityData to 14 Oct 2026

Stutter-Solver: End-to-end Multi-lingual Dysfluency Detection

arXiv 2409.09621 ↗First posted 15 Sep 2024eess.AS cs.AI cs.SDcited by 8

Not on the map. Why?

Abstract (arXiv)

Current de-facto dysfluency modeling methods utilize template matching algorithms which are not generalizable to out-of-domain real-world dysfluencies across languages, and are not scalable with increasing amounts of training data. To handle these problems, we propose Stutter-Solver: an end-to-end framework that detects dysfluency with accurate type and time transcription, inspired by the YOLO object detection algorithm. Stutter-Solver can handle co-dysfluencies and is a natural multi-lingual dysfluency detector. To leverage scalability and boost performance, we also introduce three novel dysfluency corpora: VCTK-Pro, VCTK-Art, and AISHELL3-Pro, simulating natural spoken dysfluencies including repetition, block, missing, replacement, and prolongation through articulatory-encodec and TTS-based methods. Our approach achieves state-of-the-art performance on all available dysfluency corpora. Code and datasets are open-sourced at https://github.com/eureka235/Stutter-Solver

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 25 of its 41 references that are in the map. First posted on arXiv 15 Sep 2024.

Builds on

25 of 41 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  5. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  6. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  7. 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 309
  8. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 231
  9. 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
  10. 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
  11. 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 74
  12. 2021SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stuttercited by 52
13 more
  1. 2022NANSY++: Unified Voice Synthesis with Neural Analysis and Synthesiscited by 38
  2. 2022Robust Disentangled Variational Speech Representation Learning for Zero-shot Voice Conversioncited by 28
  3. 2019Detecting Multiple Speech Disfluencies using a Deep Residual Network with Bidirectional Long Short-Term Memorycited by 27
  4. 2023AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representationscited by 27
  5. 2023Unconstrained Dysfluency Modeling for Dysfluent Speech Transcription and Detectioncited by 21
  6. 2024YOLO-Stutter: End-to-end Region-Wise Speech Dysfluency Detectioncited by 16
  7. 2024Towards Hierarchical Spoken Language Dysfluency Modelingcited by 15
  8. 2022Deep Neural Convolutive Matrix Factorization for Articulatory Representation Decompositioncited by 12
  9. 2023Deep Speech Synthesis from MRI-Based Articulatory Representationscited by 12
  10. 2022Articulatory Representation Learning Via Joint Factor Analysis and Neural Matrix Factorizationcited by 11
  11. 2022Towards Improved Zero-shot Voice Conversion with Conditional DSVAEcited by 10
  12. 2022Unsupervised TTS Acoustic Modeling for TTS with Conditional Disentangled Sequential VAEcited by 7
  13. 2020Detection and Evaluation of human and machine generated speech in spoofing attacks on automatic speaker verification systemscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 1.

8 papers.

  1. 2025Analysis and Evaluation of Synthetic Data Generation in Speech Dysfluency Detectioncited by 8
  2. 2025Dysfluent WFST: A Framework for Zero-Shot Speech Dysfluency Transcription and Detectioncited by 5
  3. 2025Seamless Dysfluent Speech Text Alignment for Disordered Speech Analysiscited by 4
  4. 2025K-Function: Joint Pronunciation Transcription and Feedback for Evaluating Kids Language Functioncited by 1
  5. 2025Revisiting Rule-Based Stuttering Detection: A Comprehensive Analysis of Interpretable Models for Clinical Applicationscited by 0
  6. 2025A Comparative Study of Controllability, Explainability, and Performance in Dysfluency Detection Modelscited by 0
  7. 2025Deploying UDM Series in Real-Life Stuttered Speech Applications: A Clinical Evaluation Frameworkcited by 0
  8. 2026Aligning Stuttered-Speech Research with End-User Needs: Scoping Review, Survey, and Guidelinescited by 0