# Clinical Annotations for Automatic Stuttering Severity Assessment

arXiv: https://arxiv.org/abs/2506.00644 · HTML: https://mlsanity.com/paper/2506.00644/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 28 references that are in the map.
- First posted on arXiv 31 May 2025.

## Builds on (most cited first, 7 of 7)

- [wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations](https://mlsanity.com/paper/2006.11477/) (2020)
- [ViViT: A Video Vision Transformer](https://mlsanity.com/paper/2103.15691/) (2021)
- [SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter](https://mlsanity.com/paper/2102.12394/) (2021)
- [KSoF: The Kassel State of Fluency Dataset -- A Therapy Centered Dataset of Stuttering](https://mlsanity.com/paper/2203.05383/) (2022)
- [Measuring Annotator Agreement Generally across Complex Structured, Multi-object, and Free-text Annotation Tasks](https://mlsanity.com/paper/2212.09503/) (2022)
- [Identification of primary and collateral tracks in stuttered speech](https://mlsanity.com/paper/2003.01018/) (2020)
- [A General Model for Aggregating Annotations Across Simple, Complex, and Multi-Object Annotation Tasks](https://mlsanity.com/paper/2312.13437/) (2023)

## Built on by (most cited first, 3 of 3)

- [Aligning Stuttered-Speech Research with End-User Needs: Scoping Review, Survey, and Guidelines](https://mlsanity.com/paper/2604.20535/) (2026)
- [Cripping AI: Reimagining AI Through Lived Disability Experiences](https://mlsanity.com/paper/2605.02080/) (2026)
- [What Counts as an Error? Dual-Reference Benchmarking for Atypical ASR](https://mlsanity.com/paper/2606.31112/) (2026)

## Abstract (arXiv)

Stuttering is a complex disorder that requires specialized expertise for effective assessment and treatment. This paper presents an effort to enhance the FluencyBank dataset with a new stuttering annotation scheme based on established clinical standards. To achieve high-quality annotations, we hired expert clinicians to label the data, ensuring that the resulting annotations mirror real-world clinical expertise. The annotations are multi-modal, incorporating audiovisual features for the detection and classification of stuttering moments, secondary behaviors, and tension scores. In addition to individual annotations, we additionally provide a test set with highly reliable annotations based on expert consensus for assessing individual annotators and machine learning models. Our experiments and analysis illustrate the complexity of this task that necessitates extensive clinical expertise for valid training and evaluation of stuttering assessment models.