mlsanityData to 7 Oct 2026

End-to-End and Self-Supervised Learning for ComParE 2022 Stuttering Sub-Challenge

arXiv 2207.10817 ↗First posted 20 Jul 2022cs.SD cs.LG eess.AScited by 5

Not on the map. Why?

Abstract (arXiv)

In this paper, we present end-to-end and speech embedding based systems trained in a self-supervised fashion to participate in the ACM Multimedia 2022 ComParE Challenge, specifically the stuttering sub-challenge. In particular, we exploit the embeddings from the pre-trained Wav2Vec2.0 model for stuttering detection (SD) on the KSoF dataset. After embedding extraction, we benchmark with several methods for SD. Our proposed self-supervised based SD system achieves a UAR of 36.9% and 41.0% on validation and test sets respectively, which is 31.32% (validation set) and 1.49% (test set) higher than the best (DeepSpectrum) challenge baseline (CBL). Moreover, we show that concatenating layer embeddings with Mel-frequency cepstral coefficients (MFCCs) features further improves the UAR of 33.81% and 5.45% on validation and test sets respectively over the CBL. Finally, we demonstrate that the summing information across all the layers of Wav2Vec2.0 surpasses the CBL by a relative margin of 45.91% and 5.69% on validation and test sets respectively. Grand-challenge: Computational Paralinguistics ChallengE

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 20 Jul 2022.

Builds on

19 of 38 references.

References · 19

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
  5. 2021Emotion Recognition from Speech Using Wav2vec 2.0 Embeddingscited by 158
  6. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 147
  7. 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 122
  8. 2020A survey on modern trainable activation functionscited by 89
  9. 2021Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognitioncited by 68
  10. 2020Speaker Recognition Based on Deep Learning: An Overviewcited by 59
  11. 2021What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structurecited by 52
  12. 2021SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stuttercited by 51
7 more
  1. 2019Detecting Multiple Speech Disfluencies using a Deep Residual Network with Bidirectional Long Short-Term Memorycited by 27
  2. 2022Detecting Dysfluencies in Stuttering Therapy Using wav2vec 2.0cited by 26
  3. 2021StutterNet: Stuttering Detection Using Time Delay Neural Networkcited by 20
  4. 2021Machine Learning for Stuttering Identification: Review, Challenges and Future Directionscited by 18
  5. 2022Enhancing ASR for Stuttered Speech with Limited Data Using Detect and Passcited by 11
  6. 2022Robust Stuttering Detection via Multi-task and Adversarial Learningcited by 6
  7. 2022Introducing ECAPA-TDNN and Wav2Vec2.0 Embeddings to Stuttering Detectioncited by 5

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 2.

5 papers.

  1. 2023A Stutter Seldom Comes Alone -- Cross-Corpus Stuttering Detection as a Multi-label Problemcited by 9
  2. 2023Advancing Stuttering Detection via Data Augmentation, Class-Balanced Loss and Multi-Contextual Deep Learningcited by 5
  3. 2023Stuttering Detection Using Speaker Representations and Self-supervised Contextual Embeddingscited by 4
  4. 2024Impact of Speech Mode in Automatic Pathological Speech Detectioncited by 2
  5. 2024Selfsupervised learning for pathological speech detectioncited by 0