mlsanityData to 7 Oct 2026

CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environments

arXiv 2409.14494 ↗First posted 13 Sep 2024cs.CL cs.LG cs.SDcited by 7

Not on the map. Why?

Abstract (arXiv)

Creating Automatic Speech Recognition (ASR) systems that are robust and resilient to classroom conditions is paramount to the development of AI tools to aid teachers and students. In this work, we study the efficacy of continued pretraining (CPT) in adapting Wav2vec2.0 to the classroom domain. We show that CPT is a powerful tool in that regard and reduces the Word Error Rate (WER) of Wav2vec2.0-based models by upwards of 10%. More specifically, CPT improves the model's robustness to different noises, microphones and classroom conditions.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 13 Sep 2024.

Builds on

14 of 26 references.

References · 14

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  3. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  4. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  5. 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
  6. 2022The NCTE Transcripts: A Dataset of Elementary Math Classroom Transcriptscited by 43
  7. 2023Kid-Whisper: Towards Bridging the Performance Gap in Automatic Speech Recognition for Children VS. Adultscited by 26
  8. 2023Adaptation of Whisper models to child speech recognitioncited by 25
  9. 2022A Noise-Robust Self-supervised Pre-training Model Based Speech Representation Learning for Automatic Speech Recognitioncited by 20
  10. 2023Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretrainingcited by 18
  11. 2024Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokenscited by 11
  12. 2022Sample-Efficient Unsupervised Domain Adaptation of Speech Recognition Systems A case study for Modern Greekcited by 7
2 more
  1. 2024Multichannel AV-wav2vec2: A Framework for Learning Multichannel Multi-Modal Speech Representationcited by 7
  2. 2023Self-Supervised Adaptive AV Fusion Module for Pre-Trained ASR Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 1.

7 papers.

  1. 2026Mind the Shift: Using Delta SSL Embeddings to Enhance Child ASRcited by 3
  2. 2025SimClass: A Classroom Speech Dataset Generated via Game Engine Simulation For Automatic Speech Recognition Researchcited by 1
  3. 2025CultureMERT: Continual Pre-Training for Cross-Cultural Music Representation Learningcited by 1
  4. 2025Multi-Stage Speaker Diarization for Noisy Classroomscited by 0
  5. 2025From Weak Labels to Strong Results: Utilizing 5,000 Hours of Noisy Classroom Transcripts with Minimal Accurate Datacited by 0
  6. 2025RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Enginescited by 0
  7. 2025Speech Separation for Hearing-Impaired Children in the Classroomcited by 0