mlsanityData to 7 Oct 2026

Adaptation of Whisper models to child speech recognition

arXiv 2307.13008 ↗First posted 24 Jul 2023eess.AS cs.AIcited by 25

Not on the map. Why?

Abstract (arXiv)

Automatic Speech Recognition (ASR) systems often struggle with transcribing child speech due to the lack of large child speech datasets required to accurately train child-friendly ASR models. However, there are huge amounts of annotated adult speech datasets which were used to create multilingual ASR models, such as Whisper. Our work aims to explore whether such models can be adapted to child speech to improve ASR for children. In addition, we compare Whisper child-adaptations with finetuned self-supervised models, such as wav2vec2. We demonstrate that finetuning Whisper on child speech yields significant improvements in ASR performance on child speech, compared to non finetuned Whisper models. Additionally, utilizing self-supervised Wav2vec2 models that have been finetuned on child speech outperforms Whisper finetuning.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 24 Jul 2023.

Builds on

15 of 33 references.

References · 15

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  4. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  5. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  6. 2019QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutionscited by 93
  7. 2021SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Networkcited by 83
  8. 2018Toward domain-invariant speech recognition via large scale trainingcited by 35
  9. 2023Towards Better Domain Adaptation for Self-supervised Models: A Case Study of Child ASRcited by 23
  10. 2018Transfer Learning from Adult to Children for Speech Recognition: Evaluation, Analysis and Recommendationscited by 21
  11. 2022DRAFT: A Novel Framework to Reduce Domain Shifting in Self-supervised Learning and Its Application to Children's ASRcited by 21
  12. 2021End-to-End Neural Systems for Automatic Children Speech Recognition: An Empirical Studycited by 17
3 more
  1. 2022A Wav2vec2-Based Experimental Study on Self-Supervised Learning Methods to Improve Child Speech Recognitioncited by 15
  2. 2021Fundamental Frequency Feature Normalization and Data Augmentation for Child Speech Recognitioncited by 9
  3. 2022Transfer Learning for Robust Low-Resource Children's Speech ASR with Transformers and Source-Filter Warpingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 9; 2025: 8; 2026: 4.

25 papers.

Sort:

  1. 2024Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Modelscited by 29
  2. 2023Kid-Whisper: Towards Bridging the Performance Gap in Automatic Speech Recognition for Children VS. Adultscited by 26
  3. 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environmentscited by 7
  4. 2025Adapting Whisper for Parameter-efficient Code-Switching Speech Recognition via Soft Prompt Tuningcited by 5
  5. 2024Continued Pretraining for Domain Adaptation of Wav2vec2.0 in Automatic Speech Recognition for Elementary Math Classroom Settingscited by 4
  6. 2025TICL+: A Case Study On Speech In-Context Learning for Children's Speech Recognitioncited by 4
  7. 2023Using fine-tuning and min lookahead beam search to improve Whispercited by 3
  8. 2024Automatic Speech Recognition (ASR) for the Diagnosis of pronunciation of Speech Sound Disorders in Korean childrencited by 3
  9. 2024FASA: a Flexible and Automatic Speech Aligner for Extracting High-quality Aligned Children Speech Datacited by 3
  10. 2023A comparative analysis between Conformer-Transducer, Whisper, and wav2vec2 for improving the child speech recognitioncited by 2
  11. 2024Efficient Compression of Multitask Multilingual Speech Modelscited by 2
  12. 2025Language-Aware Prompt Tuning for Parameter-Efficient Seamless Language Expansion in Multilingual ASRcited by 2
13 more
  1. 2024Evaluation of Speech Foundation Models for ASR on Child-Adult Conversations in Autism Diagnostic Sessionscited by 1
  2. 2024Automatic Speech Recognition for the Ika Languagecited by 1
  3. 2025Automated evaluation of children's speech fluency for low-resource languagescited by 1
  4. 2025Arabic Little STT: Arabic Children Speech Recognition Datasetcited by 1
  5. 2023Using State-of-the-Art Speech Models to Evaluate Oral Reading Fluency in Ghanacited by 0
  6. 2024Examining Test-Time Adaptation for Personalized Child Speech Recognitioncited by 0
  7. 2025Benchmarking NLP-supported Language Sample Analysis for Swiss Children's Speechcited by 0
  8. 2025Causal Structure Discovery for Error Diagnostics of Children's ASRcited by 0
  9. 2025Which one Performs Better? Wav2Vec or Whisper? Applying both in Badini Kurdish Speech to Text (BKSTT)cited by 0
  10. 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Readingcited by 0
  11. 2026Utterance-Level Methods for Identifying Reliable ASR-Output for Child Speechcited by 0
  12. 2026From Review to Design: Ethical Multimodal Driver Monitoring Systems for Risk Mitigation, Incident Response, and Accountability in Automated Vehiclescited by 0
  13. 2026Transcribing Children's Speech: ASR Performance and Obtaining Reliable Orthographic Transcriptionscited by 0