Kid-Whisper: Towards Bridging the Performance Gap in Automatic Speech Recognition for Children VS. Adults
Not on the map. Why?
Abstract (arXiv)
Recent advancements in Automatic Speech Recognition (ASR) systems, exemplified by Whisper, have demonstrated the potential of these systems to approach human-level performance given sufficient data. However, this progress doesn't readily extend to ASR for children due to the limited availability of suitable child-specific databases and the distinct characteristics of children's speech. A recent study investigated leveraging the My Science Tutor (MyST) children's speech corpus to enhance Whisper's performance in recognizing children's speech. They were able to demonstrate some improvement on a limited testset. This paper builds on these findings by enhancing the utility of the MyST dataset through more efficient data preprocessing. We reduce the Word Error Rate (WER) on the MyST testset 13.93% to 9.11% with Whisper-Small and from 13.23% to 8.61% with Whisper-Medium and show that this improvement can be generalized to unseen datasets. We also highlight important challenges towards improving children's ASR performance. The results showcase the viable and efficient integration of Whisper for effective children's speech recognition.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 8 of its 25 references that are in the map. First posted on arXiv 12 Sep 2023.
Builds on
8 of 25 references.
References · 8
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
- 2023Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggerscited by 72
- 2020Applying Wav2vec2.0 to Speech Recognition in Various Low-resource Languagescited by 30
- 2023Adaptation of Whisper models to child speech recognitioncited by 25
- 2023N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognitioncited by 20
- 2022A Wav2vec2-Based Experimental Study on Self-Supervised Learning Methods to Improve Child Speech Recognitioncited by 15
- 2021Fundamental Frequency Feature Normalization and Data Augmentation for Child Speech Recognitioncited by 9
Built on by
Citing papers per year: 2024: 7; 2025: 10; 2026: 9.
26 papers.
Sort:
- 2024Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Modelscited by 29
- 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environmentscited by 7
- 2025Benchmarking Training Paradigms, Dataset Composition, and Model Scaling for Child ASR in ESPnetcited by 6
- 2025Selective Attention Merging for low resource tasks: A case study of Child ASRcited by 5
- 2025TICL+: A Case Study On Speech In-Context Learning for Children's Speech Recognitioncited by 4
- 2024Children's Speech Recognition through Discrete Token Enhancementcited by 3
- 2024FASA: a Flexible and Automatic Speech Aligner for Extracting High-quality Aligned Children Speech Datacited by 3
- 2024Automatic Screening for Children with Speech Disorder using Automatic Speech Recognition: Opportunities and Challengescited by 3
- 2025SSVD: Structured SVD for Parameter-Efficient Fine-Tuning and Benchmarking under Domain Shift in ASRcited by 3
- 2026Mind the Shift: Using Delta SSL Embeddings to Enhance Child ASRcited by 3
- 2025SingaKids: A Multilingual Multimodal Dialogic Tutor for Language Learningcited by 2
- 2024Evaluation of Speech Foundation Models for ASR on Child-Adult Conversations in Autism Diagnostic Sessionscited by 1
14 more
- 2025CO-VADA: A Confidence-Oriented Voice Augmentation Debiasing Approach for Fair Speech Emotion Recognitioncited by 1
- 2025SimClass: A Classroom Speech Dataset Generated via Game Engine Simulation For Automatic Speech Recognition Researchcited by 1
- 2026SSVD-O: Parameter-Efficient Fine-Tuning with Structured SVD for Speech Recognitioncited by 1
- 2026Gumbel-BEARD: Automatic Layer Selection for Self-Supervised Adaptation of Whisper in Low-Resource Domainscited by 1
- 2024Examining Test-Time Adaptation for Personalized Child Speech Recognitioncited by 0
- 2025From Weak Labels to Strong Results: Utilizing 5,000 Hours of Noisy Classroom Transcripts with Minimal Accurate Datacited by 0
- 2025RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Enginescited by 0
- 2025KidSpeak: A General Multi-purpose LLM for Kids' Speech Recognition and Screeningcited by 0
- 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Readingcited by 0
- 2026Abjad-Kids: An Arabic Speech Classification Dataset for Primary Educationcited by 0
- 2026Digital Harf: A Clinically Integrated Multimodal AI System for Pervasive Arabic Speech and Language Therapycited by 0
- 2026Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMscited by 0
- 2026AURA: Uncertainty-Routed Activation Editing for Acoustic Grounding in Speech Foundation Modelscited by 0
- 2026Pruning for Efficiency, Paying in Fairness: Demographic Disparities in Pruned Speech-LLMscited by 0
- 2026Pruning for Efficiency, Paying in Fairness: Demographic Disparities in Pruned Speech-LLMs29 Sep 2026
- 2026AURA: Uncertainty-Routed Activation Editing for Acoustic Grounding in Speech Foundation Models21 Sep 2026
- 2026Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs16 Sep 2026
- 2026Gumbel-BEARD: Automatic Layer Selection for Self-Supervised Adaptation of Whisper in Low-Resource Domains9 Jun 2026
- 2026Digital Harf: A Clinically Integrated Multimodal AI System for Pervasive Arabic Speech and Language Therapy18 May 2026
- 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Reading14 Mar 2026
- 2026Abjad-Kids: An Arabic Speech Classification Dataset for Primary Education11 Mar 2026
- 2026Mind the Shift: Using Delta SSL Embeddings to Enhance Child ASR28 Jan 2026
- 2026SSVD-O: Parameter-Efficient Fine-Tuning with Structured SVD for Speech Recognition18 Jan 2026
- 2025TICL+: A Case Study On Speech In-Context Learning for Children's Speech Recognition20 Dec 2025
- 2025KidSpeak: A General Multi-purpose LLM for Kids' Speech Recognition and Screening1 Dec 2025
- 2025RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Engines1 Oct 2025
14 more
- 2025SSVD: Structured SVD for Parameter-Efficient Fine-Tuning and Benchmarking under Domain Shift in ASR2 Sep 2025
- 2025Benchmarking Training Paradigms, Dataset Composition, and Model Scaling for Child ASR in ESPnet22 Aug 2025
- 2025SimClass: A Classroom Speech Dataset Generated via Game Engine Simulation For Automatic Speech Recognition Research10 Jun 2025
- 2025CO-VADA: A Confidence-Oriented Voice Augmentation Debiasing Approach for Fair Speech Emotion Recognition6 Jun 2025
- 2025SingaKids: A Multilingual Multimodal Dialogic Tutor for Language Learning3 Jun 2025
- 2025From Weak Labels to Strong Results: Utilizing 5,000 Hours of Noisy Classroom Transcripts with Minimal Accurate Data20 May 2025
- 2025Selective Attention Merging for low resource tasks: A case study of Child ASR14 Jan 2025
- 2024Automatic Screening for Children with Speech Disorder using Automatic Speech Recognition: Opportunities and Challenges7 Oct 2024
- 2024Evaluation of Speech Foundation Models for ASR on Child-Adult Conversations in Autism Diagnostic Sessions24 Sep 2024
- 2024Examining Test-Time Adaptation for Personalized Child Speech Recognition19 Sep 2024
- 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environments13 Sep 2024
- 2024FASA: a Flexible and Automatic Speech Aligner for Extracting High-quality Aligned Children Speech Data25 Jun 2024
- 2024Children's Speech Recognition through Discrete Token Enhancement19 Jun 2024
- 2024Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Models15 Jun 2024
- 2024Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Modelscited by 29
- 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environmentscited by 7
- 2025Benchmarking Training Paradigms, Dataset Composition, and Model Scaling for Child ASR in ESPnetcited by 6
- 2025Selective Attention Merging for low resource tasks: A case study of Child ASRcited by 5
- 2025TICL+: A Case Study On Speech In-Context Learning for Children's Speech Recognitioncited by 4
- 2024Children's Speech Recognition through Discrete Token Enhancementcited by 3
- 2024FASA: a Flexible and Automatic Speech Aligner for Extracting High-quality Aligned Children Speech Datacited by 3
- 2024Automatic Screening for Children with Speech Disorder using Automatic Speech Recognition: Opportunities and Challengescited by 3
- 2025SSVD: Structured SVD for Parameter-Efficient Fine-Tuning and Benchmarking under Domain Shift in ASRcited by 3
- 2026Mind the Shift: Using Delta SSL Embeddings to Enhance Child ASRcited by 3
- 2025SingaKids: A Multilingual Multimodal Dialogic Tutor for Language Learningcited by 2
- 2024Evaluation of Speech Foundation Models for ASR on Child-Adult Conversations in Autism Diagnostic Sessionscited by 1
12 most cited of 26 All 26 (JSON)
- 2026Pruning for Efficiency, Paying in Fairness: Demographic Disparities in Pruned Speech-LLMs29 Sep 2026
- 2026AURA: Uncertainty-Routed Activation Editing for Acoustic Grounding in Speech Foundation Models21 Sep 2026
- 2026Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs16 Sep 2026
- 2026Gumbel-BEARD: Automatic Layer Selection for Self-Supervised Adaptation of Whisper in Low-Resource Domains9 Jun 2026
- 2026Digital Harf: A Clinically Integrated Multimodal AI System for Pervasive Arabic Speech and Language Therapy18 May 2026
- 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Reading14 Mar 2026
- 2026Abjad-Kids: An Arabic Speech Classification Dataset for Primary Education11 Mar 2026
- 2026Mind the Shift: Using Delta SSL Embeddings to Enhance Child ASR28 Jan 2026
- 2026SSVD-O: Parameter-Efficient Fine-Tuning with Structured SVD for Speech Recognition18 Jan 2026
- 2025TICL+: A Case Study On Speech In-Context Learning for Children's Speech Recognition20 Dec 2025
- 2025KidSpeak: A General Multi-purpose LLM for Kids' Speech Recognition and Screening1 Dec 2025
- 2025RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Engines1 Oct 2025
12 newest of 26 All 26 (JSON)