Speech Separation for Hearing-Impaired Children in the Classroom
Not on the map. Why?
Abstract (arXiv)
Classroom environments are particularly challenging for children with hearing impairments, where background noise, multiple talkers, and reverberation degrade speech perception. These difficulties are greater for children than adults, yet most deep learning speech separation models for assistive devices are developed using adult voices in simplified, low-reverberation conditions. This overlooks both the higher spectral similarity of children's voices, which weakens separation cues, and the acoustic complexity of real classrooms. We address this gap using MIMO-TasNet, a compact, low-latency, multi-channel architecture suited for real-time deployment in bilateral hearing aids or cochlear implants. We simulated naturalistic classroom scenes with moving child-child and child-adult talker pairs under varying noise and distance conditions. Training strategies tested how well the model adapts to children's speech through spatial cues. Models trained on adult speech, classroom data, and finetuned variants were compared to assess data-efficient adaptation. Results show that adult-trained models perform well in clean scenes, but classroom-specific training greatly improves separation quality. Finetuning with only half the classroom data achieved comparable gains, confirming efficient transfer learning. Training with diffuse babble noise further enhanced robustness, and the model preserved spatial awareness while generalizing to unseen distances. These findings demonstrate that spatially aware architectures combined with targeted adaptation can improve speech accessibility for children in noisy classrooms, supporting future on-device assistive technologies.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 73 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
14 of 73 references.
References · 14
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2015Deep clustering: Discriminative embeddings for segmentation and separationcited by 211
- 2016Permutation Invariant Training of Deep Models for Speaker-Independent Multi-talker Speech Separationcited by 189
- 2020Attention is All You Need in Speech Separationcited by 184
- 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 131
- 2023MossFormer2: Combining Transformer and RNN-Free Recurrent Network for Enhanced Time-Domain Monaural Speech Separationcited by 39
- 2018Transfer Learning from Adult to Children for Speech Recognition: Evaluation, Analysis and Recommendationscited by 21
- 2022SepIt: Approaching a Single Channel Speech Separation Boundcited by 16
- 2020Enhancing End-to-End Multi-channel Speech Separation via Spatial Feature Learningcited by 12
- 2020Real-time binaural speech separation with preserved spatial cuescited by 11
- 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environmentscited by 7
Built on by
Not cited yet.