Can large audio language models understand child stuttering speech? speech summarization, and source separation
Not on the map. Why?
Abstract (arXiv)
Child speech differs from adult speech in acoustics, prosody, and language development, and disfluencies (repetitions, prolongations, blocks) further challenge Automatic Speech Recognition (ASR) and downstream Natural Language Processing (NLP). Recent large audio-language models (LALMs) demonstrate strong cross-modal audio understanding; however, their behavior in disfluent child speech remains underexplored. We evaluate several state-of-the-art LALMs in two settings: an interview (mixed speakers) and a reading task (single child). The tasks are (i) single-channel source separation to isolate the child and (ii) child-only summarization that preserves clinically relevant disfluencies and avoids adult-speech leakage. Evaluation combines Large Language Model (LLM) as a judge, human expert ratings, and BERTScore (F1), and we report agreement between models and between models and humans to assess reliability. Our findings delineate the conditions under which LALMs produce faithful child-only summaries from mixed audio and where they fail, offering practical guidance for clinical and educational deployments. We provide prompts and evaluation scripts to support replication.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 21 Oct 2025.
Builds on
19 of 31 references.
References · 19
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2024Qwen2-Audio Technical Reportcited by 543
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 400
- 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 281
- 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
- 2020Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Losscited by 232
- 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 215
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 210
- 2024A Survey on Speech Large Language Models for Understandingcited by 71
- 2019Almost Unsupervised Text to Speech and Automatic Speech Recognitioncited by 41
7 more
- 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Surveycited by 38
- 2023Towards Better Domain Adaptation for Self-supervised Models: A Case Study of Child ASRcited by 23
- 2025Afrispeech-Dialog: A Benchmark Dataset for Spontaneous English Conversations in Healthcare and Beyondcited by 10
- 2025Can Large Audio Language Models Understand Audio Well? Speech, Scene and Events Understanding Benchmark for LALMscited by 5
- 2024State-Space Large Audio Language Modelscited by 3
- 2025Domain-Aware Speaker Diarization On African-Accented Englishcited by 2
- 2025CHSER: A Dataset and Case Study on Generative Speech Error Correction for Child ASRcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.