Analyzing Speech Condition Effects in Dysarthric ASR: A Layer-wise Probing Study
Not on the map. Why?
Abstract (arXiv)
Automatic speech recognition (ASR) performance degrades sharply on dysarthric speech, yet how disordered articulation reshapes a model's internal representations is underexplored. We conduct a layer-wise probing analysis of a transformer ASR encoder on Mandarin dysarthric speech under three transcript-matched conditions: original dysarthric speech, speaker conditioned zero-shot TTS resynthesis, and unconditioned TTS. Probing reveals a task- and condition-dependent representation hierarchy: phoneme boundary information remains weak across all layers for dysarthric speech; phoneme identity is recoverable in deep layers for synthetic speech, but remains poor for dysarthric speech; and recognition difficulty is concentrated in the deepest layers. Furthermore, lexical tone is a persistent error source across all conditions. Guided by these insights, layer-selective LoRA shows that mid-layer adaptation (layer 7 or layers 5-8) recovers near-full encoder performance on dysarthric speech within 6.67% and 2.89% relative margins while training only 0.16% and 0.65% of adapter parameters. Conversely, upper-layer adaptation benefits synthetic speech more than dysarthric speech. These findings link representation analysis to parameter-efficient fine-tuning and motivate layer-aware adaptation for low-resource Mandarin dysarthric ASR.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 21 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
15 of 21 references.
References · 15
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 298
- 2019Personalizing ASR for Dysarthric and Accented Speech with Limited Datacited by 45
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 25
- 2024Training Data Augmentation for Dysarthric Automatic Speech Recognition by Text-to-Dysarthric-Speech Synthesiscited by 14
- 2024UNIT-DSR: Dysarthric Speech Reconstruction System Using Speech Unit Normalizationcited by 8
- 2023CDSD: Chinese Dysarthria Speech Databasecited by 7
- 2022On-the-Fly Feature Based Rapid Speaker Adaptation for Dysarthric and Elderly Speech Recognitioncited by 5
- 2025DiffDSR: Dysarthric Speech Reconstruction Using Latent Diffusion Modelcited by 5
- 2025Probing Whisper for Dysarthric Speech in Detection and Assessmentcited by 5
- 2024CoLM-DSR: Leveraging Neural Codec Language Modeling for Multi-Modal Dysarthric Speech Reconstructioncited by 4
3 more
- 2024Enhancing Voice Wake-Up for Dysarthria: Mandarin Dysarthria Speech Corpus Release and Customized System Designcited by 4
- 2024Enhancing Dysarthric Speech Recognition for Unseen Speakers via Prototype-Based Adaptationcited by 4
- 2025A Self-Training Approach for Whisper to Enhance Long Dysarthric Speech Recognitioncited by 2
Built on by
Not cited yet.