Choosing a PEFT Variant for Per-Patient Dysarthric ASR: A Single-Speaker Case Study on Two ASR Bases
Not on the map. Why?
Abstract (arXiv)
Per-patient adapters are the preferred production architecture for dysarthric automatic speech recognition (ASR), yet parameter-efficient fine-tuning (PEFT) variants have not been compared in the speaker-dependent, per-patient regime. We present a single-speaker case study comparing seven LoRA-family methods (LoRA, QLoRA, AdaLoRA, DoRA, LoHA, VeRA, VB-LoRA) on two production bases (Whisper-large-v3 with Hungarian fine-tuning, and a multilingual Qwen3-ASR-1.7B checkpoint) for one post-stroke Hungarian male speaker (S1, 409 utterances; severe dysarthria on auditory-perceptual clinical assessment). Attention-projection adapters substantially improve CER on both bases. Across three seeds, a paired bootstrap detects no significant LoRA-DoRA difference (p>0.5; 13.86/13.90 % CER on Whisper, 28.10/28.33 % on Qwen3-ASR), so we adopt the simpler, cheaper LoRA. Real 4-bit (NF4) QLoRA is worse on every seed and both bases (14.56/30.09 % CER) with no memory saving at this scale, and LoHA, VeRA, VB-LoRA and AdaLoRA do not reach the LoRA family, though LoHA still gives an 18.6 % relative CER reduction on Whisper. On the same base, full fine-tuning is more accurate (11.43 % CER), but a 115 MB LoRA that also adapts the feed-forward blocks reaches within 0.66 pp of it at approximately 3.7 % of the per-patient storage. A 6-point enrollment grid shows about 5 min of patient audio captures 45.6 % of the zero-shot-to-30-min CER reduction, with further gains at 10 and 30 min (caveat: one speaker, one language, severe post-stroke dysarthria). Training scripts and recipes will be released, source-available under a research-use licence, on publication.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 30 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
15 of 30 references.
References · 15
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
- 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 141
- 2024VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Bankscited by 52
- 2019Personalizing ASR for Dysarthric and Accented Speech with Limited Datacited by 45
- 2021Personalized Automatic Speech Recognition Trained on Small Disordered Speech Datasetscited by 14
- 2023Parameter-efficient Dysarthric Speech Recognition Using Adapter Fusion and Householder Transformationcited by 6
- 2025Personalized Fine-Tuning with Controllable Synthetic Speech from LLM-Generated Transcripts for Dysarthric Speech Recognitioncited by 6
- 2024Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognitioncited by 4
- 2025Variational Low-Rank Adaptation for Personalized Impaired Speech Recognitioncited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Training Data Augmentation for Dysarthric Automatic Speech Recognition by Text-to-Dysarthric-Speech Synthesis
- 2025On-the-fly Routing for Zero-shot MoE Speaker Adaptation of Speech Foundation Models for Dysarthric Speech Recognition
- 2026End-to-End Simultaneous Dysarthric Speech Reconstruction with Frame-Level Adaptor and Multiple Wait-k Knowledge Distillation
- 2025Aligning ASR Evaluation with Human and LLM Judgments: Intelligibility Metrics Using Phonetic, Semantic, and NLI Approaches
- 2026DARS: Dysarthria-Aware Rhythm-Style Synthesis for ASR Enhancement
- 2025Improved Intelligibility of Dysarthric Speech using Conditional Flow Matching
- 2025Objective and Subjective Evaluation of Diffusion-Based Speech Enhancement for Dysarthric Speech
- 2026Cross-lingual Retrieval-Augmented Classification for Dysarthria Severity Assessment