Conformer Based Elderly Speech Recognition System for Alzheimer's Disease Detection
Not on the map. Why?
Abstract (arXiv)
Early diagnosis of Alzheimer's disease (AD) is crucial in facilitating preventive care to delay further progression. This paper presents the development of a state-of-the-art Conformer based speech recognition system built on the DementiaBank Pitt corpus for automatic AD detection. The baseline Conformer system trained with speed perturbation and SpecAugment based data augmentation is significantly improved by incorporating a set of purposefully designed modeling features, including neural architecture search based auto-configuration of domain-specific Conformer hyper-parameters in addition to parameter fine-tuning; fine-grained elderly speaker adaptation using learning hidden unit contributions (LHUC); and two-pass cross-system rescoring based combination with hybrid TDNN systems. An overall word error rate (WER) reduction of 13.6% absolute (34.8% relative) was obtained on the evaluation data of 48 elderly speakers. Using the final systems' recognition outputs to extract textual features, the best-published speech recognition based AD detection accuracy of 91.7% was obtained.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 19 of its 55 references that are in the map. First posted on arXiv 23 Jun 2022.
Builds on
19 of 55 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2018DARTS: Differentiable Architecture Searchcited by 1,782
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 411
- 2018SNAS: Stochastic Neural Architecture Searchcited by 288
- 2020Recent Developments on ESPnet Toolkit Boosted by Conformercited by 132
- 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
- 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
- 2019Two-Pass End-to-End Speech Recognitioncited by 62
- 2016Learning Hidden Unit Contributions for Unsupervised Acoustic Model Adaptationcited by 38
7 more
- 2022Investigation of Data Augmentation Techniques for Disordered Speech Recognitioncited by 27
- 2021Comparing Acoustic-based Approaches for Alzheimer's Disease Detectioncited by 21
- 2020Comparing Natural Language Processing Techniques for Alzheimer's Dementia Prediction in Spontaneous Speechcited by 14
- 2022Spectro-Temporal Deep Features for Disordered Speech Assessment and Recognitioncited by 13
- 2022Neural Architecture Search For LF-MMI Trained Time Delay Neural Networkscited by 11
- 2020Bayesian Learning for Deep Neural Network Adaptationcited by 9
- 2019Integrating Source-channel and Attention-based Sequence-to-sequence Models for Speech Recognitioncited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 2; 2025: 2.
12 papers.
- 2023Transformers in Speech Processing: A Surveycited by 38
- 2023Exploring Self-supervised Pre-trained ASR Models For Dysarthric and Elderly Speech Recognitioncited by 14
- 2022Exploring linguistic feature and model combination for speech recognition based automatic AD detectioncited by 9
- 2024Self-supervised ASR Models and Features For Dysarthric and Elderly Speech Recognitioncited by 9
- 2022Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detectioncited by 6
- 2023A New Benchmark of Aphasia Speech Recognition and Detection Based on E-Branchformer and Multi-task Learningcited by 4
- 2023Hyper-parameter Adaptation of Conformer ASR Systems for Elderly and Dysarthric Speech Recognitioncited by 4
- 2023Evaluating Picture Description Speech for Dementia Detection using Image-text Alignmentcited by 4
- 2025WhisperD: Dementia Speech Recognition and Filler Word Detection with Whispercited by 2
- 2023Dementia Assessment Using Mandarin Speech with an Attention-based Speech Recognition Encodercited by 1
- 2025Regularized Federated Learning for Privacy-Preserving Dysarthric and Elderly Speech Recognitioncited by 1
- 2024Multimodal Laryngoscopic Video Analysis for Assisted Diagnosis of Vocal Fold Paralysiscited by 0
- 2025Regularized Federated Learning for Privacy-Preserving Dysarthric and Elderly Speech Recognition2 Jun 2025
- 2025WhisperD: Dementia Speech Recognition and Filler Word Detection with Whisper25 May 2025
- 2024Multimodal Laryngoscopic Video Analysis for Assisted Diagnosis of Vocal Fold Paralysis5 Sep 2024
- 2024Self-supervised ASR Models and Features For Dysarthric and Elderly Speech Recognition3 Jul 2024
- 2023Dementia Assessment Using Mandarin Speech with an Attention-based Speech Recognition Encoder6 Oct 2023
- 2023Evaluating Picture Description Speech for Dementia Detection using Image-text Alignment11 Aug 2023
- 2023Hyper-parameter Adaptation of Conformer ASR Systems for Elderly and Dysarthric Speech Recognition27 Jun 2023
- 2023A New Benchmark of Aphasia Speech Recognition and Detection Based on E-Branchformer and Multi-task Learning19 May 2023
- 2023Transformers in Speech Processing: A Survey21 Mar 2023
- 2023Exploring Self-supervised Pre-trained ASR Models For Dysarthric and Elderly Speech Recognition28 Feb 2023
- 2022Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection29 Oct 2022
- 2022Exploring linguistic feature and model combination for speech recognition based automatic AD detection28 Jun 2022