Useful Blunders: Can Automated Speech Recognition Errors Improve Downstream Dementia Classification?
Not on the map. Why?
Abstract (arXiv)
Objectives: We aimed to investigate how errors from automatic speech recognition (ASR) systems affect dementia classification accuracy, specifically in the ``Cookie Theft'' picture description task. We aimed to assess whether imperfect ASR-generated transcripts could provide valuable information for distinguishing between language samples from cognitively healthy individuals and those with Alzheimer's disease (AD). Methods: We conducted experiments using various ASR models, refining their transcripts with post-editing techniques. Both these imperfect ASR transcripts and manually transcribed ones were used as inputs for the downstream dementia classification. We conducted comprehensive error analysis to compare model performance and assess ASR-generated transcript effectiveness in dementia classification. Results: Imperfect ASR-generated transcripts surprisingly outperformed manual transcription for distinguishing between individuals with AD and those without in the ``Cookie Theft'' task. These ASR-based models surpassed the previous state-of-the-art approach, indicating that ASR errors may contain valuable cues related to dementia. The synergy between ASR and classification models improved overall accuracy in dementia classification. Conclusion: Imperfect ASR transcripts effectively capture linguistic anomalies linked to dementia, improving accuracy in classification tasks. This synergy between ASR and classification models underscores ASR's potential as a valuable tool in assessing cognitive impairment and related clinical applications.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 25 of its 58 references that are in the map. First posted on arXiv 10 Jan 2024.
Builds on
25 of 58 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2020Supervised Contrastive Learningcited by 2,829
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 467
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
- 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 298
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
13 more
- 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
- 2017What do we need to build explainable AI systems for the medical domain?cited by 129
- 2019Self-Training for End-to-End Speech Recognitioncited by 129
- 2019End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architecturescited by 120
- 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
- 2020Self-training and Pre-training are Complementary for Speech Recognitioncited by 99
- 2020To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detectioncited by 49
- 2021An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognitioncited by 39
- 2019Impact of ASR on Alzheimer's Disease Detection: All Errors are Equal, but Deletions are More Equal than Otherscited by 8
- 2021Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Researchcited by 7
- 2023TRESTLE: Toolkit for Reproducible Execution of Speech, Text and Language Experimentscited by 4
- 2021Influence of ASR and Language Model on Alzheimer's Disease Detectioncited by 2
- 2022The Far Side of Failure: Investigating the Impact of Speech Recognition Errors on Subsequent Dementia Classificationcited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 5.
9 papers.
- 2024Speech Emotion Recognition with ASR Transcripts: A Comprehensive Study on Word Error Rate and Fusion Techniquescited by 15
- 2025Measuring the Effect of Transcription Noise on Downstream Language Understanding Taskscited by 7
- 2024Reexamining Racial Disparities in Automatic Speech Recognition Performance: The Role of Confounding by Provenancecited by 2
- 2024Not All Errors Are Equal: Investigation of Speech Recognition Errors in Alzheimer's Disease Detectioncited by 2
- 2026MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screeningcited by 1
- 2026Agentic Cognitive Profiling: Realigning Automated Alzheimer's Disease Detection with Clinical Construct Validitycited by 0
- 2026From Content to Audience: A Multimodal Annotation Framework for Broadcast Television Analyticscited by 0
- 2026From Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment Detectioncited by 0
- 2026Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scalingcited by 0
- 2026Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scaling4 Aug 2026
- 2026From Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment Detection26 Jun 2026
- 2026From Content to Audience: A Multimodal Annotation Framework for Broadcast Television Analytics24 Mar 2026
- 2026Agentic Cognitive Profiling: Realigning Automated Alzheimer's Disease Detection with Clinical Construct Validity18 Mar 2026
- 2026MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screening27 Feb 2026
- 2025Measuring the Effect of Transcription Noise on Downstream Language Understanding Tasks19 Feb 2025
- 2024Not All Errors Are Equal: Investigation of Speech Recognition Errors in Alzheimer's Disease Detection9 Dec 2024
- 2024Reexamining Racial Disparities in Automatic Speech Recognition Performance: The Role of Confounding by Provenance19 Jul 2024
- 2024Speech Emotion Recognition with ASR Transcripts: A Comprehensive Study on Word Error Rate and Fusion Techniques12 Jun 2024