From Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment Detection
Not on the map. Why?
Abstract (arXiv)
Speech-based cognitive impairment detection offers a noninvasive, accessible alternative to costly biomarker assays, yet transformer-based models remain clinically uninterpretable. We propose a multi-stage explainability framework that translates black-box transformer predictions into clinically grounded narratives by integrating SHapley Additive exPlanations (SHAP)-based token attribution, theory-informed linguistic features, and a four-stage LLM reasoning pipeline using LLaMA-3.1-70B-Instruct. Built on the SpeechCARE-Adaptive Gating Network multimodal screening model (F1 = 72.11% on the NIA PREPARE benchmark), the framework maps model outputs to four cognitive-linguistic dimensions, including lexical richness, syntactic complexity, and semantic coherence. Physician evaluation on 70 stratified English samples demonstrated strong alignment with patient-level cognitive profiles, and a System Usability Scale score of 82/100 indicated high potential for clinical workflow integration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
12 of 24 references.
References · 12
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 236
- 2020Explaining the Explainer: A First Theoretical Analysis of LIMEcited by 89
- 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
- 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 66
- 2024A Closer Look into Mixture-of-Experts in Large Language Modelscited by 48
- 2021Explainable Identification of Dementia from Transcripts using Transformer Networkscited by 19
- 2024Useful Blunders: Can Automated Speech Recognition Errors Improve Downstream Dementia Classification?cited by 9
- 2025LLMCARE: early detection of cognitive impairment via transformer models enhanced by LLM-generated synthetic datacited by 8
- 2026The Voice of Equity: A Systematic Evaluation of Bias Mitigation Techniques for Speech-Based Cognitive Impairment Detection Across Architectures and Demographicscited by 2
- 2025National Institute on Aging PREPARE Challenge: Early Detection of Cognitive Impairment Using Speech -- The SpeechCARE Solutioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models
- 2025CogBench: A Large Language Model Benchmark for Multilingual Speech-Based Cognitive Impairment Assessment
- 2024Profiling Patient Transcript Using Large Language Model Reasoning Augmentation for Alzheimer's Disease Detection
- 2026LoRA-Tuned Large Language Models for Dementia Detection via Multi-View Speech-Derived Features
- 2026A Monosemantic Attribution Framework for Stable Interpretability in Clinical Neuroscience Transformer-Based Language Models
- 2026Fair Cognitive Impairment Detection Through Unlearning
- 2025NeuroXVocal: Detection and Explanation of Alzheimer's Disease through Non-invasive Analysis of Picture-prompted Speech
- 2026Cross-Linguistic Persona-Driven Data Synthesis for Robust Multimodal Cognitive Decline Detection