A Review of Deep Learning Approaches for Non-Invasive Cognitive Impairment Detection
Not on the map. Why?
Abstract (arXiv)
This review paper explores recent advances in deep learning approaches for non-invasive cognitive impairment detection. We examine various non-invasive indicators of cognitive decline, including speech and language, facial, and motoric mobility. The paper provides an overview of relevant datasets, feature-extracting techniques, and deep-learning architectures applied to this domain. We have analyzed the performance of different methods across modalities and observed that speech and language-based methods generally achieved the highest detection performance. Studies combining acoustic and linguistic features tended to outperform those using a single modality. Facial analysis methods showed promise for visual modalities but were less extensively studied. Most papers focused on binary classification (impaired vs. non-impaired), with fewer addressing multi-class or regression tasks. Transfer learning and pre-trained language models emerged as popular and effective techniques, especially for linguistic analysis. Despite significant progress, several challenges remain, including data standardization and accessibility, model explainability, longitudinal analysis limitations, and clinical adaptation. Lastly, we propose future research directions, such as investigating language-agnostic speech analysis methods, developing multi-modal diagnostic systems, and addressing ethical considerations in AI-assisted healthcare. By synthesizing current trends and identifying key obstacles, this review aims to guide further development of deep learning-based cognitive impairment detection systems to improve early diagnosis and ultimately patient outcomes.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 45 of its 168 references that are in the map. First posted on arXiv 25 Oct 2024.
Builds on
45 of 168 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
33 more
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
- 2019Interpretable machine learning: definitions, methods, and applicationscited by 303
- 2020Transfer Learning in Deep Reinforcement Learning: A Surveycited by 259
- 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 230
- 2017What do we need to build explainable AI systems for the medical domain?cited by 127
- 2020Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challengescited by 120
- 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
- 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
- 2023A Review of Deep Learning Techniques for Speech Processingcited by 52
- 2021Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubscited by 28
- 2023Deep Transfer Learning for Automatic Speech Recognition: Towards Better Generalizationcited by 28
- 2021Alzheimer's Dementia Recognition Using Acoustic, Lexical, Disfluency and Speech Pause Features Robust to Noisy Inputscited by 27
- 2020Exploiting Multi-Modal Features From Pre-trained Networks for Alzheimer's Dementia Recognitioncited by 20
- 2021Multi-modal fusion with gating using audio, lexical and disfluency features for Alzheimer's Dementia recognition from spontaneous speechcited by 16
- 2020Comparing Natural Language Processing Techniques for Alzheimer's Dementia Prediction in Spontaneous Speechcited by 14
- 2023Leveraging Pretrained Representations with Task-related Keywords for Alzheimer's Disease Detectioncited by 11
- 2023MC-ViViT: Multi-branch Classifier-ViViT to detect Mild Cognitive Impairment in older adults using facial videoscited by 11
- 2021ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimationcited by 10
- 2021Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networkscited by 6
- 2018Detecting Alzheimer's Disease Using Gated Convolutional Neural Network from Audio Datacited by 5
- 2020Multi-Modal Detection of Alzheimer's Disease from Speech and Textcited by 5
- 2021XnODR and XnIDR: Two Accurate and Fast Fully Connected Layers For Convolutional Neural Networkscited by 5
- 2023Detection of Mild Cognitive Impairment Using Facial Features in Video Conversationscited by 5
- 2019Unexplainability and Incomprehensibility of Artificial Intelligencecited by 4
- 2020Explainable CNN-attention Networks (C-Attention Network) for Automated Detection of Alzheimer's Diseasecited by 4
- 2023Deep Learning-based Eye-Tracking Analysis for Diagnosis of Alzheimer's Disease Using 3D Comprehensive Visual Stimulicited by 3
- 2024Linguistic-Based Mild Cognitive Impairment Detection Using Informative Losscited by 3
- 2020Speech Paralinguistic Approach for Detecting Dementia Using Gated Convolutional Neural Networkcited by 2
- 2023GANalyzer: Analysis and Manipulation of GANs Latent Space for Controllable Face Synthesiscited by 2
- 2020Alzheimer's Dementia Detection from Audio and Text Modalitiescited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025Dementia classification from spontaneous speech using wrapper-based feature selectioncited by 0
- 2026Contrastive learning-based video quality assessment-jointed video vision transformer for video recognitioncited by 0
- 2026Transcript-Free Lightweight Detection of Alzheimer's Disease from Spontaneous Speech Using Handcrafted MFCC-Dominant Acoustic Biomarkerscited by 0
- 2026Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Modelscited by 0
- 2026LSEAD: A Privacy-Preserving LLM-Based Speech Analysis Framework for Early Alzheimer's Disease Screeningcited by 0
- 2026LSEAD: A Privacy-Preserving LLM-Based Speech Analysis Framework for Early Alzheimer's Disease Screening7 Aug 2026
- 2026Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models23 Jul 2026
- 2026Transcript-Free Lightweight Detection of Alzheimer's Disease from Spontaneous Speech Using Handcrafted MFCC-Dominant Acoustic Biomarkers11 Jul 2026
- 2026Contrastive learning-based video quality assessment-jointed video vision transformer for video recognition11 Mar 2026
- 2025Dementia classification from spontaneous speech using wrapper-based feature selection4 Feb 2025