Linguistic-Based Mild Cognitive Impairment Detection Using Informative Loss
Not on the map. Why?
Abstract (arXiv)
This paper presents a deep learning method using Natural Language Processing (NLP) techniques, to distinguish between Mild Cognitive Impairment (MCI) and Normal Cognitive (NC) conditions in older adults. We propose a framework that analyzes transcripts generated from video interviews collected within the I-CONECT study project, a randomized controlled trial aimed at improving cognitive functions through video chats. Our proposed NLP framework consists of two Transformer-based modules, namely Sentence Embedding (SE) and Sentence Cross Attention (SCA). First, the SE module captures contextual relationships between words within each sentence. Subsequently, the SCA module extracts temporal features from a sequence of sentences. This feature is then used by a Multi-Layer Perceptron (MLP) for the classification of subjects into MCI or NC. To build a robust model, we propose a novel loss function, called InfoLoss, that considers the reduction in entropy by observing each sequence of sentences to ultimately enhance the classification accuracy. The results of our comprehensive model evaluation using the I-CONECT dataset show that our framework can distinguish between MCI and NC with an average area under the curve of 84.75%.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 68 references that are in the map. First posted on arXiv 23 Jan 2024.
Builds on
25 of 68 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
13 more
- 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 254
- 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
- 2019A Repository of Conversational Datasetscited by 45
- 2021Multi-modal fusion with gating using audio, lexical and disfluency features for Alzheimer's Dementia recognition from spontaneous speechcited by 16
- 2020The INESC-ID Multi-Modal System for the ADReSS 2020 Challengecited by 15
- 2023MC-ViViT: Multi-branch Classifier-ViViT to detect Mild Cognitive Impairment in older adults using facial videoscited by 11
- 2021ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimationcited by 10
- 2017Enriching Complex Networks with Word Embeddings for Detecting Mild Cognitive Impairment from Speech Transcriptscited by 7
- 2022ACR Loss: Adaptive Coordinate-based Regression Loss for Face Alignmentcited by 7
- 2021Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networkscited by 6
- 2023Detection of Mild Cognitive Impairment Using Facial Features in Video Conversationscited by 5
- 2020Refining Automatic Speech Recognition System for older adultscited by 3
- 2023GANalyzer: Analysis and Manipulation of GANs Latent Space for Controllable Face Synthesiscited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 1.
3 papers.