mlsanityData to 14 Oct 2026

Deep Insights into Cognitive Decline: A Survey of Leveraging Non-Intrusive Modalities with Deep Learning Techniques

arXiv 2410.18972 ↗First posted 24 Oct 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Cognitive decline is a natural part of aging. However, under some circumstances, this decline is more pronounced than expected, typically due to disorders such as Alzheimer's disease. Early detection of an anomalous decline is crucial, as it can facilitate timely professional intervention. While medical data can help, it often involves invasive procedures. An alternative approach is to employ non-intrusive techniques such as speech or handwriting analysis, which do not disturb daily activities. This survey reviews the most relevant non-intrusive methodologies that use deep learning techniques to automate the cognitive decline detection task, including audio, text, and visual processing. We discuss the key features and advantages of each modality and methodology, including state-of-the-art approaches like Transformer architecture and foundation models. In addition, we present studies that integrate different modalities to develop multimodal models. We also highlight the most significant datasets and the quantitative results from studies using these resources. From this review, several conclusions emerge. In most cases, text-based approaches consistently outperform other modalities. Furthermore, combining various approaches from individual modalities into a multimodal model consistently enhances performance across nearly all scenarios.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 111 of its 312 references that are in the map. First posted on arXiv 24 Oct 2024.

Builds on

111 of 312 references.

References · 111

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  5. 2020Language Models are Few-Shot Learnerscited by 32,419
  6. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  7. 2023GPT-4 Technical Reportcited by 18,396
  8. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  9. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  10. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  11. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  12. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
38 more
  1. 2016Densely Connected Convolutional Networkscited by 6,720
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  6. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  7. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  8. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  9. 2014Going Deeper with Convolutionscited by 4,241
  10. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  11. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  12. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  13. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  14. 2020Longformer: The Long-Document Transformercited by 3,413
  15. 2016Wide Residual Networkscited by 3,070
  16. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  17. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  18. 2023A Survey of Large Language Modelscited by 2,576
  19. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  20. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  21. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  22. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  23. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
  24. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  25. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  26. 2021ViViT: A Video Vision Transformercited by 1,620
  27. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
  28. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  29. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
  30. 2021Video Swin Transformercited by 1,091
  31. 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,060
  32. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  33. 2021Transformers in Vision: A Surveycited by 1,013
  34. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  35. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 943
  36. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  37. 2016CNN Architectures for Large-Scale Audio Classificationcited by 704
  38. 2019VideoBERT: A Joint Model for Video and Language Representation Learningcited by 703

50 most cited of 111 All 111 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.