mlsanityData to 14 Oct 2026

Exploiting Longitudinal Speech Sessions via Voice Assistant Systems for Early Detection of Cognitive Decline

arXiv 2410.12885 ↗First posted 16 Oct 2024eess.AS cs.CL q-bio.QMcited by 3

Not on the map. Why?

Abstract (arXiv)

Mild Cognitive Impairment (MCI) is an early stage of Alzheimer's disease (AD), a form of neurodegenerative disorder. Early identification of MCI is crucial for delaying its progression through timely interventions. Existing research has demonstrated the feasibility of detecting MCI using speech collected from clinical interviews or digital devices. However, these approaches typically analyze data collected at limited time points, limiting their ability to identify cognitive changes over time. This paper presents a longitudinal study using voice assistant systems (VAS) to remotely collect seven-session speech data at three-month intervals across 18 months. We propose two methods to improve MCI detection and the prediction of cognitive changes. The first method incorporates historical data, while the second predicts cognitive changes at two time points. Our results indicate improvements when incorporating historical data: the average F1-score for MCI detection improves from 58.6% to 71.2% (by 12.6%) in the case of acoustic features and from 62.1% to 75.1% (by 13.0%) in the case of linguistic features. Additionally, the prediction of cognitive changes achieves an F1-score of 73.7% in the case of acoustic features. These results confirm the potential of VAS-based speech sessions for early detection of cognitive decline.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 11 of its 37 references that are in the map. First posted on arXiv 16 Oct 2024.

Builds on

11 of 37 references.

References · 11

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  5. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  6. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 666
  7. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  8. 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
  9. 2023ML-SUPERB: Multilingual Speech Universal PERformance Benchmarkcited by 71
  10. 2021Explainable Identification of Dementia from Transcripts using Transformer Networkscited by 19
  11. 2016The Dem@Care Experiments and Datasets: a Technical Reportcited by 7

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.

  1. 2025Unveil Multi-Picture Descriptions for Multilingual Mild Cognitive Impairment Detection via Contrastive Learningcited by 1
  2. 2025Cog-TiPRO: Iterative Prompt Refinement with LLMs to Detect Cognitive Decline via Longitudinal Voice Assistant Commandscited by 0
  3. 2025Explainable Graph Neural Networks: Understanding Brain Connectivity and Biomarkers in Dementiacited by 0