mlsanityData to 14 Oct 2026

Alzheimer's Dementia Recognition Using Acoustic, Lexical, Disfluency and Speech Pause Features Robust to Noisy Inputs

arXiv 2106.15684 ↗First posted 29 Jun 2021cs.CL cs.SD eess.AScited by 27

Not on the map. Why?

Abstract (arXiv)

We present two multimodal fusion-based deep learning models that consume ASR transcribed speech and acoustic data simultaneously to classify whether a speaker in a structured diagnostic task has Alzheimer's Disease and to what degree, evaluating the ADReSSo challenge 2021 data. Our best model, a BiLSTM with highway layers using words, word probabilities, disfluency features, pause information, and a variety of acoustic features, achieves an accuracy of 84% and RSME error prediction of 4.26 on MMSE cognitive scores. While predicting cognitive decline is more challenging, our models show improvement using the multimodal approach and word probabilities, disfluency and pause information over word-only models. We show considerable gains for AD classification using multimodal fusion and gating, which can effectively deal with noisy inputs from acoustic features and ASR hypotheses.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 5 of its 25 references that are in the map. First posted on arXiv 29 Jun 2021.

Builds on

5 of 25 references.

References · 5

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015Highway Networkscited by 260
  3. 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
  4. 2021Multi-modal fusion with gating using audio, lexical and disfluency features for Alzheimer's Dementia recognition from spontaneous speechcited by 16
  5. 2020Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 3; 2023: 6; 2024: 8; 2025: 5; 2026: 4.

27 papers.

Sort:

  1. 2021Detecting Dementia from Speech and Transcripts using Transformerscited by 13
  2. 2022Exploring linguistic feature and model combination for speech recognition based automatic AD detectioncited by 9
  3. 2024Self-supervised ASR Models and Features For Dysarthric and Elderly Speech Recognitioncited by 9
  4. 2025CogniAlign: Word-Level Multimodal Speech Alignment with Gated Cross-Attention for Alzheimer's Detectioncited by 7
  5. 2022Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detectioncited by 6
  6. 2023Fillers in Spoken Language Understanding: Computational and Psycholinguistic Perspectivescited by 5
  7. 2023Context-aware attention layers coupled with optimal transport domain adaptation and multimodal fusion methods for recognizing dementia from spontaneous speechcited by 5
  8. 2024A Review of Deep Learning Approaches for Non-Invasive Cognitive Impairment Detectioncited by 5
  9. 2023Transferring speech-generic and depression-specific knowledge for Alzheimer's disease detectioncited by 4
  10. 2023A Digital Language Coherence Marker for Monitoring Dementiacited by 4
  11. 2023Reformulating NLP tasks to Capture Longitudinal Manifestation of Language Disorders in People with Dementiacited by 4
  12. 2024HAFFormer: A Hierarchical Attention-Free Framework for Alzheimer's Disease Detection From Spontaneous Speechcited by 4
15 more
  1. 2024A Systematic Review of NLP for Dementia -- Tasks, Datasets and Opportunitiescited by 4
  2. 2024Performance Assessment of ChatGPT vs Bard in Detecting Alzheimer's Dementiacited by 3
  3. 2023Learning Co-Speech Gesture for Multimodal Aphasia Type Detectioncited by 2
  4. 2024Speech Technology Services for Oral History Researchcited by 2
  5. 2024Automatic Prediction of Amyotrophic Lateral Sclerosis Progression using Longitudinal Speech Transformercited by 2
  6. 2025WhisperD: Dementia Speech Recognition and Filler Word Detection with Whispercited by 2
  7. 2022Impact of Environmental Noise on Alzheimer's Disease Detection from Speech: Should You Let a Baby Cry?cited by 1
  8. 2024Deep Insights into Cognitive Decline: A Survey of Leveraging Non-Intrusive Modalities with Deep Learning Techniquescited by 1
  9. 2025CogBench: A Large Language Model Benchmark for Multilingual Speech-Based Cognitive Impairment Assessmentcited by 1
  10. 2025Recognizing Dementia from Neuropsychological Tests with State Space Modelscited by 0
  11. 2025Foundation Model-based Evaluation of Neuropsychiatric Disorders: A Lifespan-Inclusive, Multi-Modal, and Multi-Lingual Studycited by 0
  12. 2026What Do LLMs Know About Alzheimer's Disease? Multi-loss Fine-Tuning and Probing for AD Detectioncited by 0
  13. 2026Behind the [MASK]: Disentangling Representation and Faithfulness in DAPF-Based Dementia Detectioncited by 0
  14. 2026Why Alzheimer's Speech Screening Fails to Generalize: Bridging the Deployment Gap via Cross-Corpus Evidence Anchoringcited by 0
  15. 2026Explainable and Generalisable LLM-based Cognitive Decline Detection with Spontaneous Speechcited by 0