Temporal-Aware Iterative Speech Model for Dementia Detection
Not on the map. Why?
Abstract (arXiv)
Deep learning systems often struggle with processing long sequences, where computational complexity can become a bottleneck. Current methods for automated dementia detection using speech frequently rely on static, time-agnostic features or aggregated linguistic content, lacking the flexibility to model the subtle, progressive deterioration inherent in speech production. These approaches often miss the dynamic temporal patterns that are critical early indicators of cognitive decline. In this paper, we introduce TAI-Speech, a Temporal Aware Iterative framework that dynamically models spontaneous speech for dementia detection. The flexibility of our method is demonstrated through two key innovations: 1) Optical Flow-inspired Iterative Refinement: By treating spectrograms as sequential frames, this component uses a convolutional GRU to capture the fine-grained, frame-to-frame evolution of acoustic features. 2) Cross-Attention Based Prosodic Alignment: This component dynamically aligns spectral features with prosodic patterns, such as pitch and pauses, to create a richer representation of speech production deficits linked to functional decline (IADL). TAI-Speech adaptively models the temporal evolution of each utterance, enhancing the detection of cognitive markers. Experimental results on the DementiaBank dataset show that TAI-Speech achieves a strong AUC of 0.839 and 80.6% accuracy, outperforming text-based baselines without relying on ASR. Our work provides a more flexible and robust solution for automated cognitive assessment, operating directly on the dynamics of raw audio.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
12 of 36 references.
References · 12
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2021AST: Audio Spectrogram Transformercited by 643
- 2022CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flowcited by 82
- 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
- 2024Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognitioncited by 63
- 2023Context-aware attention layers coupled with optimal transport domain adaptation and multimodal fusion methods for recognizing dementia from spontaneous speechcited by 5
- 2024Infusing Acoustic Pause Context into Text-Based Dementia Assessmentcited by 5
- 2023Generative Context-aware Fine-tuning of Self-supervised Speech Modelscited by 3
- 2024Prosody-Driven Privacy-Preserving Dementia Detectioncited by 3
- 2021A Longitudinal Multi-modal Dataset for Dementia Monitoring and Diagnosiscited by 2
- 2024Profiling Patient Transcript Using Large Language Model Reasoning Augmentation for Alzheimer's Disease Detectioncited by 2
- 2024Dementia Detection using Multi-modal Methods on Audio Datacited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.