mlsanityData to 7 Oct 2026

Beyond surface form: A pipeline for semantic analysis in Alzheimer's Disease detection from spontaneous speech

arXiv 2512.13685 ↗First posted 15 Dec 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Alzheimer's Disease (AD) is a progressive neurodegenerative condition that adversely affects cognitive abilities. Language-related changes can be automatically identified through the analysis of outputs from linguistic assessment tasks, such as picture description. Language models show promise as a basis for screening tools for AD, but their limited interpretability poses a challenge in distinguishing true linguistic markers of cognitive decline from surface-level textual patterns. To address this issue, we examine how surface form variation affects classification performance, with the goal of assessing the ability of language models to represent underlying semantic indicators. We introduce a novel approach where texts surface forms are transformed by altering syntax and vocabulary while preserving semantic content. The transformations significantly modify the structure and lexical content, as indicated by low BLEU and chrF scores, yet retain the underlying semantics, as reflected in high semantic similarity scores, isolating the effect of semantic information, and finding models perform similarly to if they were using the original text, with only small deviations in macro-F1. We also investigate whether language from picture descriptions retains enough detail to reconstruct the original image using generative models. We found that image-based transformations add substantial noise reducing classification accuracy. Our methodology provides a novel way of looking at what features influence model predictions, and allows the removal of possible spurious correlations. We find that just using semantic information, language model based classifiers can still detect AD. This work shows that difficult to detect semantic impairment can be identified, addressing an overlooked feature of linguistic deterioration, and opening new pathways for early detection systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 58 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

15 of 58 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  9. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  10. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
  11. 2020A Primer in BERTology: What we know about how BERT workscited by 807
  12. 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
3 more
  1. 2020To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detectioncited by 49
  2. 2022GPT-D: Inducing Dementia-related Linguistic Anomalies by Deliberate Degradation of Artificial Neural Language Modelscited by 8
  3. 2024Linguistic Features Extracted by GPT-4 Improve Alzheimer's Disease Detection based on Spontaneous Speechcited by 8

Built on by

Not cited yet.