Dementia Through Different Eyes: Explainable Modeling of Human and LLM Perceptions for Early Awareness
Not on the map. Why?
Abstract (arXiv)
Cognitive decline often surfaces in language years before diagnosis. It is frequently non-experts, such as those closest to the patient, who first sense a change and raise concern. As LLMs become integrated into daily communication and used over prolonged periods, it may even be an LLM that notices something is off. But what exactly do they notice--and should be noticing--when making that judgment? This paper investigates how dementia is perceived through language by non-experts. We presented transcribed picture descriptions to non-expert humans and LLMs, asking them to intuitively judge whether each text was produced by someone healthy or with dementia. We introduce an explainable method that uses LLMs to extract high-level, expert-guided features representing these picture descriptions, and use logistic regression to model human and LLM perceptions and compare with clinical diagnoses. Our analysis reveals that human perception of dementia is inconsistent and relies on a narrow, and sometimes misleading, set of cues. LLMs, by contrast, draw on a richer, more nuanced feature set that aligns more closely with clinical patterns. Still, both groups show a tendency toward false negatives, frequently overlooking dementia cases. Through our interpretable framework and the insights it provides, we hope to help non-experts better recognize the linguistic signs that matter.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 123 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
19 of 123 references.
References · 19
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 205
- 2023AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotatorscited by 172
- 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 143
- 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
- 2020Interpretability of machine learning based prediction models in healthcarecited by 75
- 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMscited by 74
- 2023Two Directions for Clinical Data Generation with Large Language Models: Data-to-Label and Label-to-Datacited by 26
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 25
- 2024Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performancecited by 20
7 more
- 2018Detecting Linguistic Characteristics of Alzheimer's Dementia by Interpreting Neural Modelscited by 19
- 2021Explainable Identification of Dementia from Transcripts using Transformer Networkscited by 19
- 2024LLM-based feature generation from text for interpretable machine learningcited by 13
- 2020On the Relationships Between the Grammatical Genders of Inanimate Nouns and Their Co-Occurring Adjectives and Verbscited by 8
- 2024A Systematic Review of NLP for Dementia -- Tasks, Datasets and Opportunitiescited by 4
- 2017Idea density for predicting Alzheimer's disease from transcribed speechcited by 3
- 2024Bored to Death: Artificial Intelligence Research Reveals the Role of Boredom in Suicide Behaviorcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.