Reformulating NLP tasks to Capture Longitudinal Manifestation of Language Disorders in People with Dementia
Not on the map. Why?
Abstract (arXiv)
Dementia is associated with language disorders which impede communication. Here, we automatically learn linguistic disorder patterns by making use of a moderately-sized pre-trained language model and forcing it to focus on reformulated natural language processing (NLP) tasks and associated linguistic patterns. Our experiments show that NLP tasks that encapsulate contextual information and enhance the gradient signal with linguistic patterns benefit performance. We then use the probability estimates from the best model to construct digital linguistic markers measuring the overall quality in communication and the intensity of a variety of language disorders. We investigate how the digital markers characterize dementia speech from a longitudinal perspective. We find that our proposed communication marker is able to robustly and reliably characterize the language of people with dementia, outperforming existing linguistic approaches; and shows external validity via significant correlation with clinical markers of behaviour. Finally, our proposed linguistic disorder markers provide useful insights into gradual language impairment associated with disease progression.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 61 references that are in the map. First posted on arXiv 15 Oct 2023.
Builds on
17 of 61 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
- 2021Entailment as Few-Shot Learnercited by 122
- 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
- 2021Improving and Simplifying Pattern Exploiting Trainingcited by 97
- 2020Towards Learning a Universal Non-Semantic Representation of Speechcited by 84
- 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
- 2020To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detectioncited by 49
5 more
- 2021Alzheimer's Dementia Recognition Using Acoustic, Lexical, Disfluency and Speech Pause Features Robust to Noisy Inputscited by 27
- 2018Detecting Linguistic Characteristics of Alzheimer's Dementia by Interpreting Neural Modelscited by 19
- 2022Learning Better Masking for Better Language Model Pre-trainingcited by 14
- 2019A Review of Automated Speech and Language Features for Assessment of Cognitive and Thought Disorderscited by 11
- 2022Pre-trained Token-replaced Detection Model as Few-shot Learnercited by 7
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 2.
4 papers.
- 2024A Systematic Review of NLP for Dementia -- Tasks, Datasets and Opportunitiescited by 4
- 2024Profiling Patient Transcript Using Large Language Model Reasoning Augmentation for Alzheimer's Disease Detectioncited by 2
- 2026What Do LLMs Know About Alzheimer's Disease? Multi-loss Fine-Tuning and Probing for AD Detectioncited by 0
- 2026Fair Cognitive Impairment Detection Through Unlearningcited by 0
- 2026Fair Cognitive Impairment Detection Through Unlearning17 Jun 2026
- 2026What Do LLMs Know About Alzheimer's Disease? Multi-loss Fine-Tuning and Probing for AD Detection20 Jan 2026
- 2024A Systematic Review of NLP for Dementia -- Tasks, Datasets and Opportunities29 Sep 2024
- 2024Profiling Patient Transcript Using Large Language Model Reasoning Augmentation for Alzheimer's Disease Detection19 Sep 2024