mlsanityData to 7 Oct 2026

Reformulating NLP tasks to Capture Longitudinal Manifestation of Language Disorders in People with Dementia

arXiv 2310.09897 ↗First posted 15 Oct 2023cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Dementia is associated with language disorders which impede communication. Here, we automatically learn linguistic disorder patterns by making use of a moderately-sized pre-trained language model and forcing it to focus on reformulated natural language processing (NLP) tasks and associated linguistic patterns. Our experiments show that NLP tasks that encapsulate contextual information and enhance the gradient signal with linguistic patterns benefit performance. We then use the probability estimates from the best model to construct digital linguistic markers measuring the overall quality in communication and the intensity of a variety of language disorders. We investigate how the digital markers characterize dementia speech from a longitudinal perspective. We find that our proposed communication marker is able to robustly and reliably characterize the language of people with dementia, outperforming existing linguistic approaches; and shows external validity via significant correlation with clinical markers of behaviour. Finally, our proposed linguistic disorder markers provide useful insights into gradual language impairment associated with disease progression.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 61 references that are in the map. First posted on arXiv 15 Oct 2023.

Builds on

17 of 61 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  5. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  6. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
  7. 2021Entailment as Few-Shot Learnercited by 122
  8. 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
  9. 2021Improving and Simplifying Pattern Exploiting Trainingcited by 97
  10. 2020Towards Learning a Universal Non-Semantic Representation of Speechcited by 84
  11. 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
  12. 2020To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detectioncited by 49
5 more
  1. 2021Alzheimer's Dementia Recognition Using Acoustic, Lexical, Disfluency and Speech Pause Features Robust to Noisy Inputscited by 27
  2. 2018Detecting Linguistic Characteristics of Alzheimer's Dementia by Interpreting Neural Modelscited by 19
  3. 2022Learning Better Masking for Better Language Model Pre-trainingcited by 14
  4. 2019A Review of Automated Speech and Language Features for Assessment of Cognitive and Thought Disorderscited by 11
  5. 2022Pre-trained Token-replaced Detection Model as Few-shot Learnercited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 2.

4 papers.