mlsanityData to 14 Oct 2026

LLMCARE: early detection of cognitive impairment via transformer models enhanced by LLM-generated synthetic data

arXiv 2508.10027 ↗First posted 8 Aug 2025cs.CL cs.AIcited by 8

On the map: Synthetic data and self-improvement for LLMs → Medical synthetic data and agents

Abstract (arXiv)

Alzheimer's disease and related dementias(ADRD) affect nearly five million older adults in the United States, yet more than half remain undiagnosed. Speech-based natural language processing(NLP) offers a scalable approach for detecting early cognitive decline through subtle linguistic markers that may precede clinical diagnosis. This study develops and evaluates a speech-based screening pipeline integrating transformer embeddings with handcrafted linguistic features, synthetic augmentation using large language models(LLMs), and benchmarking of unimodal and multimodal classifiers. External validation assessed generalizability to a MCI-only cohort. Transcripts were drawn from the ADReSSo 2021 benchmark dataset(n=237, Pitt Corpus) and the DementiaBank Delaware corpus(n=205, MCI vs. controls). Ten transformer models were tested under three fine-tuning strategies. A late-fusion model combined embeddings from the top transformer with 110 linguistic features. Five LLMs(LLaMA8B/70B, MedAlpaca7B, Ministral8B,GPT-4o) generated label-conditioned synthetic speech for augmentation, and three multimodal LLMs(GPT-4o,Qwen-Omni,Phi-4) were evaluated in zero-shot and fine-tuned modes. On ADReSSo, the fusion model achieved F1=83.3(AUC=89.5), outperforming transformer-only and linguistic baselines. MedAlpaca7B augmentation(2x) improved F1=85.7, though larger scales reduced gains. Fine-tuning boosted unimodal LLMs(MedAlpaca7B F1=47.7=>78.7), while multimodal models performed lower (Phi-4=71.6;GPT-4o=67.6). On Delaware, the fusion plus 1x MedAlpaca7B model achieved F1=72.8(AUC=69.6). Integrating transformer and linguistic features enhances ADRD detection. LLM-based augmentation improves data efficiency but yields diminishing returns, while current multimodal models remain limited. Validation on an independent MCI cohort supports the pipeline's potential for scalable, clinically relevant early screening.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Medical synthetic data and agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 24 of its 81 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

24 of 81 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Synthetic Data Generation with LLM for Improved Depression Prediction26 Nov
  2. 2024Utilizing Large Language Models to Generate Synthetic Data to Increase the Performance of BERT-Based Neural Networks8 May

Other references · 22

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  7. 2020Longformer: The Long-Document Transformercited by 3,413
  8. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  9. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  10. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  11. 2025Qwen2.5-Omni Technical Reportcited by 736
  12. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
10 more
  1. 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 299
  2. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 286
  3. 2024A Survey on Speech Large Language Models for Understandingcited by 71
  4. 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 69
  5. 2023Large Language Models to Identify Social Determinants of Health in Electronic Health Recordscited by 55
  6. 2020To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detectioncited by 49
  7. 2020Exploiting Multi-Modal Features From Pre-trained Networks for Alzheimer's Dementia Recognitioncited by 20
  8. 2021Explainable Identification of Dementia from Transcripts using Transformer Networkscited by 19
  9. 2021Alzheimer's Disease Detection from Spontaneous Speech through Combining Linguistic Complexity and (Dis)Fluency Features with Pretrained Language Modelscited by 13
  10. 2018The relationship between linguistic expression and symptoms of depression, anxiety, and suicidal thoughts: A longitudinal study of blog contentcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 6.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Profiling Patient Transcript Using Large Language Model Reasoning Augmentation for Alzheimer's Disease Detection
  2. 2025CogBench: A Large Language Model Benchmark for Multilingual Speech-Based Cognitive Impairment Assessment
  3. 2026LoRA-Tuned Large Language Models for Dementia Detection via Multi-View Speech-Derived Features
  4. 2026ADRD-Bench: A Preliminary LLM Benchmark for Alzheimer's Disease and Related Dementias
  5. 2025AD-GPT: Large Language Models in Alzheimer's Disease
  6. 2026Chain-of-Thought Reasoning with Large Language Models for Clinical Alzheimer's Disease Assessment and Diagnosis
  7. 2026A Monosemantic Attribution Framework for Stable Interpretability in Clinical Neuroscience Transformer-Based Language Models
  8. 2025Reasoning-Based Approach with Chain-of-Thought for Alzheimer's Detection Using Speech and Large Language Models