mlsanityData to 7 Oct 2026

Cross-Linguistic Persona-Driven Data Synthesis for Robust Multimodal Cognitive Decline Detection

arXiv 2602.07978 ↗First posted 8 Feb 2026cs.CLcited by 0

On the map: Synthetic data and self-improvement for LLMs → Medical synthetic data and agents

Abstract (arXiv)

Speech-based digital biomarkers represent a scalable, non-invasive frontier for the early identification of Mild Cognitive Impairment (MCI). However, the development of robust diagnostic models remains impeded by acute clinical data scarcity and a lack of interpretable reasoning. Current solutions frequently struggle with cross-lingual generalization and fail to provide the transparent rationales essential for clinical trust. To address these barriers, we introduce SynCog, a novel framework integrating controllable zero-shot multimodal data synthesis with Chain-of-Thought (CoT) deduction fine-tuning. Specifically, SynCog simulates diverse virtual subjects with varying cognitive profiles to effectively alleviate clinical data scarcity. This generative paradigm enables the rapid, zero-shot expansion of clinical corpora across diverse languages, effectively bypassing data bottlenecks in low-resource settings and bolstering the diagnostic performance of Multimodal Large Language Models (MLLMs). Leveraging this synthesized dataset, we fine-tune a foundational multimodal backbone using a CoT deduction strategy, empowering the model to explicitly articulate diagnostic thought processes rather than relying on black-box predictions. Extensive experiments on the ADReSS and ADReSSo benchmarks demonstrate that augmenting limited clinical data with synthetic phenotypes yields competitive diagnostic performance, achieving Macro-F1 scores of 80.67% and 78.46%, respectively, outperforming current baseline models. Furthermore, evaluation on an independent real-world Mandarin cohort (CIR-E) demonstrates robust cross-linguistic generalization, attaining a Macro-F1 of 48.71%. These findings constitute a critical step toward providing clinically trustworthy and linguistically inclusive cognitive assessment tools for global healthcare.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical synthetic data and agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 17 of its 31 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

17 of 31 references.

References · 17

  1. 2024GPT-4o System Cardcited by 4,467
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  4. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  5. 2025Qwen2.5-Omni Technical Reportcited by 704
  6. 2024Phi-4 Technical Reportcited by 675
  7. 2024Qwen2-Audio Technical Reportcited by 543
  8. 2025Qwen3-Omni Technical Reportcited by 451
  9. 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 115
  10. 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 109
  11. 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
  12. 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 85
5 more
  1. 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
  2. 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 64
  3. 2023Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Supervision, and LLM Mix-up Augmentationcited by 19
  4. 2025Evaluating Spoken Language as a Biomarker for Automated Screening of Cognitive Impairmentcited by 5
  5. 2025CogBench: A Large Language Model Benchmark for Multilingual Speech-Based Cognitive Impairment Assessmentcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models
  2. 2026Chain-of-Thought Reasoning with Large Language Models for Clinical Alzheimer's Disease Assessment and Diagnosis
  3. 2026From Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment Detection
  4. 2025LLMCARE: early detection of cognitive impairment via transformer models enhanced by LLM-generated synthetic data
  5. 2026LoRA-Tuned Large Language Models for Dementia Detection via Multi-View Speech-Derived Features
  6. 2025Data-Efficient Fine-Tuning of Vision-Language Models for Diagnosis of Alzheimer's Disease
  7. 2026Toward Personalized Digital Twins for Cognitive Decline Assessment: A Multimodal, Uncertainty-Aware Framework
  8. 2025National Institute on Aging PREPARE Challenge: Early Detection of Cognitive Impairment Using Speech -- The SpeechCARE Solution