Cross-Linguistic Persona-Driven Data Synthesis for Robust Multimodal Cognitive Decline Detection
On the map: Synthetic data and self-improvement for LLMs → Medical synthetic data and agents
Abstract (arXiv)
Speech-based digital biomarkers represent a scalable, non-invasive frontier for the early identification of Mild Cognitive Impairment (MCI). However, the development of robust diagnostic models remains impeded by acute clinical data scarcity and a lack of interpretable reasoning. Current solutions frequently struggle with cross-lingual generalization and fail to provide the transparent rationales essential for clinical trust. To address these barriers, we introduce SynCog, a novel framework integrating controllable zero-shot multimodal data synthesis with Chain-of-Thought (CoT) deduction fine-tuning. Specifically, SynCog simulates diverse virtual subjects with varying cognitive profiles to effectively alleviate clinical data scarcity. This generative paradigm enables the rapid, zero-shot expansion of clinical corpora across diverse languages, effectively bypassing data bottlenecks in low-resource settings and bolstering the diagnostic performance of Multimodal Large Language Models (MLLMs). Leveraging this synthesized dataset, we fine-tune a foundational multimodal backbone using a CoT deduction strategy, empowering the model to explicitly articulate diagnostic thought processes rather than relying on black-box predictions. Extensive experiments on the ADReSS and ADReSSo benchmarks demonstrate that augmenting limited clinical data with synthetic phenotypes yields competitive diagnostic performance, achieving Macro-F1 scores of 80.67% and 78.46%, respectively, outperforming current baseline models. Furthermore, evaluation on an independent real-world Mandarin cohort (CIR-E) demonstrates robust cross-linguistic generalization, attaining a Macro-F1 of 48.71%. These findings constitute a critical step toward providing clinically trustworthy and linguistically inclusive cognitive assessment tools for global healthcare.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical synthetic data and agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 17 of its 31 references that are in the map. First posted on arXiv 8 Feb 2026.
Builds on
17 of 31 references.
References · 17
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2025Qwen2.5-Omni Technical Reportcited by 704
- 2024Phi-4 Technical Reportcited by 675
- 2024Qwen2-Audio Technical Reportcited by 543
- 2025Qwen3-Omni Technical Reportcited by 451
- 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 115
- 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 109
- 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
- 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 85
5 more
- 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 64
- 2023Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Supervision, and LLM Mix-up Augmentationcited by 19
- 2025Evaluating Spoken Language as a Biomarker for Automated Screening of Cognitive Impairmentcited by 5
- 2025CogBench: A Large Language Model Benchmark for Multilingual Speech-Based Cognitive Impairment Assessmentcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models
- 2026Chain-of-Thought Reasoning with Large Language Models for Clinical Alzheimer's Disease Assessment and Diagnosis
- 2026From Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment Detection
- 2025LLMCARE: early detection of cognitive impairment via transformer models enhanced by LLM-generated synthetic data
- 2026LoRA-Tuned Large Language Models for Dementia Detection via Multi-View Speech-Derived Features
- 2025Data-Efficient Fine-Tuning of Vision-Language Models for Diagnosis of Alzheimer's Disease
- 2026Toward Personalized Digital Twins for Cognitive Decline Assessment: A Multimodal, Uncertainty-Aware Framework
- 2025National Institute on Aging PREPARE Challenge: Early Detection of Cognitive Impairment Using Speech -- The SpeechCARE Solution