Large language models improve Alzheimer's disease diagnosis using multi-modality data
Not on the map. Why?
Abstract (arXiv)
In diagnosing challenging conditions such as Alzheimer's disease (AD), imaging is an important reference. Non-imaging patient data such as patient information, genetic data, medication information, cognitive and memory tests also play a very important role in diagnosis. Effect. However, limited by the ability of artificial intelligence models to mine such information, most of the existing models only use multi-modal image data, and cannot make full use of non-image data. We use a currently very popular pre-trained large language model (LLM) to enhance the model's ability to utilize non-image data, and achieved SOTA results on the ADNI dataset.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 26 May 2023.
Builds on
18 of 31 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2022A ConvNet for the 2020scited by 3,545
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
- 2022Multimodal Learning with Transformers: A Surveycited by 399
6 more
- 2023ChatCAD: Interactive Computer-Aided Diagnosis on Medical Image using Large Language Modelscited by 116
- 2022Feature robustness and sex differences in medical imaging: a case study in MRI-based Alzheimer's disease detectioncited by 19
- 2023DPIC: Decoupling Prompt and Intrinsic Characteristics for LLM Generated Text Detectioncited by 18
- 2023Gene Set Summarization using Large Language Modelscited by 12
- 2022Multi-Modal Hypergraph Diffusion Network with Dual Prior for Alzheimer Classificationcited by 9
- 2019Multi-scale Graph-based Grading for Alzheimer's Disease Predictioncited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 3; 2026: 1.
9 papers.
- 2024DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer's Disease Questions with Scientific Literaturecited by 50
- 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
- 2023LLMs-Healthcare : Current Applications and Challenges of Large Language Models in various Medical Specialtiescited by 10
- 2025MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibilitycited by 9
- 2025Large Language Models for Bioinformaticscited by 3
- 2024ML-On-Rails: Safeguarding Machine Learning Models in Software Systems A Case Studycited by 2
- 2024Leveraging Multimodal Models for Enhanced Neuroimaging Diagnostics in Alzheimer's Diseasecited by 1
- 2025Cross-Attention Fusion of MRI and Jacobian Maps for Alzheimer's Disease Diagnosiscited by 1
- 2026Speech-based Psychological Crisis Assessment using LLMscited by 0
- 2026Speech-based Psychological Crisis Assessment using LLMs11 May 2026
- 2025MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility30 May 2025
- 2025Cross-Attention Fusion of MRI and Jacobian Maps for Alzheimer's Disease Diagnosis1 Mar 2025
- 2025Large Language Models for Bioinformatics10 Jan 2025
- 2024Leveraging Multimodal Models for Enhanced Neuroimaging Diagnostics in Alzheimer's Disease12 Nov 2024
- 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directions6 Jun 2024
- 2024DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer's Disease Questions with Scientific Literature8 May 2024
- 2024ML-On-Rails: Safeguarding Machine Learning Models in Software Systems A Case Study12 Jan 2024
- 2023LLMs-Healthcare : Current Applications and Challenges of Large Language Models in various Medical Specialties28 Oct 2023