A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseases
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) are powerful machine learning models designed to handle irregularly structured data. However, their generic design often proves inadequate for analyzing brain connectomes in Alzheimer's Disease (AD), highlighting the need to incorporate domain knowledge for optimal performance. Infusing AD-related knowledge into GNNs is a complicated task. Existing methods typically rely on collaboration between computer scientists and domain experts, which can be both time-intensive and resource-demanding. To address these limitations, this paper presents a novel self-guided, knowledge-infused multimodal GNN that autonomously incorporates domain knowledge into the model development process. Our approach conceptualizes domain knowledge as natural language and introduces a specialized multimodal GNN capable of leveraging this uncurated knowledge to guide the learning process of the GNN, such that it can improve the model performance and strengthen the interpretability of the predictions. To evaluate our framework, we curated a comprehensive dataset of recent peer-reviewed papers on AD and integrated it with multiple real-world AD datasets. Experimental results demonstrate the ability of our method to extract relevant domain knowledge, provide graph-based explanations for AD diagnosis, and improve the overall performance of the GNN. This approach provides a more scalable and efficient alternative to inject domain knowledge for AD compared with the manual design from the domain expert, advancing both prediction accuracy and interpretability in AD diagnosis.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 49 of its 71 references that are in the map. First posted on arXiv 9 Dec 2024.
Builds on
49 of 71 references.
References · 49
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2023A Survey of Large Language Modelscited by 2,537
- 2016Variational Graph Auto-Encoderscited by 1,373
37 more
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
- 2015LSTM: A Search Space Odysseycited by 315
- 2023Language is All a Graph Needscited by 219
- 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 209
- 2023Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPTcited by 78
- 2022Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysiscited by 58
- 2024Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitatecited by 46
- 2019Overlapping Community Detection with Graph Neural Networkscited by 45
- 2023PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMscited by 44
- 2023Can Large Language Models Empower Molecular Property Prediction?cited by 43
- 2023Augmented Large Language Models with Parametric Knowledge Guidingcited by 37
- 2023AutoReP: Automatic ReLU Replacement for Fast Private Network Inferencecited by 29
- 2023MaxK-GNN: Extremely Fast GPU Kernel Design for Accelerating Graph Neural Networks Trainingcited by 25
- 2020Enabling On-Device CNN Training by Self-Supervised Instance Filtering and Error Map Pruningcited by 24
- 2023Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspectivecited by 23
- 2023Accel-GCN: High-Performance GPU Accelerator Design for Graph Convolution Networkscited by 22
- 2021Enabling On-Device Self-Supervised Contrastive Learning With Selective Data Contrastcited by 21
- 2022Federated Contrastive Learning for Dermatological Disease Diagnosis via On-device Learningcited by 21
- 2024Unlocking Memorization in Large Language Models with Dynamic Soft Promptingcited by 21
- 2024Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratchcited by 20
- 2020Intermittent Inference with Nonuniformly Compressed Multi-Exit Neural Network for Energy Harvesting Powered Devicescited by 19
- 2024InfuserKI: Enhancing Large Language Models with Knowledge Graphs via Infuser-Guided Knowledge Integrationcited by 19
- 2022Distributed Contrastive Learning for Medical Image Segmentationcited by 16
- 2021Detecting Communities from Heterogeneous Graphs: A Context Path-based Graph Neural Network Modelcited by 15
- 2021Decentralized Unsupervised Learning of Visual Representationscited by 15
- 2022CLARE: A Semi-supervised Community Detection Algorithmcited by 13
- 2022Synthetic Data Can Also Teach: Synthesizing Effective Data for Unsupervised Visual Representation Learningcited by 12
- 2024Pruning as a Domain-specific LLM Extractorcited by 12
- 2022Contrastive Brain Network Learning via Hierarchical Signed Graph Pooling Modelcited by 8
- 2020CommPOOL: An Interpretable Graph Pooling Framework for Hierarchical Graph Representation Learningcited by 6
- 2024Dynamic Uncertainty Ranking: Enhancing Retrieval-Augmented In-Context Learning for Long-Tail Knowledge in LLMscited by 3
- 2024Transfer Learning with Clinical Concept Embeddings from Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.