A Brain Graph Foundation Model: Pre-Training and Prompt-Tuning across Broad Atlases and Disorders
Not on the map. Why?
Abstract (arXiv)
As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on time-series signals or connectome features, we propose a novel graph-based pre-training paradigm for constructing a brain graph foundation model. In this paper, we introduce the Brain Graph Foundation Model, termed BrainGFM, a unified framework that leverages graph contrastive learning and graph masked autoencoders for large-scale fMRI-based pre-training. BrainGFM is pre-trained on a diverse mixture of brain atlases with varying parcellations, significantly expanding the pre-training corpus and enhancing the model's ability to generalize across heterogeneous fMRI-derived brain representations. To support efficient and versatile downstream transfer, we integrate both graph prompts and language prompts into the model design, enabling BrainGFM to flexibly adapt to a wide range of atlases, neurological and psychiatric disorders, and task settings. Furthermore, we employ meta-learning to optimize the graph prompts, facilitating strong generalization to previously unseen disorders under both few-shot and zero-shot learning conditions via language-guided prompting. BrainGFM is pre-trained on 27 neuroimaging datasets spanning 25 common neurological and psychiatric disorders, encompassing 2 types of brain atlases (functional and anatomical) across 8 widely-used parcellations, and covering over 25,000 subjects, 60,000 fMRI scans, and a total of 400,000 graph samples aggregated across all atlases and parcellations.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 29 of its 73 references that are in the map. First posted on arXiv 31 May 2025.
Builds on
29 of 73 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2020Benchmarking Graph Neural Networkscited by 680
- 2019Graph Transformer Networkscited by 523
17 more
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
- 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 333
- 2019Position-aware Graph Neural Networkscited by 203
- 2024OpenGraph: Towards Open Graph Foundation Modelscited by 78
- 2022BrainGB: A Benchmark for Brain Network Analysis with Graph Neural Networkscited by 75
- 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 65
- 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
- 2022Self-Supervised Learning of Brain Dynamics from Broad Neuroimaging Datacited by 39
- 2024BrainMass: Advancing Brain Network Analysis for Diagnosis with Large-scale Self-Supervised Learningcited by 32
- 2023BrainNPT: Pre-training of Transformer networks for brain network classificationcited by 9
- 2024Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusioncited by 9
- 2022Hierarchical Graph Convolutional Network Built by Multiscale Atlases for Brain Disorder Diagnosis Using Functional Connectivitycited by 8
- 2025BrainPrompt: Multi-Level Brain Prompt Enhancement for Neurological Condition Identificationcited by 5
- 2024Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEGcited by 4
- 2024Prompt Your Brain: Scaffold Prompt Tuning for Efficient Adaptation of fMRI Pre-trained Modelcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Toward a Multi-View Brain Network Foundation Model: Cross-View Consistency Learning Across Arbitrary Atlasescited by 0
- 2026When Language Models Meet NeuroGraphs: Exploring Enhanced Agentic LLM Framework Towards Brain Network Analysiscited by 0
- 2026A Scaling Study for fMRI Foundation Modelscited by 0
- 2026A Scaling Study for fMRI Foundation Models23 Sep 2026
- 2026When Language Models Meet NeuroGraphs: Exploring Enhanced Agentic LLM Framework Towards Brain Network Analysis24 Jul 2026
- 2026Toward a Multi-View Brain Network Foundation Model: Cross-View Consistency Learning Across Arbitrary Atlases20 Mar 2026