mlsanityData to 14 Oct 2026

A Brain Graph Foundation Model: Pre-Training and Prompt-Tuning across Broad Atlases and Disorders

arXiv 2506.02044 ↗First posted 31 May 2025q-bio.NC cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on time-series signals or connectome features, we propose a novel graph-based pre-training paradigm for constructing a brain graph foundation model. In this paper, we introduce the Brain Graph Foundation Model, termed BrainGFM, a unified framework that leverages graph contrastive learning and graph masked autoencoders for large-scale fMRI-based pre-training. BrainGFM is pre-trained on a diverse mixture of brain atlases with varying parcellations, significantly expanding the pre-training corpus and enhancing the model's ability to generalize across heterogeneous fMRI-derived brain representations. To support efficient and versatile downstream transfer, we integrate both graph prompts and language prompts into the model design, enabling BrainGFM to flexibly adapt to a wide range of atlases, neurological and psychiatric disorders, and task settings. Furthermore, we employ meta-learning to optimize the graph prompts, facilitating strong generalization to previously unseen disorders under both few-shot and zero-shot learning conditions via language-guided prompting. BrainGFM is pre-trained on 27 neuroimaging datasets spanning 25 common neurological and psychiatric disorders, encompassing 2 types of brain atlases (functional and anatomical) across 8 widely-used parcellations, and covering over 25,000 subjects, 60,000 fMRI scans, and a total of 400,000 graph samples aggregated across all atlases and parcellations.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 29 of its 73 references that are in the map. First posted on arXiv 31 May 2025.

Builds on

29 of 73 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  8. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  9. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  10. 2020Meta-Learning in Neural Networks: A Surveycited by 950
  11. 2020Benchmarking Graph Neural Networkscited by 680
  12. 2019Graph Transformer Networkscited by 523
17 more
  1. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
  2. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
  3. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  4. 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 333
  5. 2019Position-aware Graph Neural Networkscited by 203
  6. 2024OpenGraph: Towards Open Graph Foundation Modelscited by 78
  7. 2022BrainGB: A Benchmark for Brain Network Analysis with Graph Neural Networkscited by 75
  8. 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 65
  9. 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
  10. 2022Self-Supervised Learning of Brain Dynamics from Broad Neuroimaging Datacited by 39
  11. 2024BrainMass: Advancing Brain Network Analysis for Diagnosis with Large-scale Self-Supervised Learningcited by 32
  12. 2023BrainNPT: Pre-training of Transformer networks for brain network classificationcited by 9
  13. 2024Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusioncited by 9
  14. 2022Hierarchical Graph Convolutional Network Built by Multiscale Atlases for Brain Disorder Diagnosis Using Functional Connectivitycited by 8
  15. 2025BrainPrompt: Multi-Level Brain Prompt Enhancement for Neurological Condition Identificationcited by 5
  16. 2024Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEGcited by 4
  17. 2024Prompt Your Brain: Scaffold Prompt Tuning for Efficient Adaptation of fMRI Pre-trained Modelcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.