mlsanityData to 7 Oct 2026

Diffusion-Guided Pretraining for Brain Graph Foundation Models

arXiv 2602.09437 ↗First posted 10 Feb 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

With the growing interest in foundation models for brain signals, graph-based pretraining has emerged as a promising paradigm for learning transferable representations from connectome data. However, existing contrastive and masked autoencoder methods typically rely on naive random dropping or masking for augmentation, which is ill-suited for brain graphs and hypergraphs as it disrupts semantically meaningful connectivity patterns. Moreover, commonly used graph-level readout and reconstruction schemes fail to capture global structural information, limiting the robustness of learned representations. In this work, we propose a unified diffusion-based pretraining framework that addresses both limitations. First, diffusion is designed to guide structure-aware dropping and masking strategies, preserving brain graph semantics while maintaining effective pretraining diversity. Second, diffusion enables topology-aware graph-level readout and node-level global reconstruction by allowing graph embeddings and masked nodes to aggregate information from globally related regions. Extensive experiments across multiple neuroimaging datasets with over 25,000 subjects and 60,000 scans involving various mental disorders and brain atlases demonstrate consistent performance improvements.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

21 of 31 references.

References · 21

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  5. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  6. 2018Hypergraph Neural Networkscited by 482
  7. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  8. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  9. 2019Diffusion Improves Graph Learningcited by 414
  10. 2021GRAND: Graph Neural Diffusioncited by 258
  11. 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
  12. 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 131
9 more
  1. 2022Brain Network Transformercited by 92
  2. 2023DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusioncited by 85
  3. 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 64
  4. 2022Graph Data Augmentation for Graph Machine Learning: A Surveycited by 61
  5. 2024BrainMass: Advancing Brain Network Analysis for Diagnosis with Large-scale Self-Supervised Learningcited by 32
  6. 2022Graph Neural Networks with Adaptive Readoutscited by 29
  7. 2025Long-range Brain Graph Transformercited by 11
  8. 2024Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusioncited by 9
  9. 2023Supercharging Graph Transformers with Advective Diffusioncited by 7

Built on by

Not cited yet.