A generalizable structural brain MRI foundation model built through dual-priority federated pretraining
Not on the map. Why?
Abstract (arXiv)
Foundation models hold promise for generalizable analysis of structural brain magnetic resonance imaging (MRI) across development, aging and disease. However, existing models are typically built through centralized pretraining on pooled data, despite privacy and governance constraints. Such pooling optimization can overemphasize cohort size and overlook complementary information from smaller, specialized cohorts. Here we present BrainFedFM, a structural brain MRI foundation model federatively pretrained on 164,707 three-dimensional scans drawn from diverse real-world data distributions and organized across 42 federated sites. BrainFedFM uses dual-priority federated pretraining, coupling spatial-priority masking at each site with site-priority aggregation at the server to emphasize informative anatomical regions locally and prioritize site contributions globally. Across 20 downstream datasets spanning 17 classification, regression and segmentation tasks, BrainFedFM achieved the state-of-the-art performance (mean rank 1.68, 50% gain) across seven models, including four centralized foundation models, while showing particularly consistent advantages in classification and regression and robustness across underrepresented populations. These findings demonstrate the generalizability of BrainFedFM and highlight federated pretraining as a practical strategy for developing neuroimaging foundation models from distributed data without pooling raw images.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 55 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
18 of 55 references.
References · 18
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2021The Medical Segmentation Decathloncited by 628
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 422
- 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 240
- 2024Advances and Open Challenges in Federated Foundation Modelscited by 36
- 2024Revisiting MAE pre-training for 3D medical image segmentationcited by 35
- 2024Masked Image Modeling: A Surveycited by 29
- 2024An OpenMind for 3D medical vision self-supervised learningcited by 26
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcarecited by 16
- 2024From Pretraining to Privacy: Federated Ultrasound Foundation Model with Self-Supervised Learningcited by 15
6 more
- 2023Deepbet: Fast brain extraction of T1-weighted MRI using Convolutional Neural Networkscited by 7
- 2022Efficacy of MRI data harmonization in the age of machine learning. A multicenter study across 36 datasetscited by 6
- 2024The Imaging Database for Epilepsy And Surgery (IDEAS)cited by 6
- 2025PediDemi -- A Pediatric Demyelinating Lesion Segmentation Datasetcited by 2
- 2025From Prediction to Understanding: Will AI Foundation Models Transform Brain Science?cited by 2
- 2026Understanding the Robustness of Distributed Self-Supervised Learning Frameworks Against Non-IID Datacited by 1
Built on by
Not cited yet.