BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learning
Not on the map. Why?
Abstract (arXiv)
Brain MRI underpins a wide range of neuroscientific and clinical applications, yet most learning-based methods remain task-specific and require substantial labeled data. Here we show that a single self-supervised representation can generalize across heterogeneous brain MRI endpoints. We trained BrainDINO, a self-distilled foundation model, on approximately 6.6 million unlabeled axial slices from 20 datasets encompassing broad variation in population, disease, and acquisition setting. Using a frozen encoder with lightweight task heads, BrainDINO supported transfer across tumor segmentation, neurodegenerative and neurodevelopmental conditions classification, brain age estimation, post-stroke temporal prediction, molecular status prediction, MRI sequence classification, and survival modeling. Across tasks and supervision regimes, BrainDINO consistently equaled or exceeded natural-image and MRI-specific self-supervised baselines, with particularly strong advantages under label scarcity. Representation analyses further showed anatomically organized and pathology-sensitive feature structure in the absence of task-specific supervision. Our findings indicate that large-scale slice-wise self-supervised learning can yield a unified brain MRI representation that supports diverse neuroimaging tasks without volumetric pretraining or full-network fine-tuning, establishing a scalable foundation for robust and data-efficient brain imaging analysis. Code is available at https://github.com/mclwu22/BrainDINO
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 34 of its 78 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
34 of 78 references.
References · 34
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2025DINOv3cited by 1,414
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
22 more
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 470
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
- 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
- 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 134
- 2016Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarkercited by 72
- 2024The 2024 Brain Tumor Segmentation (BraTS) Challenge: Glioma Segmentation on Post-treatment MRIcited by 69
- 2023The ASNR-MICCAI Brain Tumor Segmentation (BraTS) Challenge 2023: Intracranial Meningiomacited by 53
- 2023The Brain Tumor Segmentation (BraTS) Challenge 2023: Focus on Pediatrics (CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs)cited by 49
- 2023Domain Generalization for Medical Image Analysis: A Reviewcited by 48
- 2023The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRIcited by 36
- 2020Deep Learning Based Brain Tumor Segmentation: A Surveycited by 30
- 2025BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signalscited by 27
- 2025MedDINOv3: How to adapt vision foundation models for medical image segmentation?cited by 25
- 2024Multi-modal Vision Pre-training for Medical Image Analysiscited by 23
- 2024AMAES: Augmented Masked Autoencoder Pretraining on Public Brain MRI Data for 3D-Native Segmentationcited by 17
- 2025Building a General SimCLR Self-Supervised Foundation Model Across Neurological Diseases to Advance 3D Brain MRI Diagnosescited by 10
- 2025Towards Generalisable Foundation Models for Brain MRIcited by 9
- 2025fMRI-LM: Towards a Universal Foundation Model for Language-Aligned fMRI Understandingcited by 7
- 2025Multimodal Masked Autoencoder Pre-training for 3D MRI-Based Brain Tumor Analysis with Missing Modalitiescited by 3
- 2025Self-DANA: A Resource-Efficient Channel-Adaptive Self-Supervised Approach for ECG Foundation Modelscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generationcited by 1
- 2026Contrastive Joint-Embedding Prediction for Representation Learning in Structural MRIcited by 0
- 2026A continually expandable foundation model for brain MRIcited by 0
- 2026Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spacescited by 0
- 2026Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spaces13 Aug 2026
- 2026A continually expandable foundation model for brain MRI8 Aug 2026
- 2026Contrastive Joint-Embedding Prediction for Representation Learning in Structural MRI12 Jul 2026
- 2026BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation17 Jun 2026