Towards Generalisable Foundation Models for Brain MRI
Not on the map. Why?
Abstract (arXiv)
Foundation models in artificial intelligence (AI) are transforming medical imaging by enabling general-purpose feature learning from large-scale, unlabeled datasets. In this work, we introduce BrainFound, a self-supervised foundation model for brain MRI, built by extending DINO-v2, a vision transformer originally designed for 2D natural images. BrainFound adapts DINO-v2 to model full 3D brain anatomy by incorporating volumetric information from sequential MRI slices, moving beyond conventional single-slice paradigms. It supports both single- and multimodal inputs, enabling a broad range of downstream tasks, including disease detection and image segmentation, while generalising across varied imaging protocols and clinical scenarios. We show that BrainFound consistently outperforms existing self-supervised pretraining strategies and supervised baselines, particularly in label-scarce and multi-contrast settings. By integrating information from diverse 3D MRI modalities (e.g., T1, T2, FLAIR), it enhances diagnostic accuracy and reduces dependency on extensive expert annotations. This flexibility makes BrainFound a scalable and practical solution for 3D neuroimaging pipelines, with significant potential for clinical deployment and research innovation.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 19 of its 48 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
19 of 48 references.
References · 19
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
- 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 368
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 288
- 2023Domain Generalization for Medical Image Analysis: A Reviewcited by 48
- 2021The University of California San Francisco Preoperative Diffuse Glioma MRI (UCSF-PDGM) Datasetcited by 43
7 more
- 2023Evaluating General Purpose Vision Foundation Models for Medical Image Analysis: An Experimental Study of DINOv2 on Radiology Benchmarkscited by 33
- 2020Longitudinal Self-Supervised Learningcited by 30
- 2020Learning joint segmentation of tissues and brain lesions from task-specific hetero-modal domain-shifted datasetscited by 15
- 2025Hi-End-MAE: Hierarchical encoder-driven masked autoencoders are stronger vision learners for medical image segmentationcited by 12
- 2023Towards Foundation Models Learned from Anatomy in Medical Imaging via Self-Supervisioncited by 11
- 2021Comparative Evaluation of 3D and 2D Deep Learning Techniques for Semantic Segmentation in CT Scanscited by 2
- 2025Foundation Model for Whole-Heart Segmentation: Leveraging Student-Teacher Learning in Multi-Modal Medical Imagingcited by 2
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learningcited by 4
- 2026Pan-FM: A Pan-Organ Foundation Model with Saliency-Guided Masking for Missing Robustnesscited by 1
- 2026Multimodal Visual Surrogate Compression for Alzheimer's Disease Classificationcited by 0
- 2026AGA3DNet: Anatomy-Guided Gaussian Priors with Multi-view xLSTM for 3D Brain MRI Subtype Classificationcited by 0
- 2026Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRIcited by 0
- 2026Contrastive Joint-Embedding Prediction for Representation Learning in Structural MRIcited by 0
- 2026BrainNext: A General-Purpose Self-Supervised Foundation Model for Brain MRI Analysiscited by 0
- 2026Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spacescited by 0
- 2026Quantifying privacy risks in foundation model representations of brain MRIcited by 0
- 2026Quantifying privacy risks in foundation model representations of brain MRI14 Oct 2026
- 2026Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spaces13 Aug 2026
- 2026BrainNext: A General-Purpose Self-Supervised Foundation Model for Brain MRI Analysis20 Jul 2026
- 2026Contrastive Joint-Embedding Prediction for Representation Learning in Structural MRI12 Jul 2026
- 2026Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI25 Jun 2026
- 2026AGA3DNet: Anatomy-Guided Gaussian Priors with Multi-view xLSTM for 3D Brain MRI Subtype Classification8 May 2026
- 2026Pan-FM: A Pan-Organ Foundation Model with Saliency-Guided Masking for Missing Robustness8 May 2026
- 2026BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learning30 Apr 2026
- 2026Multimodal Visual Surrogate Compression for Alzheimer's Disease Classification29 Jan 2026