mlsanityData to 14 Oct 2026

Towards Generalisable Foundation Models for Brain MRI

arXiv 2510.23415 ↗First posted 27 Oct 2025cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Foundation models in artificial intelligence (AI) are transforming medical imaging by enabling general-purpose feature learning from large-scale, unlabeled datasets. In this work, we introduce BrainFound, a self-supervised foundation model for brain MRI, built by extending DINO-v2, a vision transformer originally designed for 2D natural images. BrainFound adapts DINO-v2 to model full 3D brain anatomy by incorporating volumetric information from sequential MRI slices, moving beyond conventional single-slice paradigms. It supports both single- and multimodal inputs, enabling a broad range of downstream tasks, including disease detection and image segmentation, while generalising across varied imaging protocols and clinical scenarios. We show that BrainFound consistently outperforms existing self-supervised pretraining strategies and supervised baselines, particularly in label-scarce and multi-contrast settings. By integrating information from diverse 3D MRI modalities (e.g., T1, T2, FLAIR), it enhances diagnostic accuracy and reduces dependency on extensive expert annotations. This flexibility makes BrainFound a scalable and practical solution for 3D neuroimaging pipelines, with significant potential for clinical deployment and research innovation.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 19 of its 48 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

19 of 48 references.

References · 19

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
  6. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  7. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
  8. 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
  9. 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 368
  10. 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 288
  11. 2023Domain Generalization for Medical Image Analysis: A Reviewcited by 48
  12. 2021The University of California San Francisco Preoperative Diffuse Glioma MRI (UCSF-PDGM) Datasetcited by 43
7 more
  1. 2023Evaluating General Purpose Vision Foundation Models for Medical Image Analysis: An Experimental Study of DINOv2 on Radiology Benchmarkscited by 33
  2. 2020Longitudinal Self-Supervised Learningcited by 30
  3. 2020Learning joint segmentation of tissues and brain lesions from task-specific hetero-modal domain-shifted datasetscited by 15
  4. 2025Hi-End-MAE: Hierarchical encoder-driven masked autoencoders are stronger vision learners for medical image segmentationcited by 12
  5. 2023Towards Foundation Models Learned from Anatomy in Medical Imaging via Self-Supervisioncited by 11
  6. 2021Comparative Evaluation of 3D and 2D Deep Learning Techniques for Semantic Segmentation in CT Scanscited by 2
  7. 2025Foundation Model for Whole-Heart Segmentation: Leveraging Student-Teacher Learning in Multi-Modal Medical Imagingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.