mlsanityData to 7 Oct 2026

Towards Brain MRI Foundation Models for the Clinic: Findings from the FOMO25 Challenge

arXiv 2604.11679 ↗First posted 13 Apr 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Clinical deployment of automated brain MRI analysis faces a fundamental challenge: clinical data is heterogeneous and noisy, and high-quality labels are prohibitively costly to obtain. Self-supervised learning (SSL) can address this by leveraging the vast amounts of unlabeled data produced in clinical workflows to train robust textitfoundation models that adapt out-of-domain with minimal supervision. However, the development of foundation models for brain MRI has been limited by small pretraining datasets and in-domain benchmarking focused on high-quality, research-grade data. To address this gap, we organized the FOMO25 challenge as a satellite event at MICCAI 2025. FOMO25 provided participants with a large pretraining dataset, FOMO60K, and evaluated models on data sourced directly from clinical workflows in few-shot and out-of-domain settings. Tasks covered infarct classification, meningioma segmentation, and brain age regression, and considered both models trained on FOMO60K (method track) and any data (open track). Nineteen foundation models from sixteen teams were evaluated using a standardized containerized pipeline. Results show that (a) self-supervised pretraining improves generalization on clinical data under domain shift, with the strongest models trained textitout-of-domain surpassing supervised baselines trained textitin-domain. (b) No single pretraining objective benefits all tasks: MAE favors segmentation, hybrid reconstruction-contrastive objectives favor classification, and (c) strong performance was achieved by small pretrained models, and improvements from scaling model size and training duration did not yield reliable benefits.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

34 of 52 references.

References · 34

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  8. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  9. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  10. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  11. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
  12. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
22 more
  1. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
  2. 2024xLSTM: Extended Long Short-Term Memorycited by 320
  3. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
  4. 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 235
  5. 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
  6. 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
  7. 2023STU-Net: Scalable and Transferable Medical Image Segmentation Models Empowered by Large-Scale Supervised Pre-trainingcited by 96
  8. 2018Why rankings of biomedical image analysis competitions should be interpreted with carecited by 90
  9. 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
  10. 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 71
  11. 2019BIAS: Transparent reporting of biomedical image analysis challengescited by 57
  12. 2019The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort studycited by 38
  13. 2024Revisiting MAE pre-training for 3D medical image segmentationcited by 33
  14. 2022How Robust is Unsupervised Representation Learning to Distribution Shift?cited by 24
  15. 2024An OpenMind for 3D medical vision self-supervised learningcited by 23
  16. 2024AMAES: Augmented Masked Autoencoder Pretraining on Public Brain MRI Data for 3D-Native Segmentationcited by 16
  17. 2025Curia: A Multi-Modal Foundation Model for Radiologycited by 14
  18. 2025A large-scale heterogeneous 3D magnetic resonance brain imaging dataset for self-supervised learningcited by 7
  19. 2024Yucca: A Deep Learning Framework For Medical Image Analysiscited by 5
  20. 2023Data Augmentation-Based Unsupervised Domain Adaptation In Medical Imagingcited by 3
  21. 2025Consistent View Alignment Improves Foundation Models for 3D Medical Image Segmentationcited by 1
  22. 2026From 100,000+ images to winning the first brain MRI foundation model challenges: Sharing lessons and modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.