Vision Foundation Models in Radiology: A Scoping Review of Data, Methodology, Evaluation and Clinical Translation
Not on the map. Why?
Abstract (arXiv)
Vision foundation models (VFMs) are increasingly being developed for radiological imaging, yet their definition, development and evaluation remain heterogeneous. We conducted a PRISMAScR scoping review of peer-reviewed studies published between January 2017 and March 2026 describing foundation models trained exclusively on radiological imaging data. Sixty-seven studies were included and mapped across three pillars: data scale and heterogeneity, architectural and pretraining scalability, and downstream transferability and generalization. Datasets primarily covered brain MRI, thoracoabdominal CT, and chest X-ray, ranging from fewer than 100,000 samples to multi-million-image cohorts. Transformer-based architectures and self-supervised pretraining predominated, particularly masked image modeling, contrastive learning and multi-stage approaches. Evaluation focused mainly on segmentation and classification, whereas cross-center, cross-scanner, anatomical and modality-shift validation was inconsistently reported. Alignment with FUTURE-AI principles was uneven. Overall, radiology-specific VFMs show promising transferability, but clinical translation remains constrained by limited data representativeness, heterogeneous benchmarks, incomplete reporting and insufficient deployment-oriented evaluation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 103 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
38 of 103 references.
References · 38
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2023USFM: A Universal Ultrasound Foundation Model Generalized to Tasks and Organs towards Label Efficient Image Analysiscited by 68
- 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Reviewcited by 62
26 more
- 2023FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcarecited by 60
- 2023Overcoming Data Scarcity in Biomedical Imaging with a Foundational Multi-Task Modelcited by 40
- 2024BrainSegFounder: Towards 3D Foundation Models for Neuroimage Segmentationcited by 39
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 36
- 2024BrainMass: Advancing Brain Network Analysis for Diagnosis with Large-scale Self-Supervised Learningcited by 32
- 2025A generalizable 3D framework and model for self-supervised learning in medical imagingcited by 31
- 2024Foundation Models in Radiology: What, How, When, Why and Why Notcited by 28
- 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 25
- 2024UltraSam: A Foundation Model for Ultrasound using Large Open-Access Segmentation Datasetscited by 24
- 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentationcited by 17
- 2024From Pretraining to Privacy: Federated Ultrasound Foundation Model with Self-Supervised Learningcited by 15
- 2024SegmentAnyBone: A Universal Model that Segments Any Bone at Any Location on MRIcited by 14
- 2024Comparison of fine-tuning strategies for transfer learning in medical image classificationcited by 14
- 2024Towards a vision foundation model for comprehensive assessment of Cardiac MRIcited by 14
- 2024Anatomical Foundation Models for Brain MRIscited by 13
- 2025Hi-End-MAE: Hierarchical encoder-driven masked autoencoders are stronger vision learners for medical image segmentationcited by 12
- 2023A Review of Predictive and Contrastive Self-supervised Learning for Medical Imagescited by 10
- 2024Improving Representation of High-frequency Components for Medical Visual Foundation Modelscited by 9
- 2024MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentationcited by 7
- 2025Brain Foundation Models with Hypergraph Dynamic Adapter for Brain Disease Analysiscited by 7
- 2025MedicoSAM: Robust Improvement of SAM for Medical Imagingcited by 6
- 2025Chest X-ray Foundation Model with Global and Local Representations Integrationcited by 6
- 2023Meta Transfer of Self-Supervised Knowledge: Foundation Model in Action for Post-Traumatic Epilepsy Predictioncited by 5
- 2024SAMCT: Segment Any CT Allowing Labor-Free Task-Indicator Promptscited by 5
- 2024ONCOPILOT: A Promptable CT Foundation Model For Solid Tumor Evaluationcited by 5
- 2024A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRIcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.