mlsanityData to 14 Oct 2026

Vision Foundation Models in Radiology: A Scoping Review of Data, Methodology, Evaluation and Clinical Translation

arXiv 2607.07219 ↗First posted 8 Jul 2026cs.CV cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Vision foundation models (VFMs) are increasingly being developed for radiological imaging, yet their definition, development and evaluation remain heterogeneous. We conducted a PRISMAScR scoping review of peer-reviewed studies published between January 2017 and March 2026 describing foundation models trained exclusively on radiological imaging data. Sixty-seven studies were included and mapped across three pillars: data scale and heterogeneity, architectural and pretraining scalability, and downstream transferability and generalization. Datasets primarily covered brain MRI, thoracoabdominal CT, and chest X-ray, ranging from fewer than 100,000 samples to multi-million-image cohorts. Transformer-based architectures and self-supervised pretraining predominated, particularly masked image modeling, contrastive learning and multi-stage approaches. Evaluation focused mainly on segmentation and classification, whereas cross-center, cross-scanner, anatomical and modality-shift validation was inconsistently reported. Alignment with FUTURE-AI principles was uneven. Overall, radiology-specific VFMs show promising transferability, but clinical translation remains constrained by limited data representativeness, heterogeneous benchmarks, incomplete reporting and insufficient deployment-oriented evaluation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 103 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

38 of 103 references.

References · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2023Segment Anythingcited by 8,234
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  8. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  9. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
  10. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  11. 2023USFM: A Universal Ultrasound Foundation Model Generalized to Tasks and Organs towards Label Efficient Image Analysiscited by 68
  12. 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Reviewcited by 62
26 more
  1. 2023FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcarecited by 60
  2. 2023Overcoming Data Scarcity in Biomedical Imaging with a Foundational Multi-Task Modelcited by 40
  3. 2024BrainSegFounder: Towards 3D Foundation Models for Neuroimage Segmentationcited by 39
  4. 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 36
  5. 2024BrainMass: Advancing Brain Network Analysis for Diagnosis with Large-scale Self-Supervised Learningcited by 32
  6. 2025A generalizable 3D framework and model for self-supervised learning in medical imagingcited by 31
  7. 2024Foundation Models in Radiology: What, How, When, Why and Why Notcited by 28
  8. 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 25
  9. 2024UltraSam: A Foundation Model for Ultrasound using Large Open-Access Segmentation Datasetscited by 24
  10. 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentationcited by 17
  11. 2024From Pretraining to Privacy: Federated Ultrasound Foundation Model with Self-Supervised Learningcited by 15
  12. 2024SegmentAnyBone: A Universal Model that Segments Any Bone at Any Location on MRIcited by 14
  13. 2024Comparison of fine-tuning strategies for transfer learning in medical image classificationcited by 14
  14. 2024Towards a vision foundation model for comprehensive assessment of Cardiac MRIcited by 14
  15. 2024Anatomical Foundation Models for Brain MRIscited by 13
  16. 2025Hi-End-MAE: Hierarchical encoder-driven masked autoencoders are stronger vision learners for medical image segmentationcited by 12
  17. 2023A Review of Predictive and Contrastive Self-supervised Learning for Medical Imagescited by 10
  18. 2024Improving Representation of High-frequency Components for Medical Visual Foundation Modelscited by 9
  19. 2024MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentationcited by 7
  20. 2025Brain Foundation Models with Hypergraph Dynamic Adapter for Brain Disease Analysiscited by 7
  21. 2025MedicoSAM: Robust Improvement of SAM for Medical Imagingcited by 6
  22. 2025Chest X-ray Foundation Model with Global and Local Representations Integrationcited by 6
  23. 2023Meta Transfer of Self-Supervised Knowledge: Foundation Model in Action for Post-Traumatic Epilepsy Predictioncited by 5
  24. 2024SAMCT: Segment Any CT Allowing Labor-Free Task-Indicator Promptscited by 5
  25. 2024ONCOPILOT: A Promptable CT Foundation Model For Solid Tumor Evaluationcited by 5
  26. 2024A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRIcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.