Foundation Models in Biomedical Imaging: Turning Hype into Reality
Not on the map. Why?
Abstract (arXiv)
Foundation models (FMs) are driving a prominent shift in biomedical imaging from task-specific models to unified backbone models for diverse tasks. This opens an avenue to integrate imaging, pathology, clinical records, and genomics data into a composite system. However, this vision contrasts sharply with modern medicine's trajectory toward more granular sub-specialization. This tension, coupled with data scarcity, domain heterogeneity, and limited interpretability, creates a gap between benchmark success and real-world clinical value. We argue that the immediate role of FMs lies in augmenting, not replacing, clinical expertise. To separate hype from reality, we introduce REAL-FM (Real-world Evaluation and Assessment of Foundation Models), a multi-dimensional framework for assessing data, technical readiness, clinical value, workflow integration, and responsible AI. Using REAL-FM, we find that while FMs excel in pattern recognition, they fall short in causal reasoning, domain robustness, and safety. Clinical translation is hindered by scarce representative data for model training, unverified generalization beyond oversimplified benchmark settings, and a lack of prospective outcome-based validation. We further examine FM reasoning paradigms, including sequential logic, spatial understanding, and symbolic domain knowledge. We envision that the path forward lies not in a monolithic medical oracle, but in coordinated subspecialist AI systems that are transparent, safe, and clinically grounded.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 64 of its 153 references that are in the map. First posted on arXiv 17 Dec 2025.
Builds on
64 of 153 references.
References · 64
- 2023Segment Anythingcited by 8,158
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
- 2025MedGemma Technical Reportcited by 398
- 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 293
- 2023Towards Generalist Biomedical AIcited by 286
- 2019Causality for Machine Learningcited by 242
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2023Segment Anything in Medical Imagescited by 226
- 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
38 more
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2020A Survey of Evaluation Metrics Used for NLG Systemscited by 164
- 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
- 2023Causal Parrots: Large Language Models May Talk Causality But Are Not Causalcited by 146
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
- 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Imagescited by 128
- 2023SAM-Med2Dcited by 123
- 2023Causal-learn: Causal Discovery in Pythoncited by 108
- 2025Medical Hallucinations in Foundation Models and Their Impact on Healthcarecited by 89
- 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
- 2024PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathologycited by 80
- 2020Secure and Robust Machine Learning for Healthcare: A Surveycited by 77
- 2023Foundational Models in Medical Imaging: A Comprehensive Survey and Future Visioncited by 74
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
- 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 62
- 2023FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcarecited by 59
- 2024ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Datasetcited by 54
- 2024Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluationcited by 51
- 2024MedCoT: Medical Chain of Thought via Hierarchical Expertcited by 46
- 2025Vision Foundation Models for Computed Tomographycited by 44
- 2023Overcoming Data Scarcity in Biomedical Imaging with a Foundational Multi-Task Modelcited by 40
- 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 40
- 2024MedVersa: A Generalist Foundation Model for Medical Image Interpretationcited by 37
- 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 37
- 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34
- 2024The Essential Role of Causality in Foundation World Models for Embodied AIcited by 32
- 2024Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillationcited by 30
- 2024Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentationcited by 25
- 2024PLUTO: Pathology-Universal Transformercited by 17
- 2024A Survey on Trustworthiness in Foundation Models for Medical Image Analysiscited by 16
- 2025Localizing Before Answering: A Hallucination Evaluation Benchmark for Grounded Medical Multimodal LLMscited by 14
- 2025MIMO: A medical vision language model with visual referring multimodal input and pixel grounding multimodal outputcited by 14
- 2023Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Trainingcited by 13
- 2024Can Large Language Models Reason? A Characterization via 3-SATcited by 12
- 2023Towards Foundation Models Learned from Anatomy in Medical Imaging via Self-Supervisioncited by 11
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025An Explainable Biomedical Foundation Model via Large-Scale Concept-Enhanced Vision-Language Pre-training
- 2024Exploring Foundation Models for Synthetic Medical Imaging: A Study on Chest X-Rays and Fine-Tuning Techniques
- 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains
- 2024Benchmarking foundation models as feature extractors for weakly-supervised computational pathology
- 2025Leveraging Vision-Language Foundation Models to Reveal Hidden Image-Attribute Relationships in Medical Imaging
- 2025Multi-Modal Foundation Models for Computational Pathology: A Survey
- 2024Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare
- 2026Scanner-Induced Domain Shifts Undermine the Robustness of Pathology Foundation Models