mlsanityData to 7 Oct 2026

Foundation Models in Biomedical Imaging: Turning Hype into Reality

arXiv 2512.15808 ↗First posted 17 Dec 2025q-bio.QM cs.AI cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Foundation models (FMs) are driving a prominent shift in biomedical imaging from task-specific models to unified backbone models for diverse tasks. This opens an avenue to integrate imaging, pathology, clinical records, and genomics data into a composite system. However, this vision contrasts sharply with modern medicine's trajectory toward more granular sub-specialization. This tension, coupled with data scarcity, domain heterogeneity, and limited interpretability, creates a gap between benchmark success and real-world clinical value. We argue that the immediate role of FMs lies in augmenting, not replacing, clinical expertise. To separate hype from reality, we introduce REAL-FM (Real-world Evaluation and Assessment of Foundation Models), a multi-dimensional framework for assessing data, technical readiness, clinical value, workflow integration, and responsible AI. Using REAL-FM, we find that while FMs excel in pattern recognition, they fall short in causal reasoning, domain robustness, and safety. Clinical translation is hindered by scarce representative data for model training, unverified generalization beyond oversimplified benchmark settings, and a lack of prospective outcome-based validation. We further examine FM reasoning paradigms, including sequential logic, spatial understanding, and symbolic domain knowledge. We envision that the path forward lies not in a monolithic medical oracle, but in coordinated subspecialist AI systems that are transparent, safe, and clinically grounded.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 64 of its 153 references that are in the map. First posted on arXiv 17 Dec 2025.

Builds on

64 of 153 references.

References · 64

  1. 2023Segment Anythingcited by 8,158
  2. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  3. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  4. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  5. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
  6. 2025MedGemma Technical Reportcited by 398
  7. 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 293
  8. 2023Towards Generalist Biomedical AIcited by 286
  9. 2019Causality for Machine Learningcited by 242
  10. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  11. 2023Segment Anything in Medical Imagescited by 226
  12. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
38 more
  1. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
  2. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
  3. 2020A Survey of Evaluation Metrics Used for NLG Systemscited by 164
  4. 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
  5. 2023Causal Parrots: Large Language Models May Talk Causality But Are Not Causalcited by 146
  6. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  7. 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
  8. 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Imagescited by 128
  9. 2023SAM-Med2Dcited by 123
  10. 2023Causal-learn: Causal Discovery in Pythoncited by 108
  11. 2025Medical Hallucinations in Foundation Models and Their Impact on Healthcarecited by 89
  12. 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
  13. 2024PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathologycited by 80
  14. 2020Secure and Robust Machine Learning for Healthcare: A Surveycited by 77
  15. 2023Foundational Models in Medical Imaging: A Comprehensive Survey and Future Visioncited by 74
  16. 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
  17. 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
  18. 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 62
  19. 2023FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcarecited by 59
  20. 2024ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Datasetcited by 54
  21. 2024Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluationcited by 51
  22. 2024MedCoT: Medical Chain of Thought via Hierarchical Expertcited by 46
  23. 2025Vision Foundation Models for Computed Tomographycited by 44
  24. 2023Overcoming Data Scarcity in Biomedical Imaging with a Foundational Multi-Task Modelcited by 40
  25. 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 40
  26. 2024MedVersa: A Generalist Foundation Model for Medical Image Interpretationcited by 37
  27. 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 37
  28. 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34
  29. 2024The Essential Role of Causality in Foundation World Models for Embodied AIcited by 32
  30. 2024Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillationcited by 30
  31. 2024Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentationcited by 25
  32. 2024PLUTO: Pathology-Universal Transformercited by 17
  33. 2024A Survey on Trustworthiness in Foundation Models for Medical Image Analysiscited by 16
  34. 2025Localizing Before Answering: A Hallucination Evaluation Benchmark for Grounded Medical Multimodal LLMscited by 14
  35. 2025MIMO: A medical vision language model with visual referring multimodal input and pixel grounding multimodal outputcited by 14
  36. 2023Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Trainingcited by 13
  37. 2024Can Large Language Models Reason? A Characterization via 3-SATcited by 12
  38. 2023Towards Foundation Models Learned from Anatomy in Medical Imaging via Self-Supervisioncited by 11

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025An Explainable Biomedical Foundation Model via Large-Scale Concept-Enhanced Vision-Language Pre-training
  2. 2024Exploring Foundation Models for Synthetic Medical Imaging: A Study on Chest X-Rays and Fine-Tuning Techniques
  3. 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains
  4. 2024Benchmarking foundation models as feature extractors for weakly-supervised computational pathology
  5. 2025Leveraging Vision-Language Foundation Models to Reveal Hidden Image-Attribute Relationships in Medical Imaging
  6. 2025Multi-Modal Foundation Models for Computational Pathology: A Survey
  7. 2024Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare
  8. 2026Scanner-Induced Domain Shifts Undermine the Robustness of Pathology Foundation Models