Toward Clinically Ready Foundation Models in Medical Image Analysis: Adaptation Mechanisms and Deployment Trade-offs
Not on the map. Why?
Abstract (arXiv)
Foundation models (FMs) have demonstrated strong transferability across medical imaging tasks, yet their clinical utility depends critically on how pretrained representations are adapted to domain-specific data, supervision regimes, and deployment constraints. Prior surveys primarily emphasize architectural advances and application coverage, while the mechanisms of adaptation and their implications for robustness, calibration, and regulatory feasibility remain insufficiently structured. This review introduces a strategy-centric framework for FM adaptation in medical image analysis (MIA). We conceptualize adaptation as a post-pretraining intervention and organize existing approaches into five mechanisms: parameter-, representation-, objective-, data-centric, and architectural/sequence-level adaptation. For each mechanism, we analyze trade-offs in adaptation depth, label efficiency, domain robustness, computational cost, auditability, and regulatory burden. We synthesize evidence across classification, segmentation, and detection tasks, highlighting how adaptation strategies influence clinically relevant failure modes rather than only aggregate benchmark performance. Finally, we examine how adaptation choices interact with validation protocols, calibration stability, multi-institutional deployment, and regulatory oversight. By reframing adaptation as a process of controlled representational change under clinical constraints, this review provides practical guidance for designing FM-based systems that are robust, auditable, and compatible with clinical deployment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 77 of its 123 references that are in the map. First posted on arXiv 15 Mar 2026.
Builds on
77 of 123 references.
References · 77
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022Generative Adversarial Networkscited by 5,627
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
38 more
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
- 2014How transferable are features in deep neural networks?cited by 1,225
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2018Experience Replay for Continual Learningcited by 1,095
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
- 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 872
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 641
- 2020The Future of Digital Health with Federated Learningcited by 633
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2020A Survey on Contrastive Self-supervised Learningcited by 554
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
- 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
- 2021Deep Long-Tailed Learning: A Surveycited by 417
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 379
- 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 368
- 2023A Survey of Hallucination in Large Foundation Modelscited by 368
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2023Customized Segment Anything Model for Medical Image Segmentationcited by 280
- 2023Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessmentcited by 230
- 2017Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?cited by 221
- 20203D Self-Supervised Methods for Medical Imagingcited by 134
- 2017Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasmcited by 118
- 2019Reducing the Hausdorff Distance in Medical Image Segmentation with Convolutional Neural Networkscited by 116
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 111
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 107
- 2025MedSAM2: Segment Anything in 3D Medical Images and Videoscited by 96
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 95
- 2025Medical Hallucinations in Foundation Models and Their Impact on Healthcarecited by 93
50 most cited of 77 All 77 (JSON)
Built on by
Not cited yet.