Prompt Mechanisms in Medical Imaging: A Comprehensive Survey
Not on the map. Why?
Abstract (arXiv)
Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based methodologies have emerged as a pivotal strategy to guide deep learning models, providing flexible, domain-specific adaptations that significantly enhance model performance and adaptability without extensive retraining. This systematic review critically examines the burgeoning landscape of prompt engineering in medical imaging. We dissect diverse prompt modalities, including textual instructions, visual prompts, and learnable embeddings, and analyze their integration for core tasks such as image generation, segmentation, and classification. Our synthesis reveals how these mechanisms improve task-specific outcomes by enhancing accuracy, robustness, and data efficiency and reducing reliance on manual feature engineering while fostering greater model interpretability by making the model's guidance explicit. Despite substantial advancements, we identify persistent challenges, particularly in prompt design optimization, data heterogeneity, and ensuring scalability for clinical deployment. Finally, this review outlines promising future trajectories, including advanced multimodal prompting and robust clinical integration, underscoring the critical role of prompt-driven AI in accelerating the revolution of diagnostics and personalized treatment planning in medicine.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 160 of its 270 references that are in the map. First posted on arXiv 28 Jun 2025.
Builds on
160 of 270 references.
References · 160
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2022Generative Adversarial Networkscited by 5,603
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
38 more
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 487
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 351
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2022Brain Imaging Generation with Latent Diffusion Modelscited by 267
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
- 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
- 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
- 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 146
- 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 132
- 2023SAM-Med2Dcited by 123
- 2018GAN Augmentation: Augmenting Training Data using Generative Adversarial Networkscited by 107
- 2020DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasetscited by 94
- 2021CAT: Cross Attention in Vision Transformercited by 92
- 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
- 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 86
- 2021Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?cited by 85
- 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domainscited by 85
- 2019Multi-scale self-guided attention for medical image segmentationcited by 84
- 2021U-Net Transformer: Self and Cross Attention for Medical Image Segmentationcited by 81
- 2023SAM on Medical Images: A Comprehensive Study on Three Prompt Modescited by 81
- 2023CXR-CLIP: Toward Large Scale Chest X-ray Language-Image Pre-trainingcited by 81
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
- 2023Federated Learning for Medical Image Analysis: A Surveycited by 77
- 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Imagescited by 74
- 2019Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networkscited by 65
50 most cited of 160 All 160 (JSON)
Built on by
Not cited yet.