mlsanityData to 7 Oct 2026

Prompt Mechanisms in Medical Imaging: A Comprehensive Survey

arXiv 2507.01055 ↗First posted 28 Jun 2025eess.IV cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based methodologies have emerged as a pivotal strategy to guide deep learning models, providing flexible, domain-specific adaptations that significantly enhance model performance and adaptability without extensive retraining. This systematic review critically examines the burgeoning landscape of prompt engineering in medical imaging. We dissect diverse prompt modalities, including textual instructions, visual prompts, and learnable embeddings, and analyze their integration for core tasks such as image generation, segmentation, and classification. Our synthesis reveals how these mechanisms improve task-specific outcomes by enhancing accuracy, robustness, and data efficiency and reducing reliance on manual feature engineering while fostering greater model interpretability by making the model's guidance explicit. Despite substantial advancements, we identify persistent challenges, particularly in prompt design optimization, data heterogeneity, and ensuring scalability for clinical deployment. Finally, this review outlines promising future trajectories, including advanced multimodal prompting and robust clinical integration, underscoring the critical role of prompt-driven AI in accelerating the revolution of diagnostics and personalized treatment planning in medicine.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 160 of its 270 references that are in the map. First posted on arXiv 28 Jun 2025.

Builds on

160 of 270 references.

References · 160

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023Segment Anythingcited by 8,158
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  9. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  12. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
38 more
  1. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  2. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  3. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  4. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  5. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  6. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
  7. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
  8. 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
  9. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  10. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  11. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 487
  12. 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 351
  13. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  14. 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
  15. 2022Brain Imaging Generation with Latent Diffusion Modelscited by 267
  16. 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
  17. 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
  18. 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
  19. 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
  20. 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
  21. 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 146
  22. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 132
  23. 2023SAM-Med2Dcited by 123
  24. 2018GAN Augmentation: Augmenting Training Data using Generative Adversarial Networkscited by 107
  25. 2020DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasetscited by 94
  26. 2021CAT: Cross Attention in Vision Transformercited by 92
  27. 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
  28. 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 86
  29. 2021Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?cited by 85
  30. 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domainscited by 85
  31. 2019Multi-scale self-guided attention for medical image segmentationcited by 84
  32. 2021U-Net Transformer: Self and Cross Attention for Medical Image Segmentationcited by 81
  33. 2023SAM on Medical Images: A Comprehensive Study on Three Prompt Modescited by 81
  34. 2023CXR-CLIP: Toward Large Scale Chest X-ray Language-Image Pre-trainingcited by 81
  35. 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
  36. 2023Federated Learning for Medical Image Analysis: A Surveycited by 77
  37. 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Imagescited by 74
  38. 2019Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networkscited by 65

50 most cited of 160 All 160 (JSON)

Built on by

Not cited yet.