mlsanityData to 7 Oct 2026

Segment Anything Model (SAM) for Radiation Oncology

arXiv 2306.11730 ↗First posted 20 Jun 2023eess.IV cs.CV cs.LGcited by 24

Not on the map. Why?

Abstract (arXiv)

In this study, we evaluate the performance of the Segment Anything Model (SAM) in clinical radiotherapy. Our results indicate that SAM's 'segment anything' mode can achieve clinically acceptable segmentation results in most organs-at-risk (OARs) with Dice scores higher than 0.7. SAM's 'box prompt' mode further improves the Dice scores by 0.1 to 0.5. Considering the size of the organ and the clarity of its boundary, SAM displays better performance for large organs with clear boundaries but performs worse for smaller organs with unclear boundaries. Given that SAM, a model pre-trained purely on natural images, can handle the delineation of OARs from medical images with clinically acceptable accuracy, these results highlight SAM's robust generalization capabilities with consistent accuracy in automatic segmentation for radiotherapy. In other words, SAM can achieve delineation of different OARs at different sites using a generic automatic segmentation model. SAM's generalization capabilities across different disease sites suggest that it is technically feasible to develop a generic model for automatic segmentation in radiotherapy.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 48 of its 116 references that are in the map. First posted on arXiv 20 Jun 2023.

Builds on

48 of 116 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2023Segment Anythingcited by 8,158
  7. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  8. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  9. 2023PaLM 2 Technical Reportcited by 1,154
  10. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  11. 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 485
  12. 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
36 more
  1. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  2. 2020U-Net and its variants for medical image segmentation: theory and applicationscited by 169
  3. 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
  4. 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
  5. 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
  6. 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 128
  7. 2023Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applicationscited by 121
  8. 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
  9. 2023SAM Struggles in Concealed Scenes -- Empirical Study on Segment Anythingcited by 75
  10. 2023Polyp-SAM: Transfer SAM for Polyp Segmentationcited by 64
  11. 2023Can SAM Segment Polyps?cited by 59
  12. 2023An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPTcited by 57
  13. 2018AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomycited by 54
  14. 2023When Brain-inspired AI Meets AGIcited by 54
  15. 2023When SAM Meets Medical Images: An Investigation of Segment Anything Model (SAM) on Multi-phase Liver Tumor Segmentationcited by 52
  16. 2023Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physicscited by 49
  17. 2023Radiology-GPT: A Large Language Model for Radiologycited by 44
  18. 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
  19. 2023AD-AutoGPT: An Autonomous GPT for Alzheimer's Disease Infodemiologycited by 34
  20. 2023Edit Everything: A Text-Guided Generative System for Images Editingcited by 33
  21. 2023Context Matters: A Strategy to Pre-train Language Model for Science Educationcited by 32
  22. 2023Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Taskcited by 32
  23. 2023SkinSAM: Empowering Skin Cancer Segmentation with Segment Anything Modelcited by 32
  24. 2023Artificial General Intelligence for Medical Imaging Analysiscited by 32
  25. 2023ChatABL: Abductive Learning via Natural Language Interaction with ChatGPTcited by 26
  26. 2023Differentiate ChatGPT-generated and Human-written Medical Textscited by 26
  27. 2023Mask-guided BERT for Few Shot Text Classificationcited by 25
  28. 2022Coarse-to-fine Knowledge Graph Domain Adaptation based on Distantly-supervised Iterative Trainingcited by 20
  29. 2022Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Reportcited by 18
  30. 2023Any-to-Any Style Transfer: Making Picasso and Da Vinci Collaboratecited by 17
  31. 2023The Segment Anything foundation model achieves favorable brain tumor autosegmentation accuracy on MRI to support radiotherapy treatment planningcited by 15
  32. 2023Deep learning universal crater detection using Segment Anything Model (SAM)cited by 14
  33. 2018Deep Generative Models in the Real-World: An Open Challenge from Medical Imagingcited by 12
  34. 2023Deep-Learning-based Fast and Accurate 3D CT Deformable Image Registration in Lung Cancercited by 10
  35. 2022Discovering Dynamic Functional Brain Networks via Spatial and Channel-wise Attentioncited by 8
  36. 2023BreastSAM: A Study of Segment Anything Model for Breast Tumor Detection in Ultrasound Imagescited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 11; 2024: 10; 2025: 2; 2026: 1.

24 papers.

Sort:

By area:

  1. 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
  2. 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 88
  3. 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
  4. 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 58
  5. 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decodingcited by 48
  6. 2023Radiology-Llama2: Best-in-Class Large Language Model for Radiologycited by 42
  7. 2023SAMAug: Point Prompt Augmentation for Segment Anything Modelcited by 38
  8. 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
  9. 2024Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAMcited by 23
  10. 2023LLM-driven Multimodal Target Volume Contouring in Radiation Oncologycited by 20
  11. 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
  12. 2023RadOnc-GPT: A Large Language Model for Radiation Oncologycited by 18
12 more
  1. 2024MAS-SAM: Segment Any Marine Animal with Aggregated Featurescited by 15
  2. 2023Evaluating Large Language Models for Radiology Natural Language Processingcited by 12
  3. 2025Vision Foundation Models in Medical Image Analysis: Advances and Challengescited by 9
  4. 2024Unleashing the Potential of Vision-Language Pre-Training for 3D Zero-Shot Lesion Segmentation via Mask-Attribute Alignmentcited by 7
  5. 2023Hierarchical Semantic Tree Concept Whitening for Interpretable Image Classificationcited by 5
  6. 2023Benchmarking a foundation LLM on its ability to re-label structure names in accordance with the AAPM TG-263 reportcited by 5
  7. 2024Gaze-Assisted Medical Image Segmentationcited by 4
  8. 2023PharmacyGPT: The AI Pharmacistcited by 3
  9. 2024Boosting Federated Domain Generalization: Understanding the Role of Advanced Pre-Trained Architecturescited by 3
  10. 2024Mixture of Multicenter Experts in Multimodal AI for Debiased Radiotherapy Target Delineationcited by 1
  11. 2025LithoSeg: A Coarse-to-Fine Framework for High-Precision Lithography Segmentationcited by 0
  12. 2026ScribbleDose: Scribble-Guided Dose Prediction in Radiotherapycited by 0