Segment Anything Model (SAM) for Radiation Oncology
Not on the map. Why?
Abstract (arXiv)
In this study, we evaluate the performance of the Segment Anything Model (SAM) in clinical radiotherapy. Our results indicate that SAM's 'segment anything' mode can achieve clinically acceptable segmentation results in most organs-at-risk (OARs) with Dice scores higher than 0.7. SAM's 'box prompt' mode further improves the Dice scores by 0.1 to 0.5. Considering the size of the organ and the clarity of its boundary, SAM displays better performance for large organs with clear boundaries but performs worse for smaller organs with unclear boundaries. Given that SAM, a model pre-trained purely on natural images, can handle the delineation of OARs from medical images with clinically acceptable accuracy, these results highlight SAM's robust generalization capabilities with consistent accuracy in automatic segmentation for radiotherapy. In other words, SAM can achieve delineation of different OARs at different sites using a generic automatic segmentation model. SAM's generalization capabilities across different disease sites suggest that it is technically feasible to develop a generic model for automatic segmentation in radiotherapy.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 48 of its 116 references that are in the map. First posted on arXiv 20 Jun 2023.
Builds on
48 of 116 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2023PaLM 2 Technical Reportcited by 1,154
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 485
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
36 more
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2020U-Net and its variants for medical image segmentation: theory and applicationscited by 169
- 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
- 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
- 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 128
- 2023Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applicationscited by 121
- 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
- 2023SAM Struggles in Concealed Scenes -- Empirical Study on Segment Anythingcited by 75
- 2023Polyp-SAM: Transfer SAM for Polyp Segmentationcited by 64
- 2023Can SAM Segment Polyps?cited by 59
- 2023An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPTcited by 57
- 2018AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomycited by 54
- 2023When Brain-inspired AI Meets AGIcited by 54
- 2023When SAM Meets Medical Images: An Investigation of Segment Anything Model (SAM) on Multi-phase Liver Tumor Segmentationcited by 52
- 2023Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physicscited by 49
- 2023Radiology-GPT: A Large Language Model for Radiologycited by 44
- 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
- 2023AD-AutoGPT: An Autonomous GPT for Alzheimer's Disease Infodemiologycited by 34
- 2023Edit Everything: A Text-Guided Generative System for Images Editingcited by 33
- 2023Context Matters: A Strategy to Pre-train Language Model for Science Educationcited by 32
- 2023Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Taskcited by 32
- 2023SkinSAM: Empowering Skin Cancer Segmentation with Segment Anything Modelcited by 32
- 2023Artificial General Intelligence for Medical Imaging Analysiscited by 32
- 2023ChatABL: Abductive Learning via Natural Language Interaction with ChatGPTcited by 26
- 2023Differentiate ChatGPT-generated and Human-written Medical Textscited by 26
- 2023Mask-guided BERT for Few Shot Text Classificationcited by 25
- 2022Coarse-to-fine Knowledge Graph Domain Adaptation based on Distantly-supervised Iterative Trainingcited by 20
- 2022Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Reportcited by 18
- 2023Any-to-Any Style Transfer: Making Picasso and Da Vinci Collaboratecited by 17
- 2023The Segment Anything foundation model achieves favorable brain tumor autosegmentation accuracy on MRI to support radiotherapy treatment planningcited by 15
- 2023Deep learning universal crater detection using Segment Anything Model (SAM)cited by 14
- 2018Deep Generative Models in the Real-World: An Open Challenge from Medical Imagingcited by 12
- 2023Deep-Learning-based Fast and Accurate 3D CT Deformable Image Registration in Lung Cancercited by 10
- 2022Discovering Dynamic Functional Brain Networks via Spatial and Channel-wise Attentioncited by 8
- 2023BreastSAM: A Study of Segment Anything Model for Breast Tumor Detection in Ultrasound Imagescited by 7
Built on by
Citing papers per year: 2023: 11; 2024: 10; 2025: 2; 2026: 1.
24 papers.
Sort:
By area:
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 88
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 58
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decodingcited by 48
- 2023Radiology-Llama2: Best-in-Class Large Language Model for Radiologycited by 42
- 2023SAMAug: Point Prompt Augmentation for Segment Anything Modelcited by 38
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
- 2024Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAMcited by 23
- 2023LLM-driven Multimodal Target Volume Contouring in Radiation Oncologycited by 20
- 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
- 2023RadOnc-GPT: A Large Language Model for Radiation Oncologycited by 18
12 more
- 2024MAS-SAM: Segment Any Marine Animal with Aggregated Featurescited by 15
- 2023Evaluating Large Language Models for Radiology Natural Language Processingcited by 12
- 2025Vision Foundation Models in Medical Image Analysis: Advances and Challengescited by 9
- 2024Unleashing the Potential of Vision-Language Pre-Training for 3D Zero-Shot Lesion Segmentation via Mask-Attribute Alignmentcited by 7
- 2023Hierarchical Semantic Tree Concept Whitening for Interpretable Image Classificationcited by 5
- 2023Benchmarking a foundation LLM on its ability to re-label structure names in accordance with the AAPM TG-263 reportcited by 5
- 2024Gaze-Assisted Medical Image Segmentationcited by 4
- 2023PharmacyGPT: The AI Pharmacistcited by 3
- 2024Boosting Federated Domain Generalization: Understanding the Role of Advanced Pre-Trained Architecturescited by 3
- 2024Mixture of Multicenter Experts in Multimodal AI for Debiased Radiotherapy Target Delineationcited by 1
- 2025LithoSeg: A Coarse-to-Fine Framework for High-Precision Lithography Segmentationcited by 0
- 2026ScribbleDose: Scribble-Guided Dose Prediction in Radiotherapycited by 0
- 2026ScribbleDose: Scribble-Guided Dose Prediction in Radiotherapy12 May 2026
- 2025LithoSeg: A Coarse-to-Fine Framework for High-Precision Lithography Segmentation15 Nov 2025
- 2025Vision Foundation Models in Medical Image Analysis: Advances and Challenges20 Feb 2025
- 2024Gaze-Assisted Medical Image Segmentation23 Oct 2024
- 2024Unleashing the Potential of Vision-Language Pre-Training for 3D Zero-Shot Lesion Segmentation via Mask-Attribute Alignment21 Oct 2024
- 2024Mixture of Multicenter Experts in Multimodal AI for Debiased Radiotherapy Target Delineation27 Sep 2024
- 2024Boosting Federated Domain Generalization: Understanding the Role of Advanced Pre-Trained Architectures20 Sep 2024
- 2024MAS-SAM: Segment Any Marine Animal with Aggregated Features24 Apr 2024
- 2024Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAM7 Apr 2024
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decoding27 Mar 2024
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectives9 Jan 2024
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directions7 Jan 2024
12 more
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inference4 Jan 2024
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomy23 Nov 2023
- 2023Holistic Evaluation of GPT-4V for Biomedical Imaging10 Nov 2023
- 2023LLM-driven Multimodal Target Volume Contouring in Radiation Oncology3 Nov 2023
- 2023Benchmarking a foundation LLM on its ability to re-label structure names in accordance with the AAPM TG-263 report5 Oct 2023
- 2023RadOnc-GPT: A Large Language Model for Radiation Oncology18 Sep 2023
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentation16 Sep 2023
- 2023Radiology-Llama2: Best-in-Class Large Language Model for Radiology29 Aug 2023
- 2023Evaluating Large Language Models for Radiology Natural Language Processing25 Jul 2023
- 2023PharmacyGPT: The AI Pharmacist19 Jul 2023
- 2023Hierarchical Semantic Tree Concept Whitening for Interpretable Image Classification10 Jul 2023
- 2023SAMAug: Point Prompt Augmentation for Segment Anything Model3 Jul 2023
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 58
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decodingcited by 48
- 2023Radiology-Llama2: Best-in-Class Large Language Model for Radiologycited by 42
- 2023SAMAug: Point Prompt Augmentation for Segment Anything Modelcited by 38
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
- 2024Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAMcited by 23
- 2023LLM-driven Multimodal Target Volume Contouring in Radiation Oncologycited by 20
- 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
- 2023RadOnc-GPT: A Large Language Model for Radiation Oncologycited by 18
- 2024MAS-SAM: Segment Any Marine Animal with Aggregated Featurescited by 15
12 most cited of 21 All 21 (JSON)
- 2026ScribbleDose: Scribble-Guided Dose Prediction in Radiotherapy12 May 2026
- 2025LithoSeg: A Coarse-to-Fine Framework for High-Precision Lithography Segmentation15 Nov 2025
- 2025Vision Foundation Models in Medical Image Analysis: Advances and Challenges20 Feb 2025
- 2024Gaze-Assisted Medical Image Segmentation23 Oct 2024
- 2024Boosting Federated Domain Generalization: Understanding the Role of Advanced Pre-Trained Architectures20 Sep 2024
- 2024MAS-SAM: Segment Any Marine Animal with Aggregated Features24 Apr 2024
- 2024Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAM7 Apr 2024
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decoding27 Mar 2024
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directions7 Jan 2024
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inference4 Jan 2024
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomy23 Nov 2023
- 2023Holistic Evaluation of GPT-4V for Biomedical Imaging10 Nov 2023
12 newest of 21 All 21 (JSON)