When SAM Meets Medical Images: An Investigation of Segment Anything Model (SAM) on Multi-phase Liver Tumor Segmentation
Not on the map. Why?
Abstract (arXiv)
Learning to segmentation without large-scale samples is an inherent capability of human. Recently, Segment Anything Model (SAM) performs the significant zero-shot image segmentation, attracting considerable attention from the computer vision community. Here, we investigate the capability of SAM for medical image analysis, especially for multi-phase liver tumor segmentation (MPLiTS), in terms of prompts, data resolution, phases. Experimental results demonstrate that there might be a large gap between SAM and expected performance. Fortunately, the qualitative results show that SAM is a powerful annotation tool for the community of interactive medical image segmentation.
Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). Builds on 4 of its 9 references that are in the map. First posted on arXiv 17 Apr 2023.
Builds on
4 of 9 references.
References · 4
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023Segment Anythingcited by 8,158
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
Built on by
Citing papers per year: 2023: 23; 2024: 23; 2025: 5; 2026: 1.
52 papers.
Sort:
- 2023Segment Anything in Medical Imagescited by 226
- 2023SAM-Med2Dcited by 123
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 101
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
- 2023SAM on Medical Images: A Comprehensive Study on Three Prompt Modescited by 81
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decodingcited by 48
- 2023Computer-Vision Benchmark Segment-Anything Model (SAM) in Medical Images: Accuracy in 12 Datasetscited by 45
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineeringcited by 45
- 2023AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentationcited by 37
- 2023Self-Prompting Large Vision Models for Few-Shot Medical Image Segmentationcited by 35
38 more
- 2023SAM Meets Robotic Surgery: An Empirical Study on Generalization, Robustness and Adaptationcited by 30
- 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
- 2024Data-Centric Foundation Models in Computational Healthcare: A Surveycited by 27
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
- 2024Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentationcited by 25
- 2023SAM Meets Robotic Surgery: An Empirical Study in Robustness Perspectivecited by 24
- 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
- 2023Towards Segment Anything Model (SAM) for Medical Image Segmentation: A Surveycited by 21
- 2024SAM 2 in Robotic Surgery: An Empirical Evaluation for Robustness and Generalization in Surgical Video Segmentationcited by 21
- 2023FM-OV3D: Foundation Model-based Cross-modal Knowledge Blending for Open-Vocabulary 3D Detectioncited by 19
- 2024MedSAM-U: Uncertainty-Guided Auto Multi-Prompt Adaptation for Reliable MedSAMcited by 17
- 2023Knowledge distillation with Segment Anything (SAM) model for Planetary Geological Mappingcited by 16
- 2024On Efficient Variants of Segment Anything Model: A Surveycited by 16
- 2023mathrmSAMMed: A medical image annotation framework based on large vision modelcited by 13
- 2024M2OST: Many-to-one Regression for Predicting Spatial Transcriptomics from Digital Pathology Imagescited by 13
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptationcited by 12
- 2024S-SAM: SVD-based Fine-Tuning of Segment Anything Model for Medical Image Segmentationcited by 11
- 2023Enhancing the Reliability of Segment Anything Model for Auto-Prompting Medical Image Segmentation with Uncertainty Rectificationcited by 8
- 2024SAM-MIL: A Spatial Contextual Aware Multiple Instance Learning Approach for Whole Slide Image Classificationcited by 6
- 2024RevSAM2: Prompt SAM2 for Medical Image Segmentation via Reverse-Propagation without Fine-tuningcited by 6
- 2024Do Vision Foundation Models Enhance Domain Generalization in Medical Image Segmentation?cited by 6
- 2023AdapterShadow: Adapting Segment Anything Model for Shadow Detectioncited by 5
- 2024SAM-CP: Marrying SAM with Composable Prompts for Versatile Segmentationcited by 5
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Networkcited by 5
- 2023Industrial Segment Anything -- a Case Study in Aircraft Manufacturing, Intralogistics, Maintenance, Repair, and Overhaulcited by 4
- 2024MaskSAM: Towards Auto-prompt SAM with Mask Classification for Volumetric Medical Image Segmentationcited by 4
- 2024RadioActive: 3D Radiological Interactive Segmentation Benchmarkcited by 4
- 2023CEmb-SAM: Segment Anything Model with Condition Embedding for Joint Learning from Heterogeneous Datasetscited by 3
- 2024RClicks: Realistic Click Simulation for Benchmarking Interactive Segmentationcited by 3
- 2024Foundation AI Model for Medical Image Segmentationcited by 2
- 2023BoxCell: Leveraging SAM for Cell Segmentation with Box Supervisioncited by 1
- 2024Adaptive Interactive Segmentation for Multimodal Medical Imaging via Selection Enginecited by 1
- 2025MedFocusCLIP : Improving few shot classification in medical datasets using pixel wise attentioncited by 1
- 2025VesselSAM: Leveraging SAM for Aortic Vessel Segmentation with AtrousLoRAcited by 1
- 2024Does SAM dream of EIG? Characterizing Interactive Segmenter Performance using Expected Information Gaincited by 0
- 2024PAM: A Propagation-Based Model for Segmenting Any 3D Objects across Multi-Modal Medical Imagescited by 0
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domaincited by 0
- 2025TAGS: 3D Tumor-Adaptive Guidance for SAMcited by 0
50 most cited of 52 All 52 (JSON)
- 2026Do Instance Priors Help Weakly Supervised Semantic Segmentation?13 Apr 2026
- 2025Prompt Mechanisms in Medical Imaging: A Comprehensive Survey28 Jun 2025
- 2025TAGS: 3D Tumor-Adaptive Guidance for SAM21 May 2025
- 2025VesselSAM: Leveraging SAM for Aortic Vessel Segmentation with AtrousLoRA25 Feb 2025
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptation2 Feb 2025
- 2025MedFocusCLIP : Improving few shot classification in medical datasets using pixel wise attention7 Jan 2025
- 2024Adaptive Interactive Segmentation for Multimodal Medical Imaging via Selection Engine29 Nov 2024
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domain25 Nov 2024
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network21 Nov 2024
- 2024RadioActive: 3D Radiological Interactive Segmentation Benchmark12 Nov 2024
- 2024Foundation AI Model for Medical Image Segmentation5 Nov 2024
- 2024RClicks: Realistic Click Simulation for Benchmarking Interactive Segmentation15 Oct 2024
38 more
- 2024On Efficient Variants of Segment Anything Model: A Survey7 Oct 2024
- 2024M2OST: Many-to-one Regression for Predicting Spatial Transcriptomics from Digital Pathology Images23 Sep 2024
- 2024Do Vision Foundation Models Enhance Domain Generalization in Medical Image Segmentation?12 Sep 2024
- 2024RevSAM2: Prompt SAM2 for Medical Image Segmentation via Reverse-Propagation without Fine-tuning6 Sep 2024
- 2024MedSAM-U: Uncertainty-Guided Auto Multi-Prompt Adaptation for Reliable MedSAM2 Sep 2024
- 2024PAM: A Propagation-Based Model for Segmenting Any 3D Objects across Multi-Modal Medical Images25 Aug 2024
- 2024S-SAM: SVD-based Fine-Tuning of Segment Anything Model for Medical Image Segmentation12 Aug 2024
- 2024SAM 2 in Robotic Surgery: An Empirical Evaluation for Robustness and Generalization in Surgical Video Segmentation8 Aug 2024
- 2024SAM-MIL: A Spatial Contextual Aware Multiple Instance Learning Approach for Whole Slide Image Classification25 Jul 2024
- 2024SAM-CP: Marrying SAM with Composable Prompts for Versatile Segmentation23 Jul 2024
- 2024Does SAM dream of EIG? Characterizing Interactive Segmenter Performance using Expected Information Gain24 Apr 2024
- 2024Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentation9 Apr 2024
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decoding27 Mar 2024
- 2024MaskSAM: Towards Auto-prompt SAM with Mask Classification for Volumetric Medical Image Segmentation21 Mar 2024
- 2024Foundation Models for Biomedical Image Segmentation: A Survey15 Jan 2024
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directions7 Jan 2024
- 2024Data-Centric Foundation Models in Computational Healthcare: A Survey4 Jan 2024
- 2023FM-OV3D: Foundation Model-based Cross-modal Knowledge Blending for Open-Vocabulary 3D Detection22 Dec 2023
- 2023BoxCell: Leveraging SAM for Cell Segmentation with Box Supervision29 Nov 2023
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomy23 Nov 2023
- 2023Enhancing the Reliability of Segment Anything Model for Auto-Prompting Medical Image Segmentation with Uncertainty Rectification17 Nov 2023
- 2023AdapterShadow: Adapting Segment Anything Model for Shadow Detection15 Nov 2023
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Images23 Oct 2023
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentation16 Sep 2023
- 2023SAM-Med2D30 Aug 2023
- 2023Self-Prompting Large Vision Models for Few-Shot Medical Image Segmentation15 Aug 2023
- 2023SAM Meets Robotic Surgery: An Empirical Study on Generalization, Robustness and Adaptation14 Aug 2023
- 2023CEmb-SAM: Segment Anything Model with Condition Embedding for Joint Learning from Heterogeneous Datasets14 Aug 2023
- 2023AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentation7 Aug 2023
- 2023Industrial Segment Anything -- a Case Study in Aircraft Manufacturing, Intralogistics, Maintenance, Repair, and Overhaul24 Jul 2023
- 2023mathrmSAMMed: A medical image annotation framework based on large vision model11 Jul 2023
- 2023Segment Anything Model (SAM) for Radiation Oncology20 Jun 2023
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyond14 May 2023
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering12 May 2023
- 2023Knowledge distillation with Segment Anything (SAM) model for Planetary Geological Mapping12 May 2023
- 2023Towards Segment Anything Model (SAM) for Medical Image Segmentation: A Survey5 May 2023
- 2023SAM on Medical Images: A Comprehensive Study on Three Prompt Modes28 Apr 2023
- 2023SAM Meets Robotic Surgery: An Empirical Study in Robustness Perspective28 Apr 2023
50 newest of 52 All 52 (JSON)
- 2023Segment Anything in Medical Imagescited by 226
- 2023SAM-Med2Dcited by 123
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 101
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
- 2023SAM on Medical Images: A Comprehensive Study on Three Prompt Modescited by 81
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decodingcited by 48
- 2023Computer-Vision Benchmark Segment-Anything Model (SAM) in Medical Images: Accuracy in 12 Datasetscited by 45
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineeringcited by 45
- 2023AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentationcited by 37
- 2023Self-Prompting Large Vision Models for Few-Shot Medical Image Segmentationcited by 35
12 most cited of 52 All 52 (JSON)
- 2026Do Instance Priors Help Weakly Supervised Semantic Segmentation?13 Apr 2026
- 2025Prompt Mechanisms in Medical Imaging: A Comprehensive Survey28 Jun 2025
- 2025TAGS: 3D Tumor-Adaptive Guidance for SAM21 May 2025
- 2025VesselSAM: Leveraging SAM for Aortic Vessel Segmentation with AtrousLoRA25 Feb 2025
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptation2 Feb 2025
- 2025MedFocusCLIP : Improving few shot classification in medical datasets using pixel wise attention7 Jan 2025
- 2024Adaptive Interactive Segmentation for Multimodal Medical Imaging via Selection Engine29 Nov 2024
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domain25 Nov 2024
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network21 Nov 2024
- 2024RadioActive: 3D Radiological Interactive Segmentation Benchmark12 Nov 2024
- 2024Foundation AI Model for Medical Image Segmentation5 Nov 2024
- 2024RClicks: Realistic Click Simulation for Benchmarking Interactive Segmentation15 Oct 2024
12 newest of 52 All 52 (JSON)