Can SAM Segment Polyps?
Not on the map. Why?
Abstract (arXiv)
Recently, Meta AI Research releases a general Segment Anything Model (SAM), which has demonstrated promising performance in several segmentation tasks. As we know, polyp segmentation is a fundamental task in the medical imaging field, which plays a critical role in the diagnosis and cure of colorectal cancer. In particular, applying SAM to the polyp segmentation task is interesting. In this report, we evaluate the performance of SAM in segmenting polyps, in which SAM is under unprompted settings. We hope this report will provide insights to advance this polyp segmentation field and promote more interesting works in the future. This project is publicly at https://github.com/taozh2017/SAMPolyp.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 15 Apr 2023.
Builds on
28 of 38 references.
References · 28
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2016A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Imagescited by 220
- 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
16 more
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2023Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applicationscited by 121
- 2021Shallow Attention Network for Polyp Segmentationcited by 107
- 2023Can SAM Segment Anything? When SAM Meets Camouflaged Object Detectioncited by 99
- 2021Context-aware Cross-level Fusion Network for Camouflaged Object Detectioncited by 86
- 2021Automatic Polyp Segmentation via Multi-scale Subtraction Networkcited by 77
- 2023SAM Struggles in Concealed Scenes -- Empirical Study on Segment Anythingcited by 75
- 2020RGB-D Salient Object Detection: A Surveycited by 73
- 2021HarDNet-MSEG: A Simple Encoder-Decoder Polyp Segmentation Neural Network that Achieves over 0.9 Mean Dice and 86 FPScited by 71
- 2021Specificity-preserving RGB-D Saliency Detectioncited by 70
- 2023SAM.MD: Zero-shot medical image segmentation capabilities of the Segment Anything Modelcited by 61
- 2023Adaptive Context Selection for Polyp Segmentationcited by 47
- 2022Feature Aggregation and Propagation Network for Camouflaged Object Detectioncited by 40
- 2023Lesion-aware Dynamic Kernel for Polyp Segmentationcited by 39
- 2021Enhanced U-Net: A Feature Enhancement Network for Polyp Segmentationcited by 33
- 2021Duplex Contextual Relation Network for Polyp Segmentationcited by 22
Built on by
Citing papers per year: 2023: 33; 2024: 21; 2025: 3; 2026: 2.
59 papers.
Sort:
By area:
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2023Segment Anything in Medical Imagescited by 226
- 2023SAM-Med2Dcited by 123
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 101
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
- 2023SAM on Medical Images: A Comprehensive Study on Three Prompt Modescited by 81
- 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
- 2024Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelcited by 67
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2023Input Augmentation with SAM: Boosting Medical Image Segmentation with Segmentation Foundation Modelcited by 56
38 more
- 2023Computer-Vision Benchmark Segment-Anything Model (SAM) in Medical Images: Accuracy in 12 Datasetscited by 45
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineeringcited by 45
- 2023Are Natural Domain Foundation Models Useful for Medical Image Classification?cited by 44
- 2023SAM3D: Zero-Shot 3D Object Detection via Segment Anything Modelcited by 40
- 2023Segment Anything Model for Medical Images?cited by 39
- 2023Self-Prompting Large Vision Models for Few-Shot Medical Image Segmentationcited by 35
- 2024Interactive Medical Image Segmentation: A Benchmark Dataset and Baselinecited by 30
- 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
- 2024Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentationcited by 25
- 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
- 2023RefSAM: Efficiently Adapting Segmenting Anything Model for Referring Video Object Segmentationcited by 24
- 2023An Empirical Study on the Robustness of the Segment Anything Model (SAM)cited by 23
- 2023Polyp-SAM++: Can A Text Guided SAM Perform Better for Polyp Segmentation?cited by 22
- 2023Towards Segment Anything Model (SAM) for Medical Image Segmentation: A Surveycited by 21
- 2023Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learningcited by 18
- 2024SAFIRE: Segment Any Forged Image Regioncited by 18
- 2024Interactive 3D Medical Image Segmentation with SAM 2cited by 17
- 2023mathrmSAMMed: A medical image annotation framework based on large vision modelcited by 13
- 2023Leaf Only SAM: A Segment Anything Pipeline for Zero-Shot Automated Leaf Segmentationcited by 12
- 2023SamDSK: Combining Segment Anything Model with Domain-Specific Knowledge for Semi-Supervised Learning in Medical Image Segmentationcited by 12
- 2023A Survey on Deep Learning for Polyp Segmentation: Techniques, Challenges and Future Trendscited by 12
- 2024ASPS: Augmented Segment Anything Model for Polyp Segmentationcited by 12
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptationcited by 12
- 2023Temporally-Extended Prompts Optimization for SAM in Interactive Medical Image Segmentationcited by 9
- 2024Polyp SAM 2: Advancing Zero shot Polyp Segmentation in Colorectal Cancer Detectioncited by 8
- 2024SAM-Mamba: Mamba Guided SAM Architecture for Generalized Zero-Shot Polyp Segmentationcited by 7
- 2024Do Vision Foundation Models Enhance Domain Generalization in Medical Image Segmentation?cited by 6
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Surveycited by 5
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Networkcited by 5
- 2023Rethinking Polyp Segmentation from an Out-of-Distribution Perspectivecited by 4
- 2023Industrial Segment Anything -- a Case Study in Aircraft Manufacturing, Intralogistics, Maintenance, Repair, and Overhaulcited by 4
- 2024MaskSAM: Towards Auto-prompt SAM with Mask Classification for Volumetric Medical Image Segmentationcited by 4
- 2023Empirical Analysis of a Segmentation Foundation Model in Prostate Imagingcited by 3
- 2023CEmb-SAM: Segment Anything Model with Condition Embedding for Joint Learning from Heterogeneous Datasetscited by 3
- 2024ProMISe: Promptable Medical Image Segmentation using SAMcited by 3
- 2026Boosting Segment Anything Model to Generalize Visually Non-Salient Scenarioscited by 3
- 2023Segment Anything Model-guided Collaborative Learning Network for Scribble-supervised Polyp Segmentationcited by 2
- 2024Foundation AI Model for Medical Image Segmentationcited by 2
50 most cited of 59 All 59 (JSON)
- 2026BALD-SAM: Disagreement-based Active Prompting in Interactive Segmentation11 Mar 2026
- 2026Boosting Segment Anything Model to Generalize Visually Non-Salient Scenarios2 Jan 2026
- 2025Mamba Guided Boundary Prior Matters: A New Perspective for Generalized Polyp Segmentation2 Jul 2025
- 2025Frequency Domain Enhanced U-Net for Low-Frequency Information-Rich Image Segmentation in Surgical and Deep-Sea Exploration Robots6 Feb 2025
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptation2 Feb 2025
- 2024SAM-Mamba: Mamba Guided SAM Architecture for Generalized Zero-Shot Polyp Segmentation11 Dec 2024
- 2024SAFIRE: Segment Any Forged Image Region11 Dec 2024
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network21 Nov 2024
- 2024Interactive Medical Image Segmentation: A Benchmark Dataset and Baseline19 Nov 2024
- 2024Foundation AI Model for Medical Image Segmentation5 Nov 2024
- 2024Segment Anything for Dendrites from Electron Microscopy4 Nov 2024
- 2024Adapting Segment Anything Model to Melanoma Segmentation in Microscopy Slide Images3 Oct 2024
38 more
- 2024Do Vision Foundation Models Enhance Domain Generalization in Medical Image Segmentation?12 Sep 2024
- 2024PAM: A Propagation-Based Model for Segmenting Any 3D Objects across Multi-Modal Medical Images25 Aug 2024
- 2024Polyp SAM 2: Advancing Zero shot Polyp Segmentation in Colorectal Cancer Detection12 Aug 2024
- 2024Interactive 3D Medical Image Segmentation with SAM 25 Aug 2024
- 2024ASPS: Augmented Segment Anything Model for Polyp Segmentation30 Jun 2024
- 2024Does SAM dream of EIG? Characterizing Interactive Segmenter Performance using Expected Information Gain24 Apr 2024
- 2024Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentation9 Apr 2024
- 2024MaskSAM: Towards Auto-prompt SAM with Mask Classification for Volumetric Medical Image Segmentation21 Mar 2024
- 2024Task-Specific Adaptation of Segmentation Foundation Model via Prompt Learning14 Mar 2024
- 2024ProMISe: Promptable Medical Image Segmentation using SAM7 Mar 2024
- 2024Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Model31 Jan 2024
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Survey22 Jan 2024
- 2024Foundation Models for Biomedical Image Segmentation: A Survey15 Jan 2024
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directions7 Jan 2024
- 2023SQA-SAM: Segmentation Quality Assessment for Medical Images Utilizing the Segment Anything Model15 Dec 2023
- 2023Segment Anything Model-guided Collaborative Learning Network for Scribble-supervised Polyp Segmentation1 Dec 2023
- 2023A Survey on Deep Learning for Polyp Segmentation: Techniques, Challenges and Future Trends30 Nov 2023
- 2023Are Natural Domain Foundation Models Useful for Medical Image Classification?30 Oct 2023
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Images23 Oct 2023
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistants18 Sep 2023
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentation16 Sep 2023
- 2023Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learning31 Aug 2023
- 2023SAM-Med2D30 Aug 2023
- 2023SamDSK: Combining Segment Anything Model with Domain-Specific Knowledge for Semi-Supervised Learning in Medical Image Segmentation26 Aug 2023
- 2023Self-Prompting Large Vision Models for Few-Shot Medical Image Segmentation15 Aug 2023
- 2023CEmb-SAM: Segment Anything Model with Condition Embedding for Joint Learning from Heterogeneous Datasets14 Aug 2023
- 2023Polyp-SAM++: Can A Text Guided SAM Perform Better for Polyp Segmentation?12 Aug 2023
- 2023Industrial Segment Anything -- a Case Study in Aircraft Manufacturing, Intralogistics, Maintenance, Repair, and Overhaul24 Jul 2023
- 2023mathrmSAMMed: A medical image annotation framework based on large vision model11 Jul 2023
- 2023Empirical Analysis of a Segmentation Foundation Model in Prostate Imaging6 Jul 2023
- 2023RefSAM: Efficiently Adapting Segmenting Anything Model for Referring Video Object Segmentation3 Jul 2023
- 2023Review of Large Vision Models and Visual Prompt Engineering3 Jul 2023
- 2023Segment Anything Model (SAM) for Radiation Oncology20 Jun 2023
- 2023Temporally-Extended Prompts Optimization for SAM in Interactive Medical Image Segmentation15 Jun 2023
- 2023Rethinking Polyp Segmentation from an Out-of-Distribution Perspective13 Jun 2023
- 2023SAM3D: Zero-Shot 3D Object Detection via Segment Anything Model4 Jun 2023
- 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Grouping18 May 2023
- 2023Leaf Only SAM: A Segment Anything Pipeline for Zero-Shot Automated Leaf Segmentation16 May 2023
50 newest of 59 All 59 (JSON)
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2023Segment Anything in Medical Imagescited by 226
- 2023SAM-Med2Dcited by 123
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 101
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
- 2023SAM on Medical Images: A Comprehensive Study on Three Prompt Modescited by 81
- 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
- 2024Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelcited by 67
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2023Input Augmentation with SAM: Boosting Medical Image Segmentation with Segmentation Foundation Modelcited by 56
12 most cited of 57 All 57 (JSON)
- 2026BALD-SAM: Disagreement-based Active Prompting in Interactive Segmentation11 Mar 2026
- 2026Boosting Segment Anything Model to Generalize Visually Non-Salient Scenarios2 Jan 2026
- 2025Frequency Domain Enhanced U-Net for Low-Frequency Information-Rich Image Segmentation in Surgical and Deep-Sea Exploration Robots6 Feb 2025
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptation2 Feb 2025
- 2024SAFIRE: Segment Any Forged Image Region11 Dec 2024
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network21 Nov 2024
- 2024Interactive Medical Image Segmentation: A Benchmark Dataset and Baseline19 Nov 2024
- 2024Foundation AI Model for Medical Image Segmentation5 Nov 2024
- 2024Segment Anything for Dendrites from Electron Microscopy4 Nov 2024
- 2024Adapting Segment Anything Model to Melanoma Segmentation in Microscopy Slide Images3 Oct 2024
- 2024Do Vision Foundation Models Enhance Domain Generalization in Medical Image Segmentation?12 Sep 2024
- 2024PAM: A Propagation-Based Model for Segmenting Any 3D Objects across Multi-Modal Medical Images25 Aug 2024
12 newest of 57 All 57 (JSON)