# Adaptive Context Selection for Polyp Segmentation

arXiv: https://arxiv.org/abs/2301.04799 · HTML: https://mlsanity.com/paper/2301.04799/

## Key facts

- Cited by 47 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 21 references that are in the map.
- First posted on arXiv 12 Jan 2023.

## Builds on (most cited first, 17 of 17)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Feature Pyramid Networks for Object Detection](https://mlsanity.com/paper/1612.03144/) (2016)
- [Fully Convolutional Networks for Semantic Segmentation](https://mlsanity.com/paper/1411.4038/) (2014)
- [Squeeze-and-Excitation Networks](https://mlsanity.com/paper/1709.01507/) (2017)
- [Pyramid Scene Parsing Network](https://mlsanity.com/paper/1612.01105/) (2016)
- [Non-local Neural Networks](https://mlsanity.com/paper/1711.07971/) (2017)
- [UNet++: A Nested U-Net Architecture for Medical Image Segmentation](https://mlsanity.com/paper/1807.10165/) (2018)
- [Kvasir-SEG: A Segmented Polyp Dataset](https://mlsanity.com/paper/1911.07069/) (2019)
- [A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images](https://mlsanity.com/paper/1612.00799/) (2016)
- [A Simple Pooling-Based Design for Real-Time Salient Object Detection](https://mlsanity.com/paper/1904.09569/) (2019)
- [Adaptive Context Network for Scene Parsing](https://mlsanity.com/paper/1911.01664/) (2019)
- [Polyp Segmentation in Colonoscopy Images Using Fully Convolutional Network](https://mlsanity.com/paper/1802.00368/) (2018)
- [Cubic LSTMs for Video Prediction](https://mlsanity.com/paper/1904.09412/) (2019)
- [Uncertainty and Interpretability in Convolutional Neural Networks for Semantic Segmentation of Colorectal Polyps](https://mlsanity.com/paper/1807.10584/) (2018)
- [Contrast-Oriented Deep Neural Networks for Salient Object Detection](https://mlsanity.com/paper/1803.11395/) (2018)

## Built on by (most cited first, 30 of 47)

- [Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Grouping](https://mlsanity.com/paper/2305.11003/) (2023)
- [AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encoder](https://mlsanity.com/paper/2306.06370/) (2023)
- [Can SAM Segment Polyps?](https://mlsanity.com/paper/2304.07583/) (2023)
- [Vivim: a Video Vision Mamba for Medical Video Segmentation](https://mlsanity.com/paper/2401.14168/) (2024)
- [ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Models](https://mlsanity.com/paper/2309.01111/) (2023)
- [MEGANet: Multi-Scale Edge-Guided Attention Network for Weak Boundary Polyp Segmentation](https://mlsanity.com/paper/2309.03329/) (2023)
- [Polyp-SAM++: Can A Text Guided SAM Perform Better for Polyp Segmentation?](https://mlsanity.com/paper/2308.06623/) (2023)
- [WeakPolyp: You Only Look Bounding Box for Polyp Segmentation](https://mlsanity.com/paper/2307.10912/) (2023)
- [Spider: A Unified Framework for Context-dependent Concept Segmentation](https://mlsanity.com/paper/2405.01002/) (2024)
- [Towards Diverse Binary Segmentation via A Simple yet General Gated Network](https://mlsanity.com/paper/2303.10396/) (2023)
- [Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videos](https://mlsanity.com/paper/2310.01861/) (2023)
- [Frontiers in Intelligent Colonoscopy](https://mlsanity.com/paper/2410.17241/) (2024)
- [M2SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation](https://mlsanity.com/paper/2303.10894/) (2023)
- [A Survey on Deep Learning for Polyp Segmentation: Techniques, Challenges and Future Trends](https://mlsanity.com/paper/2311.18373/) (2023)
- [GLCONet: Learning Multi-source Perception Representation for Camouflaged Object Detection](https://mlsanity.com/paper/2409.09588/) (2024)
- [Polyper: Boundary Sensitive Polyp Segmentation](https://mlsanity.com/paper/2312.08735/) (2023)
- [Polyp SAM 2: Advancing Zero shot Polyp Segmentation in Colorectal Cancer Detection](https://mlsanity.com/paper/2408.05892/) (2024)
- [Segmenting Medical Images: From UNet to Res-UNet and nnUNet](https://mlsanity.com/paper/2407.04353/) (2024)
- [Diff-VPS: Video Polyp Segmentation via a Multi-task Diffusion Network with Adversarial Temporal Reasoning](https://mlsanity.com/paper/2409.07238/) (2024)
- [Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Survey](https://mlsanity.com/paper/2401.11734/) (2024)
- [Polyp-DAM: Polyp segmentation via depth anything model](https://mlsanity.com/paper/2402.02298/) (2024)
- [Edge-aware Feature Aggregation Network for Polyp Segmentation](https://mlsanity.com/paper/2309.10523/) (2023)
- [SegT: A Novel Separated Edge-guidance Transformer Network for Polyp Segmentation](https://mlsanity.com/paper/2306.10773/) (2023)
- [MAST: Video Polyp Segmentation with a Mixture-Attention Siamese Transformer](https://mlsanity.com/paper/2401.12439/) (2024)
- [Multi-scale Information Sharing and Selection Network with Boundary Attention for Polyp Segmentation](https://mlsanity.com/paper/2405.11151/) (2024)
- [Cooperation Learning Enhanced Colonic Polyp Segmentation Based on Transformer-CNN Fusion](https://mlsanity.com/paper/2301.06892/) (2023)
- [Multi-level feature fusion network combining attention mechanisms for polyp segmentation](https://mlsanity.com/paper/2309.10219/) (2023)
- [RTA-Former: Reverse Transformer Attention for Polyp Segmentation](https://mlsanity.com/paper/2401.11671/) (2024)
- [Multi-Layer Dense Attention Decoder for Polyp Segmentation](https://mlsanity.com/paper/2403.18180/) (2024)
- [Enhancing Polyp Segmentation via Encoder Attention and Dynamic Kernel Update](https://mlsanity.com/paper/2509.23502/) (2025)

## Abstract (arXiv)

Accurate polyp segmentation is of great significance for the diagnosis and treatment of colorectal cancer. However, it has always been very challenging due to the diverse shape and size of polyp. In recent years, state-of-the-art methods have achieved significant breakthroughs in this task with the help of deep convolutional neural networks. However, few algorithms explicitly consider the impact of the size and shape of the polyp and the complex spatial context on the segmentation performance, which results in the algorithms still being powerless for complex samples. In fact, segmentation of polyps of different sizes relies on different local and global contextual information for regional contrast reasoning. To tackle these issues, we propose an adaptive context selection based encoder-decoder framework which is composed of Local Context Attention (LCA) module, Global Context Module (GCM) and Adaptive Selection Module (ASM). Specifically, LCA modules deliver local context features from encoder layers to decoder layers, enhancing the attention to the hard region which is determined by the prediction map of previous layer. GCM aims to further explore the global context features and send to the decoder layers. ASM is used for adaptive selection and aggregation of context features through channel-wise attention. Our proposed approach is evaluated on the EndoScene and Kvasir-SEG Datasets, and shows outstanding performance compared with other state-of-the-art methods. The code is available at https://github.com/ReaFly/ACSNet.