Progressively Normalized Self-Attention Network for Video Polyp Segmentation
Not on the map. Why?
Abstract (arXiv)
Existing video polyp segmentation (VPS) models typically employ convolutional neural networks (CNNs) to extract features. However, due to their limited receptive fields, CNNs can not fully exploit the global temporal and spatial information in successive video frames, resulting in false-positive segmentation results. In this paper, we propose the novel PNS-Net (Progressively Normalized Self-attention Network), which can efficiently learn representations from polyp videos with real-time speed (~140fps) on a single RTX 2080 GPU and no post-processing. Our PNS-Net is based solely on a basic normalized self-attention block, equipping with recurrence and CNNs entirely. Experiments on challenging VPS datasets demonstrate that the proposed PNS-Net achieves state-of-the-art performance. We also conduct extensive experiments to study the effectiveness of the channel split, soft-attention, and progressive learning strategy. We find that our PNS-Net works well under different settings, making it a promising solution to the VPS task.
Key facts. Cited by 75 papers in the map (data through 14 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 18 May 2021.
Builds on
16 of 30 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Layer Normalizationcited by 5,669
- 2017Non-local Neural Networkscited by 2,293
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 347
- 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
- 2017Receptive Field Block Net for Accurate and Fast Object Detectioncited by 141
4 more
- 2020Normalized and Geometry-Aware Self-Attention Network for Image Captioningcited by 63
- 2018Polyp Segmentation in Colonoscopy Images Using Fully Convolutional Networkcited by 33
- 2013Automated polyp detection in colon capsule endoscopycited by 30
- 2019Psi-Net: Shape and boundary aware joint multi-task deep network for medical image segmentationcited by 30
Built on by
Citing papers per year: 2021: 7; 2022: 14; 2023: 14; 2024: 22; 2025: 14; 2026: 4.
75 papers.
Sort:
By area:
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
- 2022Video Polyp Segmentation: A Deep Learning Perspectivecited by 82
- 2021Full-Duplex Strategy for Video Object Segmentationcited by 78
- 2021Automatic Polyp Segmentation via Multi-scale Subtraction Networkcited by 77
- 2023AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encodercited by 70
- 2022Deep Gradient Learning for Efficient Camouflaged Object Detectioncited by 65
- 2022Implicit Motion Handling for Video Camouflaged Object Detectioncited by 60
- 2023VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learningcited by 58
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentationcited by 52
- 2023ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detectioncited by 48
- 2021Fast Camouflaged Object Detection via Edge-based Reversible Re-calibration Networkcited by 42
38 more
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
- 2024A Survey of Camouflaged Object Detection and Beyondcited by 37
- 2023HQG-Net: Unpaired Medical Image Enhancement with High-Quality Guidancecited by 36
- 2021Depth Quality-Inspired Feature Manipulation for Efficient RGB-D Salient Object Detectioncited by 33
- 2022Camouflaged Object Detection via Context-aware Cross-level Fusioncited by 32
- 2022OSFormer: One-Stage Camouflaged Instance Segmentation with Transformerscited by 30
- 2022Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challengecited by 27
- 2024SAM-COD: SAM-guided Unified Framework for Weakly-Supervised Camouflaged Object Detectioncited by 22
- 2023WeakPolyp: You Only Look Bounding Box for Polyp Segmentationcited by 21
- 2022Contrastive Transformer-based Multiple Instance Learning for Weakly Supervised Polyp Frame Detectioncited by 20
- 2023SimCol3D -- 3D Reconstruction during Colonoscopy Challengecited by 19
- 2024SALI: Short-term Alignment and Long-term Interaction Network for Colonoscopy Video Polyp Segmentationcited by 19
- 2024Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detectioncited by 18
- 2023Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videoscited by 16
- 2024Frontiers in Intelligent Colonoscopycited by 14
- 2023M2SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentationcited by 13
- 2023A Survey on Deep Learning for Polyp Segmentation: Techniques, Challenges and Future Trendscited by 12
- 2024Explicit Motion Handling and Interactive Prompting for Video Camouflaged Object Detectioncited by 11
- 2024SAM-PM: Enhancing Video Camouflaged Object Detection using Spatio-Temporal Attentioncited by 11
- 2024When SAM2 Meets Video Camouflaged Object Segmentation: A Comprehensive Evaluation and Adaptationcited by 11
- 2025Reversible Unfolding Network for Concealed Visual Perception with Generative Refinementcited by 11
- 2022BoxPolyp:Boost Generalized Polyp Segmentation Using Extra Coarse Bounding Box Annotationscited by 10
- 2023Acquiring Weak Annotations for Tumor Localization in Temporal and Volumetric Datacited by 9
- 2024Inspiring the Next Generation of Segment Anything Models: Comprehensively Evaluate SAM and SAM 2 with Diverse Prompts Towards Context-Dependent Concepts under Different Scenescited by 9
- 2025CamSAM2: Segment Anything Accurately in Camouflaged Videoscited by 7
- 2024Diff-VPS: Video Polyp Segmentation via a Multi-task Diffusion Network with Adversarial Temporal Reasoningcited by 6
- 2024Self-Prompting Polyp Segmentation in Colonoscopy using Hybrid Yolo-SAM 2 Modelcited by 6
- 2022Trichomonas Vaginalis Segmentation in Microscope Imagescited by 5
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Surveycited by 5
- 2021Guidance and Teaching Network for Video Salient Object Detectioncited by 4
- 2023Rethinking Polyp Segmentation from an Out-of-Distribution Perspectivecited by 4
- 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotationscited by 4
- 2025Text-Promptable Propagation for Referring Medical Image Sequence Segmentationcited by 4
- 2024MAST: Video Polyp Segmentation with a Mixture-Attention Siamese Transformercited by 3
- 2024YOLO-MED : Multi-Task Interaction Network for Biomedical Imagescited by 3
- 2024HilbertMamba: Local-Global Reciprocal Network for Uterine Fibroid Segmentation in Ultrasound Videoscited by 2
- 2024Towards a Benchmark for Colorectal Cancer Segmentation in Endorectal Ultrasound Videos: Dataset and Model Developmentcited by 2
- 2025Assisted Refinement Network Based on Channel Information Interaction for Camouflaged and Salient Object Detectioncited by 2
50 most cited of 75 All 75 (JSON)
- 2026WSPolypNet: Weakly Supervised Polyp Localization in Colonoscopy Videos8 Sep 2026
- 2026ASTRA-Net: Anatomy-Specific Transfer and Representation Alignment for Drug-Induced Sleep Endoscopy Segmentation23 Jul 2026
- 2026ARTEMIS: Agent-guided Reliability-aware Temporal Mask Evolution for Imperfectly Supervised Video Polyp Segmentation18 Jun 2026
- 2026CMSA-Net: Causal Multi-scale Aggregation with Adaptive Multi-source Reference for Video Polyp Segmentation26 Feb 2026
- 2025Assisted Refinement Network Based on Channel Information Interaction for Camouflaged and Salient Object Detection12 Dec 2025
- 2025EMA-SAM: Exponential Moving-average for SAM-based PTMC Segmentation21 Oct 2025
- 2025FreeVPS: Repurposing Training-Free SAM2 for Generalizable Video Polyp Segmentation27 Aug 2025
- 2025Reversible Unfolding Network for Concealed Visual Perception with Generative Refinement20 Aug 2025
- 2025Mamba-based Spatio-Frequency Motion Perception for Video Camouflaged Object Detection31 Jul 2025
- 2025Dual Semantic-Aware Network for Noise Suppressed Ultrasound Video Segmentation10 Jul 2025
- 2025CamoSAM2: SAM2-oriented Prompt Auto-Refinement for Video Camouflaged Object Detection1 Apr 2025
- 2025CamSAM2: Segment Anything Accurately in Camouflaged Videos25 Mar 2025
38 more
- 2025Scoring, Remember, and Reference: Catching Camouflaged Objects in Videos21 Mar 2025
- 2025MSVCOD:A Large-Scale Multi-Scene Dataset for Video Camouflage Object Detection19 Feb 2025
- 2025Text-Promptable Propagation for Referring Medical Image Sequence Segmentation16 Feb 2025
- 2025QMaxViT-Unet+: A Query-Based MaxViT-Unet with Edge Enhancement for Scribble-Supervised Segmentation of Medical Images14 Feb 2025
- 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotations3 Feb 2025
- 2025Green Video Camouflaged Object Detection19 Jan 2025
- 2024Multi-scale and Multi-path Cascaded Convolutional Network for Semantic Segmentation of Colorectal Polyps3 Dec 2024
- 2024Inspiring the Next Generation of Segment Anything Models: Comprehensively Evaluate SAM and SAM 2 with Diverse Prompts Towards Context-Dependent Concepts under Different Scenes2 Dec 2024
- 2024Frontiers in Intelligent Colonoscopy22 Oct 2024
- 2024When SAM2 Meets Video Camouflaged Object Segmentation: A Comprehensive Evaluation and Adaptation27 Sep 2024
- 2024Self-Prompting Polyp Segmentation in Colonoscopy using Hybrid Yolo-SAM 2 Model14 Sep 2024
- 2024Diff-VPS: Video Polyp Segmentation via a Multi-task Diffusion Network with Adversarial Temporal Reasoning11 Sep 2024
- 2024Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detection27 Aug 2024
- 2024A Survey of Camouflaged Object Detection and Beyond26 Aug 2024
- 2024SAM-COD: SAM-guided Unified Framework for Weakly-Supervised Camouflaged Object Detection20 Aug 2024
- 2024Towards a Benchmark for Colorectal Cancer Segmentation in Endorectal Ultrasound Videos: Dataset and Model Development19 Aug 2024
- 2024HilbertMamba: Local-Global Reciprocal Network for Uterine Fibroid Segmentation in Ultrasound Videos8 Jul 2024
- 2024SALI: Short-term Alignment and Long-term Interaction Network for Colonoscopy Video Polyp Segmentation19 Jun 2024
- 2024SSTFB: Leveraging self-supervised pretext learning and temporal self-attention with feature branching for real-time video polyp segmentation14 Jun 2024
- 2024SAM-PM: Enhancing Video Camouflaged Object Detection using Spatio-Temporal Attention9 Jun 2024
- 2024Shifting Spotlight for Co-supervision: A Simple yet Efficient Single-branch Network to See Through Camouflage13 Apr 2024
- 2024A Spatial-Temporal Progressive Fusion Network for Breast Lesion Segmentation in Ultrasound Videos18 Mar 2024
- 2024Explicit Motion Handling and Interactive Prompting for Video Camouflaged Object Detection4 Mar 2024
- 2024YOLO-MED : Multi-Task Interaction Network for Biomedical Images1 Mar 2024
- 2024PolypNextLSTM: A lightweight and fast polyp video segmentation network using ConvNext and ConvLSTM18 Feb 2024
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentation25 Jan 2024
- 2024MAST: Video Polyp Segmentation with a Mixture-Attention Siamese Transformer23 Jan 2024
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Survey22 Jan 2024
- 2023A Survey on Deep Learning for Polyp Segmentation: Techniques, Challenges and Future Trends30 Nov 2023
- 2023VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learning25 Nov 2023
- 2023ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detection31 Oct 2023
- 2023Acquiring Weak Annotations for Tumor Localization in Temporal and Volumetric Data23 Oct 2023
- 2023Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videos3 Oct 2023
- 2023Efficient Polyp Segmentation Via Integrity Learning15 Sep 2023
- 2023SimCol3D -- 3D Reconstruction during Colonoscopy Challenge20 Jul 2023
- 2023Spinal nerve segmentation method and dataset construction in endoscopic surgical scenarios20 Jul 2023
- 2023WeakPolyp: You Only Look Bounding Box for Polyp Segmentation20 Jul 2023
- 2023HQG-Net: Unpaired Medical Image Enhancement with High-Quality Guidance15 Jul 2023
50 newest of 75 All 75 (JSON)
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
- 2022Video Polyp Segmentation: A Deep Learning Perspectivecited by 82
- 2021Full-Duplex Strategy for Video Object Segmentationcited by 78
- 2021Automatic Polyp Segmentation via Multi-scale Subtraction Networkcited by 77
- 2023AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encodercited by 70
- 2022Deep Gradient Learning for Efficient Camouflaged Object Detectioncited by 65
- 2022Implicit Motion Handling for Video Camouflaged Object Detectioncited by 60
- 2023VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learningcited by 58
- 2023ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detectioncited by 48
- 2021Fast Camouflaged Object Detection via Edge-based Reversible Re-calibration Networkcited by 42
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
12 most cited of 71 All 71 (JSON)
- 2026WSPolypNet: Weakly Supervised Polyp Localization in Colonoscopy Videos8 Sep 2026
- 2026ASTRA-Net: Anatomy-Specific Transfer and Representation Alignment for Drug-Induced Sleep Endoscopy Segmentation23 Jul 2026
- 2026ARTEMIS: Agent-guided Reliability-aware Temporal Mask Evolution for Imperfectly Supervised Video Polyp Segmentation18 Jun 2026
- 2026CMSA-Net: Causal Multi-scale Aggregation with Adaptive Multi-source Reference for Video Polyp Segmentation26 Feb 2026
- 2025Assisted Refinement Network Based on Channel Information Interaction for Camouflaged and Salient Object Detection12 Dec 2025
- 2025EMA-SAM: Exponential Moving-average for SAM-based PTMC Segmentation21 Oct 2025
- 2025FreeVPS: Repurposing Training-Free SAM2 for Generalizable Video Polyp Segmentation27 Aug 2025
- 2025Dual Semantic-Aware Network for Noise Suppressed Ultrasound Video Segmentation10 Jul 2025
- 2025CamoSAM2: SAM2-oriented Prompt Auto-Refinement for Video Camouflaged Object Detection1 Apr 2025
- 2025CamSAM2: Segment Anything Accurately in Camouflaged Videos25 Mar 2025
- 2025Scoring, Remember, and Reference: Catching Camouflaged Objects in Videos21 Mar 2025
- 2025MSVCOD:A Large-Scale Multi-Scene Dataset for Video Camouflage Object Detection19 Feb 2025
12 newest of 71 All 71 (JSON)