NeoUNet: Towards accurate colon polyp segmentation and neoplasm detection
Not on the map. Why?
Abstract (arXiv)
Automatic polyp segmentation has proven to be immensely helpful for endoscopy procedures, reducing the missing rate of adenoma detection for endoscopists while increasing efficiency. However, classifying a polyp as being neoplasm or not and segmenting it at the pixel level is still a challenging task for doctors to perform in a limited time. In this work, we propose a fine-grained formulation for the polyp segmentation problem. Our formulation aims to not only segment polyp regions, but also identify those at high risk of malignancy with high accuracy. In addition, we present a UNet-based neural network architecture called NeoUNet, along with a hybrid loss function to solve this problem. Experiments show highly competitive results for NeoUNet on our benchmark dataset compared to existing polyp segmentation models.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 11 Jul 2021.
Builds on
21 of 36 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2014Going Deeper with Convolutionscited by 4,231
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
9 more
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
- 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
- 2017Tversky loss function for image segmentation using 3D fully convolutional deep networkscited by 228
- 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
- 2018A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentationcited by 171
- 2020DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentationcited by 125
- 2019HarDNet: A Low Memory Traffic Networkcited by 76
- 2021HarDNet-MSEG: A Simple Encoder-Decoder Polyp Segmentation Neural Network that Achieves over 0.9 Mean Dice and 86 FPScited by 71
- 2018CU-Net: Coupled U-Netscited by 11
Built on by
Citing papers per year: 2022: 9; 2023: 10; 2024: 13; 2025: 10; 2026: 8.
50 papers.
Sort:
By area:
- 2024EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentationcited by 64
- 2022TGANet: Text-guided attention for improved polyp segmentationcited by 59
- 2023Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentationcited by 29
- 2022ColonFormer: An Efficient Transformer based Method for Colon Polyp Segmentationcited by 28
- 2023Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Modelscited by 28
- 2023TransNetR: Transformer-based Residual Network for Polyp Segmentation with Multi-Center Out-of-Distribution Testingcited by 26
- 2022TransResU-Net: Transformer based ResU-Net for Real-Time Colonoscopy Polyp Segmentationcited by 19
- 2024Is SAM 2 Better than SAM in Medical Image Segmentation?cited by 16
- 2023Towards General Purpose Medical AI: Continual Learning Medical Foundation Modelcited by 14
- 2024Frontiers in Intelligent Colonoscopycited by 13
- 2024ProMamba: Prompt-Mamba for polyp segmentationcited by 12
- 2024VLSM-Adapter: Finetuning Vision-Language Segmentation Efficiently with Lightweight Blockscited by 11
38 more
- 2022BlazeNeo: Blazing fast polyp segmentation and neoplasm detectioncited by 10
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretationcited by 10
- 2023Attention Mechanisms in Medical Image Segmentation: A Surveycited by 9
- 2024PolypDB: A Curated Multi-Center Dataset for Development of AI Algorithms in Colonoscopycited by 7
- 2022DilatedSegNet: A Deep Dilated Segmentation Network for Polyp Segmentationcited by 6
- 2022Focal-UNet: UNet-like Focal Modulation for Medical Image Segmentationcited by 6
- 2024Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignmentscited by 6
- 2024SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy datacited by 6
- 2026MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learningcited by 6
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Surveycited by 5
- 2023M3FPolypSegNet: Segmentation Network with Multi-frequency Feature Fusion for Polyp Localization in Colonoscopy Imagescited by 3
- 2024TuneVLSeg: Prompt Tuning Benchmark for Vision-Language Segmentation Modelscited by 3
- 2025EndoCogniAgent: Closed-Loop Agentic Reasoning with Self-Consistency Validation for Endoscopic Diagnosiscited by 3
- 2026MedCLIPSeg: Probabilistic Vision-Language Adaptation for Data-Efficient and Generalizable Medical Image Segmentationcited by 3
- 2022LAPFormer: A Light and Accurate Polyp Segmentation Transformercited by 2
- 2023RaBiT: An Efficient Transformer using Bidirectional Feature Pyramid Network with Reverse Attention for Colon Polyp Segmentationcited by 2
- 2025iDPA: Instance Decoupled Prompt Attention for Incremental Medical Object Detectioncited by 2
- 2025K-Prism: A Knowledge-Guided and Prompt Integrated Universal Medical Image Segmentation Modelcited by 2
- 2022Automatic Polyp Segmentation with Multiple Kernel Dilated Convolution Networkcited by 1
- 2022Online pseudo labeling for polyp segmentation with momentum networkscited by 1
- 2023TransRUPNet for Improved Polyp Segmentationcited by 1
- 2023RetSeg: Retention-based Colorectal Polyps Segmentation Networkcited by 1
- 2025VLSM-Ensemble: Ensembling CLIP-based Vision-Language Models for Enhanced Medical Image Segmentationcited by 1
- 2025RRTS Dataset: A Benchmark Colonoscopy Dataset from Resource-Limited Settings for Computer-Aided Diagnosis Researchcited by 1
- 2025SurgSLOT: Segment Anything in Surgical Videos via Semantic Long-term Trackingcited by 1
- 2025Improvise, Adapt, Overcome -- Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imagingcited by 1
- 2026Multi-Scale Global-Instance Prompt Tuning for Continual Test-time Adaptation in Medical Image Segmentationcited by 1
- 2026SPEGC: Continual Test-Time Adaptation via Semantic-Prompt-Enhanced Graph Clustering for Medical Image Segmentationcited by 1
- 2023Prototype Learning for Out-of-Distribution Polyp Segmentationcited by 0
- 2024Polyp segmentation in colonoscopy images using DeepLabV3++cited by 0
- 2024Transformer-Enhanced Iterative Feedback Mechanism for Polyp Segmentationcited by 0
- 2024Day-Night Adaptation: An Innovative Source-free Adaptation Framework for Medical Image Segmentationcited by 0
- 2025Cycle Context Verification for In-Context Medical Image Segmentationcited by 0
- 2025The Power of Certainty: How Confident Models Lead to Better Segmentationcited by 0
- 2026MieDB-100k: A Comprehensive Dataset for Medical Image Editingcited by 0
- 2026From Adaptation to Generalization: Adaptive Visual Prompting for Medical Image Segmentationcited by 0
- 2026MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Modelscited by 0
- 2026MedSegBenchmarker: A Raw-Count-First Framework for Controlled 2D Medical Image Segmentation Benchmarkscited by 0
- 2026MedSegBenchmarker: A Raw-Count-First Framework for Controlled 2D Medical Image Segmentation Benchmarks30 Aug 2026
- 2026MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Models4 Jun 2026
- 2026From Adaptation to Generalization: Adaptive Visual Prompting for Medical Image Segmentation19 Apr 2026
- 2026SPEGC: Continual Test-Time Adaptation via Semantic-Prompt-Enhanced Graph Clustering for Medical Image Segmentation12 Mar 2026
- 2026MedCLIPSeg: Probabilistic Vision-Language Adaptation for Data-Efficient and Generalizable Medical Image Segmentation23 Feb 2026
- 2026MieDB-100k: A Comprehensive Dataset for Medical Image Editing10 Feb 2026
- 2026Multi-Scale Global-Instance Prompt Tuning for Continual Test-time Adaptation in Medical Image Segmentation5 Feb 2026
- 2026MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learning3 Feb 2026
- 2025Improvise, Adapt, Overcome -- Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imaging15 Dec 2025
- 2025SurgSLOT: Segment Anything in Surgical Videos via Semantic Long-term Tracking20 Nov 2025
- 2025RRTS Dataset: A Benchmark Colonoscopy Dataset from Resource-Limited Settings for Computer-Aided Diagnosis Research10 Nov 2025
- 2025K-Prism: A Knowledge-Guided and Prompt Integrated Universal Medical Image Segmentation Model29 Sep 2025
38 more
- 2025VLSM-Ensemble: Ensembling CLIP-based Vision-Language Models for Enhanced Medical Image Segmentation5 Sep 2025
- 2025EndoCogniAgent: Closed-Loop Agentic Reasoning with Self-Consistency Validation for Endoscopic Diagnosis10 Aug 2025
- 2025The Power of Certainty: How Confident Models Lead to Better Segmentation14 Jul 2025
- 2025Cycle Context Verification for In-Context Medical Image Segmentation11 Jul 2025
- 2025iDPA: Instance Decoupled Prompt Attention for Incremental Medical Object Detection31 May 2025
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretation30 Apr 2025
- 2024SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy data20 Dec 2024
- 2024Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignments18 Dec 2024
- 2024Frontiers in Intelligent Colonoscopy22 Oct 2024
- 2024Day-Night Adaptation: An Innovative Source-free Adaptation Framework for Medical Image Segmentation17 Oct 2024
- 2024TuneVLSeg: Prompt Tuning Benchmark for Vision-Language Segmentation Models7 Oct 2024
- 2024Transformer-Enhanced Iterative Feedback Mechanism for Polyp Segmentation25 Aug 2024
- 2024PolypDB: A Curated Multi-Center Dataset for Development of AI Algorithms in Colonoscopy19 Aug 2024
- 2024Is SAM 2 Better than SAM in Medical Image Segmentation?8 Aug 2024
- 2024Polyp segmentation in colonoscopy images using DeepLabV3++27 Jul 2024
- 2024EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentation11 May 2024
- 2024VLSM-Adapter: Finetuning Vision-Language Segmentation Efficiently with Lightweight Blocks10 May 2024
- 2024ProMamba: Prompt-Mamba for polyp segmentation20 Mar 2024
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Survey22 Jan 2024
- 2023Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentation30 Nov 2023
- 2023M3FPolypSegNet: Segmentation Network with Multi-frequency Feature Fusion for Polyp Localization in Colonoscopy Images9 Oct 2023
- 2023RetSeg: Retention-based Colorectal Polyps Segmentation Network9 Oct 2023
- 2023Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Models15 Aug 2023
- 2023Prototype Learning for Out-of-Distribution Polyp Segmentation7 Aug 2023
- 2023RaBiT: An Efficient Transformer using Bidirectional Feature Pyramid Network with Reverse Attention for Colon Polyp Segmentation12 Jul 2023
- 2023TransRUPNet for Improved Polyp Segmentation3 Jun 2023
- 2023Attention Mechanisms in Medical Image Segmentation: A Survey29 May 2023
- 2023TransNetR: Transformer-based Residual Network for Polyp Segmentation with Multi-Center Out-of-Distribution Testing13 Mar 2023
- 2023Towards General Purpose Medical AI: Continual Learning Medical Foundation Model12 Mar 2023
- 2022Focal-UNet: UNet-like Focal Modulation for Medical Image Segmentation19 Dec 2022
- 2022DilatedSegNet: A Deep Dilated Segmentation Network for Polyp Segmentation24 Oct 2022
- 2022LAPFormer: A Light and Accurate Polyp Segmentation Transformer10 Oct 2022
- 2022Online pseudo labeling for polyp segmentation with momentum networks29 Sep 2022
- 2022TransResU-Net: Transformer based ResU-Net for Real-Time Colonoscopy Polyp Segmentation17 Jun 2022
- 2022Automatic Polyp Segmentation with Multiple Kernel Dilated Convolution Network13 Jun 2022
- 2022ColonFormer: An Efficient Transformer based Method for Colon Polyp Segmentation17 May 2022
- 2022TGANet: Text-guided attention for improved polyp segmentation9 May 2022
- 2022BlazeNeo: Blazing fast polyp segmentation and neoplasm detection28 Feb 2022
- 2023Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Modelscited by 28
- 2024VLSM-Adapter: Finetuning Vision-Language Segmentation Efficiently with Lightweight Blockscited by 11
- 2024TuneVLSeg: Prompt Tuning Benchmark for Vision-Language Segmentation Modelscited by 3
- 2026MedCLIPSeg: Probabilistic Vision-Language Adaptation for Data-Efficient and Generalizable Medical Image Segmentationcited by 3
- 2025VLSM-Ensemble: Ensembling CLIP-based Vision-Language Models for Enhanced Medical Image Segmentationcited by 1
- 2025Improvise, Adapt, Overcome -- Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imagingcited by 1
- 2026MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Modelscited by 0
- 2026MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Models4 Jun 2026
- 2026MedCLIPSeg: Probabilistic Vision-Language Adaptation for Data-Efficient and Generalizable Medical Image Segmentation23 Feb 2026
- 2025Improvise, Adapt, Overcome -- Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imaging15 Dec 2025
- 2025VLSM-Ensemble: Ensembling CLIP-based Vision-Language Models for Enhanced Medical Image Segmentation5 Sep 2025
- 2024TuneVLSeg: Prompt Tuning Benchmark for Vision-Language Segmentation Models7 Oct 2024
- 2024VLSM-Adapter: Finetuning Vision-Language Segmentation Efficiently with Lightweight Blocks10 May 2024
- 2023Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Models15 Aug 2023
- 2024ProMamba: Prompt-Mamba for polyp segmentationcited by 12
- 2024ProMamba: Prompt-Mamba for polyp segmentation20 Mar 2024
- 2024EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentationcited by 64
- 2022TGANet: Text-guided attention for improved polyp segmentationcited by 59
- 2023Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentationcited by 29
- 2022ColonFormer: An Efficient Transformer based Method for Colon Polyp Segmentationcited by 28
- 2023TransNetR: Transformer-based Residual Network for Polyp Segmentation with Multi-Center Out-of-Distribution Testingcited by 26
- 2022TransResU-Net: Transformer based ResU-Net for Real-Time Colonoscopy Polyp Segmentationcited by 19
- 2024Is SAM 2 Better than SAM in Medical Image Segmentation?cited by 16
- 2023Towards General Purpose Medical AI: Continual Learning Medical Foundation Modelcited by 14
- 2024Frontiers in Intelligent Colonoscopycited by 13
- 2022BlazeNeo: Blazing fast polyp segmentation and neoplasm detectioncited by 10
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretationcited by 10
- 2023Attention Mechanisms in Medical Image Segmentation: A Surveycited by 9
12 most cited of 39 All 39 (JSON)
- 2026MedSegBenchmarker: A Raw-Count-First Framework for Controlled 2D Medical Image Segmentation Benchmarks30 Aug 2026
- 2026From Adaptation to Generalization: Adaptive Visual Prompting for Medical Image Segmentation19 Apr 2026
- 2026SPEGC: Continual Test-Time Adaptation via Semantic-Prompt-Enhanced Graph Clustering for Medical Image Segmentation12 Mar 2026
- 2026MieDB-100k: A Comprehensive Dataset for Medical Image Editing10 Feb 2026
- 2026Multi-Scale Global-Instance Prompt Tuning for Continual Test-time Adaptation in Medical Image Segmentation5 Feb 2026
- 2025SurgSLOT: Segment Anything in Surgical Videos via Semantic Long-term Tracking20 Nov 2025
- 2025RRTS Dataset: A Benchmark Colonoscopy Dataset from Resource-Limited Settings for Computer-Aided Diagnosis Research10 Nov 2025
- 2025The Power of Certainty: How Confident Models Lead to Better Segmentation14 Jul 2025
- 2025Cycle Context Verification for In-Context Medical Image Segmentation11 Jul 2025
- 2025iDPA: Instance Decoupled Prompt Attention for Incremental Medical Object Detection31 May 2025
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretation30 Apr 2025
- 2024SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy data20 Dec 2024
12 newest of 39 All 39 (JSON)