mlsanityData to 7 Oct 2026

Detecting, Localising and Classifying Polyps from Colonoscopy Videos using Deep Learning

arXiv 2101.03285 ↗First posted 9 Jan 2021cs.CV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose and analyse a system that can automatically detect, localise and classify polyps from colonoscopy videos. The detection of frames with polyps is formulated as a few-shot anomaly classification problem, where the training set is highly imbalanced with the large majority of frames consisting of normal images and a small minority comprising frames with polyps. Colonoscopy videos may contain blurry images and frames displaying feces and water jet sprays to clean the colon -- such frames can mistakenly be detected as anomalies, so we have implemented a classifier to reject these two types of frames before polyp detection takes place. Next, given a frame containing a polyp, our method localises (with a bounding box around the polyp) and classifies it into five different classes. Furthermore, we study a method to improve the reliability and interpretability of the classification result using uncertainty estimation and classification calibration. Classification uncertainty and calibration not only help improve classification accuracy by rejecting low-confidence and high-uncertain results, but can be used by doctors to decide how to decide on the classification of a polyp. All the proposed detection, localisation and classification methods are tested using large data sets and compared with relevant baseline approaches.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 29 of its 63 references that are in the map. First posted on arXiv 9 Jan 2021.

Builds on

29 of 63 references.

References · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  4. 2016Densely Connected Convolutional Networkscited by 6,691
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  6. 2017On Calibration of Modern Neural Networkscited by 4,860
  7. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  8. 2015Fast R-CNNcited by 2,930
  9. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  10. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
  11. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  12. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
17 more
  1. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
  2. 2018Learning to Reweight Examples for Robust Deep Learningcited by 670
  3. 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
  4. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
  5. 2016Tutorial on Variational Autoencoderscited by 404
  6. 2015Adversarial Autoencoderscited by 359
  7. 2017Concrete Dropoutcited by 227
  8. 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
  9. 2019Deep Anomaly Detection with Deviation Networkscited by 152
  10. 2018Exploring Uncertainty Measures in Deep Networks for Multiple Sclerosis Lesion Detection and Segmentationcited by 146
  11. 2018Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detectioncited by 79
  12. 2019Overfitting of neural nets under class imbalance: Analysis and improvements for segmentationcited by 27
  13. 2017Deep-Learning for Classification of Colorectal Polyps on Whole-Slide Imagescited by 26
  14. 2018Towards safe deep learning: accurately quantifying biomarker uncertainty in neural network predictionscited by 25
  15. 2020Few-Shot Anomaly Detection for Polyp Frames from Colonoscopycited by 19
  16. 2019Unsupervised Dual Adversarial Learning for Anomaly Detection in Colonoscopy Video Framescited by 14
  17. 2018XNet: A convolutional neural network (CNN) implementation for medical X-Ray image segmentation suitable for small datasetscited by 9

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 1.

3 papers.

  1. 2021Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Imagescited by 45
  2. 2021Self-supervised Pseudo Multi-class Pre-training for Unsupervised Anomaly Detection and Segmentation in Medical Imagescited by 23
  3. 2022Contrastive Transformer-based Multiple Instance Learning for Weakly Supervised Polyp Frame Detectioncited by 20