Deep ensembles based on Stochastic Activation Selection for Polyp Segmentation
Not on the map. Why?
Abstract (arXiv)
Semantic segmentation has a wide array of applications ranging from medical-image analysis, scene understanding, autonomous driving and robotic navigation. This work deals with medical image segmentation and in particular with accurate polyp detection and segmentation during colonoscopy examinations. Several convolutional neural network architectures have been proposed to effectively deal with this task and with the problem of segmenting objects at different scale input. The basic architecture in image segmentation consists of an encoder and a decoder: the first uses convolutional filters to extract features from the image, the second is responsible for generating the final output. In this work, we compare some variant of the DeepLab architecture obtained by varying the decoder backbone. We compare several decoder architectures, including ResNet, Xception, EfficentNet, MobileNet and we perturb their layers by substituting ReLU activation layers with other functions. The resulting methods are used to create deep ensembles which are shown to be very effective. Our experimental evaluations show that our best ensemble produces good segmentation results by achieving high evaluation scores with a dice coefficient of 0.884, and a mean Intersection over Union (mIoU) of 0.818 for the Kvasir-SEG dataset. To improve reproducibility and research efficiency the MATLAB source code used for this research is available at GitHub: https://github.com/LorisNanni.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 2 Apr 2021.
Builds on
28 of 35 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
16 more
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
- 2020Image Segmentation Using Deep Learning: A Surveycited by 659
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
- 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
- 2020A survey of loss functions for semantic segmentationcited by 216
- 2019A Survey of the Recent Architectures of Deep Convolutional Neural Networkscited by 211
- 2019Mish: A Self Regularized Non-Monotonic Activation Functioncited by 141
- 2021HarDNet-MSEG: A Simple Encoder-Decoder Polyp Segmentation Neural Network that Achieves over 0.9 Mean Dice and 86 FPScited by 71
- 2014Learning Activation Functions to Improve Deep Neural Networkscited by 62
- 2020DDANet: Dual Decoder Attention Network for Automatic Polyp Segmentationcited by 31
- 2015Deep Learning with S-shaped Rectified Linear Activation Unitscited by 26
- 2020Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learningcited by 13
- 2019Ensemble of Convolutional Neural Networks Trained with Different Activation Functionscited by 9
- 2020Soft-Root-Sign Activation Functioncited by 8
- 2020Comparisons among different stochastic selection of activation layers for convolutional neural networks for healthcarecited by 1
Built on by
Citing papers per year: 2021: 1.
1 paper.
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159