ScribblePolyp: Scribble-Supervised Polyp Segmentation through Dual Consistency Alignment
Not on the map. Why?
Abstract (arXiv)
Automatic polyp segmentation models play a pivotal role in the clinical diagnosis of gastrointestinal diseases. In previous studies, most methods relied on fully supervised approaches, necessitating pixel-level annotations for model training. However, the creation of pixel-level annotations is both expensive and time-consuming, impeding the development of model generalization. In response to this challenge, we introduce ScribblePolyp, a novel scribble-supervised polyp segmentation framework. Unlike fully-supervised models, ScribblePolyp only requires the annotation of two lines (scribble labels) for each image, significantly reducing the labeling cost. Despite the coarse nature of scribble labels, which leave a substantial portion of pixels unlabeled, we propose a two-branch consistency alignment approach to provide supervision for these unlabeled pixels. The first branch employs transformation consistency alignment to narrow the gap between predictions under different transformations of the same input image. The second branch leverages affinity propagation to refine predictions into a soft version, extending additional supervision to unlabeled pixels. In summary, ScribblePolyp is an efficient model that does not rely on teacher models or moving average pseudo labels during training. Extensive experiments on the SUN-SEG dataset underscore the effectiveness of ScribblePolyp, achieving a Dice score of 0.8155, with the potential for a 1.8% improvement in the Dice score through a straightforward self-training strategy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 11 references that are in the map. First posted on arXiv 9 Nov 2023.
Builds on
8 of 11 references.
References · 8
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017Non-local Neural Networkscited by 2,293
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2021Shallow Attention Network for Polyp Segmentationcited by 107
- 2022Video Polyp Segmentation: A Deep Learning Perspectivecited by 82
- 2022Scribble-Supervised Medical Image Segmentation via Dual-Branch Network and Dynamically Mixed Pseudo Labels Supervisioncited by 64
- 2020Scribble2Label: Scribble-Supervised Cell Segmentation via Self-Generating Pseudo-Labels with Consistencycited by 52
- 2023S2ME: Spatial-Spectral Mutual Teaching and Ensemble Learning for Scribble-supervised Polyp Segmentationcited by 15
Built on by
Not cited yet.