Noisy Annotations in Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Obtaining accurate labels for instance segmentation is particularly challenging due to the complex nature of the task. Each image necessitates multiple annotations, encompassing not only the object class but also its precise spatial boundaries. These requirements elevate the likelihood of errors and inconsistencies in both manual and automated annotation processes. By simulating different noise conditions, we provide a realistic scenario for assessing the robustness and generalization capabilities of instance segmentation models in different segmentation tasks, introducing COCO-N and Cityscapes-N. We also propose a benchmark for weakly annotation noise, dubbed COCO-WAN, which utilizes foundation models and weak annotations to simulate semi-automated annotation tools and their noisy labels. This study sheds light on the quality of segmentation masks produced by various models and challenges the efficacy of popular methods designed to address learning with label noise.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 16 Jun 2024.
Builds on
22 of 37 references.
References · 22
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Segment Anythingcited by 8,234
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2021Scaling Vision Transformerscited by 999
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
- 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
- 2019Hybrid Task Cascade for Instance Segmentationcited by 481
10 more
- 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
- 2019Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentationcited by 260
- 2019Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiographycited by 244
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 188
- 2019Deep learning with noisy labels: exploring techniques and remedies in medical image analysiscited by 173
- 2017Playing for Benchmarkscited by 169
- 2021Robustness and Reliability When Training With Noisy Labelscited by 10
- 2023Semi-Supervised Semantic Segmentation via Marginal Contextual Informationcited by 8
- 2023How to Efficiently Annotate Images for Best-Performing Deep Learning Based Segmentation Models: An Empirical Study with Weak and Noisy Annotations and Segment Anything Modelcited by 7
- 2022On Image Segmentation With Noisy Labels: Characterization and Volume Properties of the Optimal Solutions to Accuracy and Dicecited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 1.
5 papers.
- 2024Hysteresis Activation Function for Efficient Inferencecited by 2
- 2025Benchmarking Adversarial Patch Selection and Locationcited by 1
- 2025Segment-to-Act: Label-Noise-Robust Action-Prompted Video Segmentation Towards Embodied Intelligencecited by 1
- 2025R3: Reconstruction, Raw, and Rain: Deraining Directly in the Bayer Domaincited by 0
- 2026A Novel Method to Evaluate Models on Unreliable, Noisy and Inconsistent Labels: Adaptive Resolution Label Aggregation (ARLA)cited by 0
- 2026A Novel Method to Evaluate Models on Unreliable, Noisy and Inconsistent Labels: Adaptive Resolution Label Aggregation (ARLA)13 Jul 2026
- 2025R3: Reconstruction, Raw, and Rain: Deraining Directly in the Bayer Domain28 Sep 2025
- 2025Segment-to-Act: Label-Noise-Robust Action-Prompted Video Segmentation Towards Embodied Intelligence20 Sep 2025
- 2025Benchmarking Adversarial Patch Selection and Location3 Aug 2025
- 2024Hysteresis Activation Function for Efficient Inference15 Nov 2024