Semi-Supervised Semantic Segmentation via Marginal Contextual Information
Not on the map. Why?
Abstract (arXiv)
We present a novel confidence refinement scheme that enhances pseudo labels in semi-supervised semantic segmentation. Unlike existing methods, which filter pixels with low-confidence predictions in isolation, our approach leverages the spatial correlation of labels in segmentation maps by grouping neighboring pixels and considering their pseudo labels collectively. With this contextual information, our method, named S4MC, increases the amount of unlabeled data used during training while maintaining the quality of the pseudo labels, all with negligible computational overhead. Through extensive experiments on standard benchmarks, we demonstrate that S4MC outperforms existing state-of-the-art semi-supervised learning approaches, offering a promising solution for reducing the cost of acquiring dense annotations. For example, S4MC achieves a 1.39 mIoU improvement over the prior art on PASCAL VOC 12 with 366 annotated images. The code to reproduce our experiments is available at https://s4mcontext.github.io/
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 53 of its 65 references that are in the map. First posted on arXiv 26 Aug 2023.
Builds on
53 of 65 references.
References · 53
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2023Segment Anythingcited by 8,234
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2015Fast R-CNNcited by 2,933
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
38 more
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,060
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
- 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
- 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 463
- 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 376
- 2020Rethinking Pre-training and Self-trainingcited by 352
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 344
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 306
- 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
- 2020A Simple Semi-Supervised Learning Framework for Object Detectioncited by 282
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 274
- 2015Semi-Supervised Learning with Ladder Networkscited by 247
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2022Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labelscited by 218
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 188
- 2021ST++: Make Self-training Work Better for Semi-supervised Semantic Segmentationcited by 184
- 2020PseudoSeg: Designing Pseudo Labels for Semantic Segmentationcited by 180
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 178
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
- 2020Guided Collaborative Training for Pixel-wise Semi-Supervised Learningcited by 120
- 2021Perturbed and Strict Mean Teachers for Semi-supervised Semantic Segmentationcited by 113
- 2019Dual Student: Breaking the Limits of the Teacher in Semi-supervised Learningcited by 104
- 2021Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentationcited by 101
- 2021Semi-Supervised Semantic Segmentation via Adaptive Equalization Learningcited by 101
- 2019SESS: Self-Ensembling Semi-Supervised 3D Object Detectioncited by 89
- 20203DIoUMatch: Leveraging IoU Prediction for Semi-Supervised 3D Object Detectioncited by 89
- 2021Bootstrapping Semantic Segmentation with Regional Contrastcited by 80
- 2022Class-Aware Contrastive Semi-Supervised Learningcited by 62
- 2017Real-time Semantic Segmentation of Crop and Weed for Precision Agriculture Robots Leveraging Background Knowledge in CNNscited by 55
- 2022Semi-supervised Semantic Segmentation with Prototype-based Consistency Regularizationcited by 50
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 1.
8 papers.
- 2024Noisy Annotations in Semantic Segmentationcited by 5
- 2024Robot Instance Segmentation with Few Annotations for Graspingcited by 4
- 2025WAVECLIP: Wavelet Tokenization for Adaptive-Resolution CLIPcited by 3
- 2024Hysteresis Activation Function for Efficient Inferencecited by 2
- 2025Knowledge Consultation for Semi-Supervised Semantic Segmentationcited by 1
- 2025Benchmarking Adversarial Patch Selection and Locationcited by 1
- 2025R3: Reconstruction, Raw, and Rain: Deraining Directly in the Bayer Domaincited by 0
- 2026CXR-Retrieve: Compositional Text-to-Image Retrieval in Chest Radiographycited by 0
- 2026CXR-Retrieve: Compositional Text-to-Image Retrieval in Chest Radiography30 Jul 2026
- 2025R3: Reconstruction, Raw, and Rain: Deraining Directly in the Bayer Domain28 Sep 2025
- 2025WAVECLIP: Wavelet Tokenization for Adaptive-Resolution CLIP25 Sep 2025
- 2025Benchmarking Adversarial Patch Selection and Location3 Aug 2025
- 2025Knowledge Consultation for Semi-Supervised Semantic Segmentation12 Mar 2025
- 2024Hysteresis Activation Function for Efficient Inference15 Nov 2024
- 2024Robot Instance Segmentation with Few Annotations for Grasping1 Jul 2024
- 2024Noisy Annotations in Semantic Segmentation16 Jun 2024