Robust Semantic Segmentation with Superpixel-Mix
Not on the map. Why?
Abstract (arXiv)
Along with predictive performance and runtime speed, reliability is a key requirement for real-world semantic segmentation. Reliability encompasses robustness, predictive uncertainty and reduced bias. To improve reliability, we introduce Superpixel-mix, a new superpixel-based data augmentation method with teacher-student consistency training. Unlike other mixing-based augmentation techniques, mixing superpixels between images is aware of object boundaries, while yielding consistent gains in segmentation accuracy. Our proposed technique achieves state-of-the-art results in semi-supervised semantic segmentation on the Cityscapes dataset. Moreover, Superpixel-mix improves the reliability of semantic segmentation by reducing network uncertainty and bias, as confirmed by competitive results under strong distributions shift (adverse weather, image corruptions) and when facing out-of-distribution data.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 68 of its 97 references that are in the map. First posted on arXiv 2 Aug 2021.
Builds on
68 of 97 references.
References · 68
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2013Intriguing properties of neural networkscited by 5,114
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
38 more
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2015A Neural Algorithm of Artistic Stylecited by 480
- 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
- 2017Semantic Foggy Scene Understanding with Synthetic Datacited by 401
- 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
- 2019ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoringcited by 349
- 2020Noise or Signal: The Role of Image Backgrounds in Object Recognitioncited by 342
- 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2017DeepXplore: Automated Whitebox Testing of Deep Learning Systemscited by 307
- 2017Dilated Residual Networkscited by 293
- 2017ICNet for Real-Time Semantic Segmentation on High-Resolution Imagescited by 261
- 2020Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixupcited by 260
- 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
- 2020ClassMix: Segmentation-Based Data Augmentation for Semi-Supervised Learningcited by 209
- 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
- 2019Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Visioncited by 182
- 2020Training independent subnetworks for robust predictioncited by 177
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 5; 2024: 4; 2025: 2; 2026: 1.
19 papers.
Sort:
By area:
- 2022FIFO: Learning Fog-invariant Features for Foggy Scene Segmentationcited by 31
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainabilitycited by 30
- 2022MUAD: Multiple Uncertainties for Autonomous Driving, a benchmark for multiple uncertainty types and taskscited by 24
- 2022Latent Discriminant deterministic Uncertaintycited by 17
- 2024Towards Understanding Why Label Smoothing Degrades Selective Classification and How to Fix Itcited by 11
- 2023Improving CLIP Robustness with Knowledge Distillation and Self-Trainingcited by 6
- 20232D Feature Distillation for Weakly- and Semi-Supervised 3D Semantic Segmentationcited by 6
- 2024Benchmarking Segmentation Models with Mask-Preserved Attribute Editingcited by 6
- 2024The BRAVO Semantic Segmentation Challenge Results in UNCV2024cited by 6
- 2023Tailoring Mixup to Data for Calibrationcited by 5
- 2021ViCE: Improving Dense Representation Learning by Superpixelization and Contrasting Cluster Assignmentcited by 4
- 2022SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix Data Augmentationcited by 2
7 more
- 2023Learning to Generate Training Datasets for Robust Semantic Segmentationcited by 2
- 2023Rethinking Superpixel Segmentation from Biologically Inspired Mechanismscited by 2
- 2025D-Feat Occlusions: Diffusion Features for Robustness to Partial Visual Occlusions in Object Recognitioncited by 2
- 2026Benchmarking Semantic Segmentation Models via Appearance and Geometry Attribute Editingcited by 2
- 2022Improving Predictive Performance and Calibration by Weight Fusion in Semantic Segmentationcited by 1
- 2024Adaptive Sensitivity Analysis for Robust Augmentation against Natural Corruptions in Image Segmentationcited by 1
- 2025HSMix: Hard and Soft Mixing Data Augmentation for Medical Image Segmentationcited by 0
- 2026Benchmarking Semantic Segmentation Models via Appearance and Geometry Attribute Editing2 Mar 2026
- 2025HSMix: Hard and Soft Mixing Data Augmentation for Medical Image Segmentation18 Nov 2025
- 2025D-Feat Occlusions: Diffusion Features for Robustness to Partial Visual Occlusions in Object Recognition8 Apr 2025
- 2024The BRAVO Semantic Segmentation Challenge Results in UNCV202423 Sep 2024
- 2024Adaptive Sensitivity Analysis for Robust Augmentation against Natural Corruptions in Image Segmentation3 Jun 2024
- 2024Towards Understanding Why Label Smoothing Degrades Selective Classification and How to Fix It19 Mar 2024
- 2024Benchmarking Segmentation Models with Mask-Preserved Attribute Editing2 Mar 2024
- 20232D Feature Distillation for Weakly- and Semi-Supervised 3D Semantic Segmentation27 Nov 2023
- 2023Tailoring Mixup to Data for Calibration2 Nov 2023
- 2023Rethinking Superpixel Segmentation from Biologically Inspired Mechanisms23 Sep 2023
- 2023Improving CLIP Robustness with Knowledge Distillation and Self-Training19 Sep 2023
- 2023Learning to Generate Training Datasets for Robust Semantic Segmentation1 Aug 2023
7 more
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainability21 Dec 2022
- 2022Improving Predictive Performance and Calibration by Weight Fusion in Semantic Segmentation22 Jul 2022
- 2022Latent Discriminant deterministic Uncertainty20 Jul 2022
- 2022SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix Data Augmentation11 Apr 2022
- 2022FIFO: Learning Fog-invariant Features for Foggy Scene Segmentation4 Apr 2022
- 2022MUAD: Multiple Uncertainties for Autonomous Driving, a benchmark for multiple uncertainty types and tasks2 Mar 2022
- 2021ViCE: Improving Dense Representation Learning by Superpixelization and Contrasting Cluster Assignment24 Nov 2021
- 2022FIFO: Learning Fog-invariant Features for Foggy Scene Segmentationcited by 31
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainabilitycited by 30
- 2022MUAD: Multiple Uncertainties for Autonomous Driving, a benchmark for multiple uncertainty types and taskscited by 24
- 2022Latent Discriminant deterministic Uncertaintycited by 17
- 2024Towards Understanding Why Label Smoothing Degrades Selective Classification and How to Fix Itcited by 11
- 2023Improving CLIP Robustness with Knowledge Distillation and Self-Trainingcited by 6
- 20232D Feature Distillation for Weakly- and Semi-Supervised 3D Semantic Segmentationcited by 6
- 2024Benchmarking Segmentation Models with Mask-Preserved Attribute Editingcited by 6
- 2024The BRAVO Semantic Segmentation Challenge Results in UNCV2024cited by 6
- 2023Tailoring Mixup to Data for Calibrationcited by 5
- 2021ViCE: Improving Dense Representation Learning by Superpixelization and Contrasting Cluster Assignmentcited by 4
- 2022SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix Data Augmentationcited by 2
12 most cited of 18 All 18 (JSON)
- 2026Benchmarking Semantic Segmentation Models via Appearance and Geometry Attribute Editing2 Mar 2026
- 2025HSMix: Hard and Soft Mixing Data Augmentation for Medical Image Segmentation18 Nov 2025
- 2024The BRAVO Semantic Segmentation Challenge Results in UNCV202423 Sep 2024
- 2024Adaptive Sensitivity Analysis for Robust Augmentation against Natural Corruptions in Image Segmentation3 Jun 2024
- 2024Towards Understanding Why Label Smoothing Degrades Selective Classification and How to Fix It19 Mar 2024
- 2024Benchmarking Segmentation Models with Mask-Preserved Attribute Editing2 Mar 2024
- 20232D Feature Distillation for Weakly- and Semi-Supervised 3D Semantic Segmentation27 Nov 2023
- 2023Tailoring Mixup to Data for Calibration2 Nov 2023
- 2023Rethinking Superpixel Segmentation from Biologically Inspired Mechanisms23 Sep 2023
- 2023Improving CLIP Robustness with Knowledge Distillation and Self-Training19 Sep 2023
- 2023Learning to Generate Training Datasets for Robust Semantic Segmentation1 Aug 2023
- 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainability21 Dec 2022
12 newest of 18 All 18 (JSON)