mlsanityData to 7 Oct 2026

RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whitening

arXiv 2103.15597 ↗First posted 29 Mar 2021cs.CVcited by 213

Not on the map. Why?

Abstract (arXiv)

Enhancing the generalization capability of deep neural networks to unseen domains is crucial for safety-critical applications in the real world such as autonomous driving. To address this issue, this paper proposes a novel instance selective whitening loss to improve the robustness of the segmentation networks for unseen domains. Our approach disentangles the domain-specific style and domain-invariant content encoded in higher-order statistics (i.e., feature covariance) of the feature representations and selectively removes only the style information causing domain shift. As shown in Fig. 1, our method provides reasonable predictions for (a) low-illuminated, (b) rainy, and (c) unseen structures. These types of images are not included in the training dataset, where the baseline shows a significant performance drop, contrary to ours. Being simple yet effective, our approach improves the robustness of various backbone networks without additional computational cost. We conduct extensive experiments in urban-scene segmentation and show the superiority of our approach to existing work. Our code is available at https://github.com/shachoi/RobustNet.

Key facts. Cited by 213 papers in the map (data through 7 Oct 2026). Builds on 56 of its 70 references that are in the map. First posted on arXiv 29 Mar 2021.

Builds on

56 of 70 references.

References · 56

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  5. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  7. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  8. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  9. 2016Pyramid Scene Parsing Networkcited by 2,472
  10. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  11. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
  12. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
38 more
  1. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  2. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  3. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  4. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,132
  5. 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
  6. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  7. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  8. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
  9. 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
  10. 2018ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentationcited by 623
  11. 2013Domain Generalization via Invariant Feature Representationcited by 622
  12. 2018Learning to Adapt Structured Output Space for Semantic Segmentationcited by 584
  13. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
  14. 2018Two at Once: Enhancing Learning and Generalization Capacities via IBN-Netcited by 361
  15. 2017Universal Style Transfer via Feature Transformscited by 352
  16. 2017Unified Deep Supervised Domain Adaptation and Generalizationcited by 322
  17. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  18. 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
  19. 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
  20. 2019Episodic Training for Domain Generalizationcited by 245
  21. 2019Domain Randomization and Pyramid Consistency: Simulation-to-Real Generalization without Accessing Target Domain Datacited by 245
  22. 2016FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptationcited by 242
  23. 2020Unsupervised Intra-domain Adaptation for Semantic Segmentation through Self-Supervisioncited by 198
  24. 2015ParseNet: Looking Wider to See Bettercited by 176
  25. 2018DLOW: Domain Flow for Adaptation and Generalizationcited by 176
  26. 2017Image to Image Translation for Domain Adaptationcited by 171
  27. 2019Learning to Optimize Domain Specific Normalization for Domain Generalizationcited by 160
  28. 2018Improving Semantic Segmentation via Video Propagation and Label Relaxationcited by 134
  29. 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
  30. 2019Feature-Critic Networks for Heterogeneous Domain Generalizationcited by 130
  31. 2017Curriculum Domain Adaptation for Semantic Segmentation of Urban Scenescited by 105
  32. 2019Switchable Whitening for Deep Representation Learningcited by 105
  33. 2018DCAN: Dual Channel-wise Alignment Networks for Unsupervised Scene Adaptationcited by 101
  34. 2017ROAD: Reality Oriented Adaptation for Semantic Segmentation of Urban Scenescited by 95
  35. 2019Iterative Normalization: Beyond Standardization towards Efficient Whiteningcited by 92
  36. 2018Decorrelated Batch Normalizationcited by 83
  37. 2020Cars Can't Fly up in the Sky: Improving Urban-Scene Segmentation via Height-driven Attention Networkscited by 70
  38. 2019Unsupervised Domain Adaptation using Feature-Whitening and Consensus Losscited by 67

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 42; 2023: 60; 2024: 40; 2025: 51; 2026: 12.

213 papers.

Sort:

By area:

  1. 2023Transformer-Based Visual Segmentation: A Surveycited by 124
  2. 2023EcoTTA: Memory-Efficient Continual Test-time Adaptation via Self-distilled Regularizationcited by 123
  3. 2022Uncertainty Modeling for Out-of-Distribution Generalizationcited by 122
  4. 2023TTN: A Domain-Shift Aware Batch Normalization in Test-Time Adaptationcited by 101
  5. 2022Style-Hallucinated Dual Consistency Learning for Domain Generalized Semantic Segmentationcited by 88
  6. 2023CLIP the Gap: A Single Domain Generalization Approach for Object Detectioncited by 87
  7. 2023Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentationcited by 82
  8. 2022Semantic-Aware Domain Generalized Segmentationcited by 78
  9. 2021Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentationcited by 77
  10. 2022WildNet: Learning Domain Generalized Semantic Segmentation from the Wildcited by 75
  11. 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
  12. 2022Improving Test-Time Adaptation via Shift-agnostic Weight Regularization and Nearest Source Prototypescited by 67
38 more
  1. 2021Test-time Batch Statistics Calibration for Covariate Shiftcited by 50
  2. 2022Pin the Memory: Learning to Generalize Semantic Segmentationcited by 48
  3. 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
  4. 2023DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Controlcited by 44
  5. 2021Source-Free Open Compound Domain Adaptation in Semantic Segmentationcited by 43
  6. 2023Instance-Aware Domain Generalization for Face Anti-Spoofingcited by 42
  7. 2021Feature Stylization and Domain-aware Contrastive Learning for Domain Generalizationcited by 40
  8. 2022ITSA: An Information-Theoretic Approach to Automatic Shortcut Avoidance and Domain Generalization in Stereo Matching Networkscited by 39
  9. 2023Towards Open-Set Test-Time Adaptation Utilizing the Wisdom of Crowds in Entropy Minimizationcited by 39
  10. 2022PASTA: Proportional Amplitude Spectrum Training Augmentation for Syn-to-Real Domain Generalizationcited by 38
  11. 2023Progressive Random Convolutions for Single Domain Generalizationcited by 33
  12. 2023Collaborating Foundation Models for Domain Generalized Semantic Segmentationcited by 33
  13. 2022FIFO: Learning Fog-invariant Features for Foggy Scene Segmentationcited by 31
  14. 2023HGFormer: Hierarchical Grouping Transformer for Domain Generalized Semantic Segmentationcited by 31
  15. 2023Prompting Diffusion Representations for Cross-Domain Semantic Segmentationcited by 30
  16. 2023Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Drivingcited by 29
  17. 2023Learning Content-enhanced Mask Transformer for Domain Generalized Urban-Scene Segmentationcited by 29
  18. 2024Improving Single Domain-Generalized Object Detection: A Focus on Diversification and Alignmentcited by 29
  19. 2024Unbiased Faster R-CNN for Single-source Domain Generalized Object Detectioncited by 29
  20. 2023SRCD: Semantic Reasoning with Compound Domains for Single-Domain Generalized Object Detectioncited by 28
  21. 2023A Simple Recipe for Language-guided Domain Generalized Segmentationcited by 27
  22. 2023Generalization by Adaptation: Diffusion-Based Domain Extension for Domain-Generalized Semantic Segmentationcited by 27
  23. 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
  24. 2023Domain Adaptive and Generalizable Network Architectures and Training Strategies for Semantic Image Segmentationcited by 26
  25. 2021WEDGE: Web-Image Assisted Domain Generalization for Semantic Segmentationcited by 25
  26. 2024BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptationcited by 25
  27. 2024Prompt-Driven Dynamic Object-Centric Learning for Single Domain Generalizationcited by 24
  28. 2024UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weathercited by 24
  29. 2023Texture Learning Domain Randomization for Domain Generalized Segmentationcited by 23
  30. 2024Rethinking Multi-domain Generalization with A General Learning Objectivecited by 23
  31. 2025Mamba as a Bridge: Where Vision Foundation Models Meet Vision Language Models for Domain-Generalized Semantic Segmentationcited by 23
  32. 2022Style-Hallucinated Dual Consistency Learning: A Unified Framework for Visual Domain Generalizationcited by 22
  33. 2024SoMA: Singular Value Decomposed Minor Components Adaptation for Domain Generalizable Representation Learningcited by 22
  34. 2022CAFA: Class-Aware Feature Alignment for Test-Time Adaptationcited by 21
  35. 2022Cross-Domain Ensemble Distillation for Domain Generalizationcited by 21
  36. 2023Object-Aware Domain Generalization for Object Detectioncited by 21
  37. 2024Learning Spectral-Decomposed Tokens for Domain Generalized Semantic Segmentationcited by 21
  38. 2021MVDG: A Unified Multi-view Framework for Domain Generalizationcited by 20

50 most cited of 213 All 213 (JSON)