mlsanityData to 7 Oct 2026

Does enhanced shape bias improve neural network robustness to common corruptions?

arXiv 2104.09789 ↗First posted 20 Apr 2021cs.CVcited by 32

Not on the map. Why?

Abstract (arXiv)

Convolutional neural networks (CNNs) learn to extract representations of complex features, such as object shapes and textures to solve image recognition tasks. Recent work indicates that CNNs trained on ImageNet are biased towards features that encode textures and that these alone are sufficient to generalize to unseen test data from the same distribution as the training data but often fail to generalize to out-of-distribution data. It has been shown that augmenting the training data with different image styles decreases this texture bias in favor of increased shape bias while at the same time improving robustness to common corruptions, such as noise and blur. Commonly, this is interpreted as shape bias increasing corruption robustness. However, this relationship is only hypothesized. We perform a systematic study of different ways of composing inputs based on natural images, explicit edge information, and stylization. While stylization is essential for achieving high corruption robustness, we do not find a clear correlation between shape bias and robustness. We conclude that the data augmentation caused by style-variation accounts for the improved corruption robustness and increased shape bias is only a byproduct.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 20 Apr 2021.

Builds on

33 of 39 references.

References · 33

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  2. 2013Intriguing properties of neural networkscited by 5,114
  3. 2017Squeeze-and-Excitation Networkscited by 4,763
  4. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  5. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  6. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  7. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  8. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  9. 2016Adversarial examples in the physical worldcited by 1,762
  10. 2018Group Normalizationcited by 1,514
  11. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  12. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
21 more
  1. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
  2. 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 950
  3. 2015Holistically-Nested Edge Detectioncited by 590
  4. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
  5. 2019Making Convolutional Networks Shift-Invariant Againcited by 390
  6. 2016A Learned Representation For Artistic Stylecited by 340
  7. 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
  8. 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
  9. 2019Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNetcited by 260
  10. 2018Generalisation in humans and deep neural networkscited by 237
  11. 2019Domain-Specific Batch Normalization for Unsupervised Domain Adaptationcited by 197
  12. 2018Physical Adversarial Examples for Object Detectorscited by 163
  13. 2016Richer Convolutional Features for Edge Detectioncited by 141
  14. 2019Improving Robustness Without Sacrificing Accuracy with Patch Gaussian Augmentationcited by 105
  15. 2019On Physical Adversarial Patches for Object Detectioncited by 93
  16. 2017Measuring the tendency of CNNs to Learn Surface Statistical Regularitiescited by 87
  17. 2020On Feature Normalization and Data Augmentationcited by 71
  18. 2020Informative Dropout for Robust Representation Learning: A Shape-bias Perspectivecited by 57
  19. 2019Micro-Batch Training with Batch-Channel Normalization and Weight Standardizationcited by 45
  20. 2019Reducing Domain Gap by Reducing Style Biascited by 35
  21. 2020A simple way to make neural networks robust against diverse image corruptionscited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 6; 2022: 1; 2023: 5; 2024: 9; 2025: 7; 2026: 4.

32 papers.

Sort:

By area:

  1. 2021Intriguing Properties of Vision Transformerscited by 446
  2. 2021Robust Contrastive Learning Using Negative Samples with Diminished Semanticscited by 43
  3. 2021On the Effect of Pruning on Adversarial Robustnesscited by 23
  4. 2024Can Biases in ImageNet Models Explain Generalization?cited by 20
  5. 2021Exploring Corruption Robustness: Inductive Biases in Vision Transformers and MLP-Mixerscited by 13
  6. 2025ImageNet-trained CNNs are not biased towards texture: Revisiting feature reliance through controlled suppressioncited by 13
  7. 2023Convolutional Neural Networks Rarely Learn Shape for Semantic Segmentationcited by 12
  8. 2024Trapped in texture bias? A large scale comparison of deep instance segmentationcited by 10
  9. 2024The Art of Deception: Color Visual Illusions and Diffusion Modelscited by 9
  10. 2024Visual Data Diagnosis and Debiasing with Concept Graphscited by 6
  11. 2024Deep Shape-Texture Statistics for Completely Blind Image Quality Evaluationcited by 5
  12. 2025Robust Asymmetric Heterogeneous Federated Learning with Corrupted Clientscited by 5
20 more
  1. 2024Enhancing 2D Representation Learning with a 3D Priorcited by 3
  2. 2025Shape Bias and Robustness Evaluation via Cue Decomposition for Image Classification and Segmentationcited by 3
  3. 2021On the Effects of Artificial Data Modificationcited by 2
  4. 2025Decomposing and Revising What Language Models Generatecited by 2
  5. 2021Robust Object Detection with Multi-input Multi-output Faster R-CNNcited by 1
  6. 2023Connecting metrics for shape-texture knowledge in computer visioncited by 1
  7. 2023Fourier Sensitivity and Regularization of Computer Vision Modelscited by 1
  8. 2023Domain Generalization Emerges from Dreamingcited by 1
  9. 2024Clarifying Myths About the Relationship Between Shape Bias, Accuracy, and Robustnesscited by 1
  10. 2025Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networkscited by 1
  11. 2026On the Reliability of Cue Conflict and Beyondcited by 1
  12. 2022Intrinsic Bias Identification on Medical Image Datasetscited by 0
  13. 2023On the ability of CNNs to extract color invariant intensity based features for image classificationcited by 0
  14. 2024On the Influence of Shape, Texture and Color for Learning Semantic Segmentationcited by 0
  15. 2024Contrast All the Time: Learning Time Series Representation from Temporal Consistencycited by 0
  16. 2025A Critical Review of Predominant Bias in Neural Networkscited by 0
  17. 2025Response Wide Shut? Surprising Observations in Basic Vision Language Model Capabilitiescited by 0
  18. 2026ShapeY: A Principled Framework for Measuring Shape Recognition Capacity via Nearest-Neighbor Matchingcited by 0
  19. 2026Anatomy of a failure: When, how, and why deep vision fails in scientific domainscited by 0
  20. 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillationcited by 0