Does enhanced shape bias improve neural network robustness to common corruptions?
Not on the map. Why?
Abstract (arXiv)
Convolutional neural networks (CNNs) learn to extract representations of complex features, such as object shapes and textures to solve image recognition tasks. Recent work indicates that CNNs trained on ImageNet are biased towards features that encode textures and that these alone are sufficient to generalize to unseen test data from the same distribution as the training data but often fail to generalize to out-of-distribution data. It has been shown that augmenting the training data with different image styles decreases this texture bias in favor of increased shape bias while at the same time improving robustness to common corruptions, such as noise and blur. Commonly, this is interpreted as shape bias increasing corruption robustness. However, this relationship is only hypothesized. We perform a systematic study of different ways of composing inputs based on natural images, explicit edge information, and stylization. While stylization is essential for achieving high corruption robustness, we do not find a clear correlation between shape bias and robustness. We conclude that the data augmentation caused by style-variation accounts for the improved corruption robustness and increased shape bias is only a byproduct.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 20 Apr 2021.
Builds on
33 of 39 references.
References · 33
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2016Adversarial examples in the physical worldcited by 1,762
- 2018Group Normalizationcited by 1,514
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
21 more
- 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 950
- 2015Holistically-Nested Edge Detectioncited by 590
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2019Making Convolutional Networks Shift-Invariant Againcited by 390
- 2016A Learned Representation For Artistic Stylecited by 340
- 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
- 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
- 2019Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNetcited by 260
- 2018Generalisation in humans and deep neural networkscited by 237
- 2019Domain-Specific Batch Normalization for Unsupervised Domain Adaptationcited by 197
- 2018Physical Adversarial Examples for Object Detectorscited by 163
- 2016Richer Convolutional Features for Edge Detectioncited by 141
- 2019Improving Robustness Without Sacrificing Accuracy with Patch Gaussian Augmentationcited by 105
- 2019On Physical Adversarial Patches for Object Detectioncited by 93
- 2017Measuring the tendency of CNNs to Learn Surface Statistical Regularitiescited by 87
- 2020On Feature Normalization and Data Augmentationcited by 71
- 2020Informative Dropout for Robust Representation Learning: A Shape-bias Perspectivecited by 57
- 2019Micro-Batch Training with Batch-Channel Normalization and Weight Standardizationcited by 45
- 2019Reducing Domain Gap by Reducing Style Biascited by 35
- 2020A simple way to make neural networks robust against diverse image corruptionscited by 30
Built on by
Citing papers per year: 2021: 6; 2022: 1; 2023: 5; 2024: 9; 2025: 7; 2026: 4.
32 papers.
Sort:
By area:
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2021Robust Contrastive Learning Using Negative Samples with Diminished Semanticscited by 43
- 2021On the Effect of Pruning on Adversarial Robustnesscited by 23
- 2024Can Biases in ImageNet Models Explain Generalization?cited by 20
- 2021Exploring Corruption Robustness: Inductive Biases in Vision Transformers and MLP-Mixerscited by 13
- 2025ImageNet-trained CNNs are not biased towards texture: Revisiting feature reliance through controlled suppressioncited by 13
- 2023Convolutional Neural Networks Rarely Learn Shape for Semantic Segmentationcited by 12
- 2024Trapped in texture bias? A large scale comparison of deep instance segmentationcited by 10
- 2024The Art of Deception: Color Visual Illusions and Diffusion Modelscited by 9
- 2024Visual Data Diagnosis and Debiasing with Concept Graphscited by 6
- 2024Deep Shape-Texture Statistics for Completely Blind Image Quality Evaluationcited by 5
- 2025Robust Asymmetric Heterogeneous Federated Learning with Corrupted Clientscited by 5
20 more
- 2024Enhancing 2D Representation Learning with a 3D Priorcited by 3
- 2025Shape Bias and Robustness Evaluation via Cue Decomposition for Image Classification and Segmentationcited by 3
- 2021On the Effects of Artificial Data Modificationcited by 2
- 2025Decomposing and Revising What Language Models Generatecited by 2
- 2021Robust Object Detection with Multi-input Multi-output Faster R-CNNcited by 1
- 2023Connecting metrics for shape-texture knowledge in computer visioncited by 1
- 2023Fourier Sensitivity and Regularization of Computer Vision Modelscited by 1
- 2023Domain Generalization Emerges from Dreamingcited by 1
- 2024Clarifying Myths About the Relationship Between Shape Bias, Accuracy, and Robustnesscited by 1
- 2025Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networkscited by 1
- 2026On the Reliability of Cue Conflict and Beyondcited by 1
- 2022Intrinsic Bias Identification on Medical Image Datasetscited by 0
- 2023On the ability of CNNs to extract color invariant intensity based features for image classificationcited by 0
- 2024On the Influence of Shape, Texture and Color for Learning Semantic Segmentationcited by 0
- 2024Contrast All the Time: Learning Time Series Representation from Temporal Consistencycited by 0
- 2025A Critical Review of Predominant Bias in Neural Networkscited by 0
- 2025Response Wide Shut? Surprising Observations in Basic Vision Language Model Capabilitiescited by 0
- 2026ShapeY: A Principled Framework for Measuring Shape Recognition Capacity via Nearest-Neighbor Matchingcited by 0
- 2026Anatomy of a failure: When, how, and why deep vision fails in scientific domainscited by 0
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillationcited by 0
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation24 Sep 2026
- 2026Anatomy of a failure: When, how, and why deep vision fails in scientific domains5 May 2026
- 2026ShapeY: A Principled Framework for Measuring Shape Recognition Capacity via Nearest-Neighbor Matching27 Apr 2026
- 2026On the Reliability of Cue Conflict and Beyond11 Mar 2026
- 2025ImageNet-trained CNNs are not biased towards texture: Revisiting feature reliance through controlled suppression24 Sep 2025
- 2025Decomposing and Revising What Language Models Generate31 Aug 2025
- 2025Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networks14 Jul 2025
- 2025Response Wide Shut? Surprising Observations in Basic Vision Language Model Capabilities10 Jul 2025
- 2025Shape Bias and Robustness Evaluation via Cue Decomposition for Image Classification and Segmentation16 Mar 2025
- 2025Robust Asymmetric Heterogeneous Federated Learning with Corrupted Clients12 Mar 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2024The Art of Deception: Color Visual Illusions and Diffusion Models13 Dec 2024
20 more
- 2024Contrast All the Time: Learning Time Series Representation from Temporal Consistency20 Oct 2024
- 2024On the Influence of Shape, Texture and Color for Learning Semantic Segmentation18 Oct 2024
- 2024Visual Data Diagnosis and Debiasing with Concept Graphs26 Sep 2024
- 2024Clarifying Myths About the Relationship Between Shape Bias, Accuracy, and Robustness7 Jun 2024
- 2024Enhancing 2D Representation Learning with a 3D Prior4 Jun 2024
- 2024Can Biases in ImageNet Models Explain Generalization?1 Apr 2024
- 2024Trapped in texture bias? A large scale comparison of deep instance segmentation17 Jan 2024
- 2024Deep Shape-Texture Statistics for Completely Blind Image Quality Evaluation16 Jan 2024
- 2023On the ability of CNNs to extract color invariant intensity based features for image classification13 Jul 2023
- 2023Convolutional Neural Networks Rarely Learn Shape for Semantic Segmentation11 May 2023
- 2023Domain Generalization Emerges from Dreaming2 Feb 2023
- 2023Fourier Sensitivity and Regularization of Computer Vision Models31 Jan 2023
- 2023Connecting metrics for shape-texture knowledge in computer vision25 Jan 2023
- 2022Intrinsic Bias Identification on Medical Image Datasets24 Mar 2022
- 2021Robust Object Detection with Multi-input Multi-output Faster R-CNN25 Nov 2021
- 2021Robust Contrastive Learning Using Negative Samples with Diminished Semantics27 Oct 2021
- 2021On the Effects of Artificial Data Modification26 Oct 2021
- 2021On the Effect of Pruning on Adversarial Robustness10 Aug 2021
- 2021Exploring Corruption Robustness: Inductive Biases in Vision Transformers and MLP-Mixers24 Jun 2021
- 2021Intriguing Properties of Vision Transformers21 May 2021
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2021Robust Contrastive Learning Using Negative Samples with Diminished Semanticscited by 43
- 2021On the Effect of Pruning on Adversarial Robustnesscited by 23
- 2024Can Biases in ImageNet Models Explain Generalization?cited by 20
- 2021Exploring Corruption Robustness: Inductive Biases in Vision Transformers and MLP-Mixerscited by 13
- 2025ImageNet-trained CNNs are not biased towards texture: Revisiting feature reliance through controlled suppressioncited by 13
- 2023Convolutional Neural Networks Rarely Learn Shape for Semantic Segmentationcited by 12
- 2024Trapped in texture bias? A large scale comparison of deep instance segmentationcited by 10
- 2024Visual Data Diagnosis and Debiasing with Concept Graphscited by 6
- 2024Deep Shape-Texture Statistics for Completely Blind Image Quality Evaluationcited by 5
- 2025Robust Asymmetric Heterogeneous Federated Learning with Corrupted Clientscited by 5
- 2024Enhancing 2D Representation Learning with a 3D Priorcited by 3
12 most cited of 30 All 30 (JSON)
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation24 Sep 2026
- 2026Anatomy of a failure: When, how, and why deep vision fails in scientific domains5 May 2026
- 2026ShapeY: A Principled Framework for Measuring Shape Recognition Capacity via Nearest-Neighbor Matching27 Apr 2026
- 2026On the Reliability of Cue Conflict and Beyond11 Mar 2026
- 2025ImageNet-trained CNNs are not biased towards texture: Revisiting feature reliance through controlled suppression24 Sep 2025
- 2025Decomposing and Revising What Language Models Generate31 Aug 2025
- 2025Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networks14 Jul 2025
- 2025Shape Bias and Robustness Evaluation via Cue Decomposition for Image Classification and Segmentation16 Mar 2025
- 2025Robust Asymmetric Heterogeneous Federated Learning with Corrupted Clients12 Mar 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2024Contrast All the Time: Learning Time Series Representation from Temporal Consistency20 Oct 2024
- 2024On the Influence of Shape, Texture and Color for Learning Semantic Segmentation18 Oct 2024
12 newest of 30 All 30 (JSON)