Promoting Shape Bias in CNNs: Frequency-Based and Contrastive Regularization for Corruption Robustness
Not on the map. Why?
Abstract (arXiv)
Convolutional Neural Networks (CNNs) excel at image classification but remain vulnerable to common corruptions that humans handle with ease. A key reason for this fragility is their reliance on local texture cues rather than global object shapes -- a stark contrast to human perception. To address this, we propose two complementary regularization strategies designed to encourage shape-biased representations and enhance robustness. The first introduces an auxiliary loss that enforces feature consistency between original and low-frequency filtered inputs, discouraging dependence on high-frequency textures. The second incorporates supervised contrastive learning to structure the feature space around class-consistent, shape-relevant representations. Evaluated on the CIFAR-10-C benchmark, both methods improve corruption robustness without degrading clean accuracy. Our results suggest that loss-level regularization can effectively steer CNNs toward more shape-aware, resilient representations.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 39 references that are in the map. First posted on arXiv 14 Sep 2025.
Builds on
14 of 39 references.
References · 14
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2020Supervised Contrastive Learningcited by 2,829
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2019High Frequency Component Helps Explain the Generalization of Convolutional Neural Networkscited by 310
- 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
- 2025Winsor-CAM: Human-Tunable Visual Explanations from Deep Networks via Layer-Wise Winsorizationcited by 10
- 2024Dense Cross-Connected Ensemble Convolutional Neural Networks for Enhanced Model Robustnesscited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Bridging Symmetry and Robustness: On the Role of Equivariance in Enhancing Adversarial Robustnesscited by 8
- 2026Explainable Novel Category Discovery in Semantic Concept Spacecited by 1
- 2026Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphscited by 0
- 2026Grad-CAM for Vision Transformers: A Systematic Taxonomy and Audit of Methodological Ambiguity in Explainable AIcited by 0
- 2026Grad-CAM for Vision Transformers: A Systematic Taxonomy and Audit of Methodological Ambiguity in Explainable AI5 Aug 2026
- 2026Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs8 Jul 2026
- 2026Explainable Novel Category Discovery in Semantic Concept Space5 Jul 2026
- 2025Bridging Symmetry and Robustness: On the Role of Equivariance in Enhancing Adversarial Robustness17 Oct 2025