Alignment and Adversarial Robustness: Are More Human-Like Models More Secure?
Not on the map. Why?
Abstract (arXiv)
A small but growing body of work has shown that machine learning models which better align with human vision have also exhibited higher robustness to adversarial examples, raising the question: can human-like perception make models more secure? If true generally, such mechanisms would offer new avenues toward robustness. In this work, we conduct a large-scale empirical analysis to systematically investigate the relationship between representational alignment and adversarial robustness. We evaluate 114 models spanning diverse architectures and training paradigms, measuring their neural and behavioral alignment and engineering task performance across 105 benchmarks as well as their adversarial robustness via AutoAttack. Our findings reveal that while average alignment and robustness exhibit a weak overall correlation, specific alignment benchmarks serve as strong predictors of adversarial robustness, particularly those that measure selectivity toward texture or shape. These results suggest that different forms of alignment play distinct roles in model robustness, motivating further investigation into how alignment-driven approaches can be leveraged to build more secure and perceptually-grounded vision models.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 29 of its 39 references that are in the map. First posted on arXiv 17 Feb 2025.
Builds on
29 of 39 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2022A ConvNet for the 2020scited by 3,579
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
17 more
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
- 2020RobustBench: a standardized adversarial robustness benchmarkcited by 661
- 2015An Introduction to Convolutional Neural Networkscited by 514
- 2019On Evaluating Adversarial Robustnesscited by 447
- 2018Generalisation in humans and deep neural networkscited by 237
- 2021Partial success in closing the gap between human and machine visioncited by 185
- 2020Torchattacks: A PyTorch Repository for Adversarial Attackscited by 158
- 2023Getting aligned on representational alignmentcited by 143
- 2019Learning From Brains How to Regularize Machinescited by 38
- 2023Improving neural network representations using human similarity judgmentscited by 38
- 2023Spatial-frequency channels, shape bias, and adversarial robustnesscited by 28
- 2023Alignment with human representations supports robust few-shot learningcited by 25
- 2024How Aligned are Different Alignment Metrics?cited by 6
- 2024Explorations in Texture Learningcited by 3
- 2024RTify: Aligning Deep Neural Networks with Human Behavioral Decisionscited by 3
- 2024Err on the Side of Texture: Texture Bias on Real Datacited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.