Exploring the Landscape of Spatial Robustness
Not on the map. Why?
Abstract (arXiv)
The study of adversarial robustness has so far largely focused on perturbations bound in p-norms. However, state-of-the-art models turn out to be also vulnerable to other, more natural classes of perturbations such as translations and rotations. In this work, we thoroughly investigate the vulnerability of neural network--based classifiers to rotations and translations. While data augmentation offers relatively small robustness, we use ideas from robust optimization and test-time input aggregation to significantly improve robustness. Finally we find that, in contrast to the p-norm case, first-order methods cannot reliably find worst-case perturbations. This highlights spatial robustness as a fundamentally different setting requiring additional study. Code available at https://github.com/MadryLab/adversarial_spatial and https://github.com/MadryLab/spatial-pytorch.
Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 38; 2022: 11; 2023: 14; 2024: 8; 2025: 7; 2026: 3.
81 papers.
Sort:
By area:
- 2021Unsolved Problems in ML Safetycited by 291
- 2023Diffusion-Based Adversarial Sample Generation for Improved Stealthiness and Controllabilitycited by 66
- 2021CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detectioncited by 64
- 2023Black Box Adversarial Prompting for Foundation Modelscited by 62
- 2022The Lie Derivative for Measuring Learned Equivariancecited by 51
- 2022On the Principles of Parsimony and Self-Consistency for the Emergence of Intelligencecited by 50
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2025SynthID-Image: Image watermarking at internet scalecited by 26
- 2022Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformerscited by 25
- 2021Exploring Adversarial Fake Images on Face Manifoldcited by 24
- 2021Towards Robust Neural Networks via Close-loop Controlcited by 23
- 2021ML Attack Models: Adversarial Attacks and Data Poisoning Attackscited by 23
38 more
- 2021Robustness and Generalization via Generative Adversarial Trainingcited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021CC-Cert: A Probabilistic Approach to Certify General Robustness of Neural Networkscited by 18
- 2021Scale-invariant scale-channel networks: Deep networks that generalise to previously unseen scalescited by 17
- 2023Instruct2Attack: Language-Guided Semantic Adversarial Attackscited by 16
- 2021Anti-aliasing Deep Image Classifiers using Novel Depth Adaptive Blurring and Activation Functioncited by 11
- 2021Adversarial Token Attacks on Vision Transformerscited by 11
- 2023Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learningcited by 11
- 2021Truly shift-equivariant convolutional neural networks with adaptive polyphase upsamplingcited by 10
- 2024Verification of Neural Networks' Global Robustnesscited by 10
- 2021Training or Architecture? How to Incorporate Invariance in Neural Networkscited by 9
- 2023Policy Gradient Methods in the Presence of Symmetries and State Abstractionscited by 8
- 2024Machine Learning Robustness: A Primercited by 8
- 2021Domain Invariant Adversarial Learningcited by 7
- 2021SI-Score: An image dataset for fine-grained analysis of robustness to object location, rotation and sizecited by 7
- 2021Imperceptible Adversarial Examples by Spatial Chroma-Shiftcited by 7
- 2024A Survey and Evaluation of Adversarial Attacks for Object Detectioncited by 7
- 2021Simple Transparent Adversarial Examplescited by 6
- 2021Relaxing Local Robustnesscited by 6
- 2021Generating Unrestricted Adversarial Examples via Three Parameterscited by 5
- 2021Improving Sound Event Classification by Increasing Shift Invariance in Convolutional Neural Networkscited by 5
- 2021Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoderscited by 4
- 2022Certified Robustness in Federated Learningcited by 4
- 2021Tiny Adversarial Mulit-Objective Oneshot Neural Architecture Searchcited by 3
- 2021Adversarial Attack Driven Data Augmentation for Accurate And Robust Medical Image Segmentationcited by 3
- 2021In-distribution adversarial attacks on object recognition models using gradient-free searchcited by 3
- 2021Tightening the Approximation Error of Adversarial Risk with Auto Loss Function Searchcited by 3
- 2023Adversarial Image Generation by Spatial Transformation in Perceptual Colorspacescited by 3
- 2024Adversarial Attacks and Defenses in Multivariate Time-Series Forecasting for Smart and Connected Infrastructurescited by 3
- 2021Robust Training Using Natural Transformationcited by 2
- 2021Probing the Effect of Selection Bias on Generalization: A Thought Experimentcited by 2
- 2021Pareto Adversarial Robustness: Balancing Spatial Robustness and Sensitivity-based Robustnesscited by 2
- 2022A Simple Strategy to Provable Invariance via Orbit Mappingcited by 2
- 2022A Closer Look at Robustness to L-infinity and Spatial Perturbations and their Compositioncited by 2
- 2022Assessing Neural Network Robustness via Adversarial Pivotal Tuningcited by 2
- 2023A Geometrical Approach to Evaluate the Adversarial Robustness of Deep Neural Networkscited by 2
- 2021Adversarial Robustness: What fools you makes you strongercited by 1
- 2021Localized Uncertainty Attackscited by 1
50 most cited of 81 All 81 (JSON)
- 2026Which Directions Matter? Sparse Design for Affine Robust Optimization12 Jun 2026
- 2026When Surfaces Lie: Exploiting Wrinkle-Induced Attention Shift to Attack Vision-Language Models29 Mar 2026
- 2026Latent Transfer Attack: Adversarial Examples via Generative Latent Spaces6 Mar 2026
- 2025TIE: A Training-Inversion-Exclusion Framework for Visually Interpretable and Uncertainty-Guided Out-of-Distribution Detection28 Nov 2025
- 2025Diffusion Guided Adversarial State Perturbations in Reinforcement Learning10 Nov 2025
- 2025SynthID-Image: Image watermarking at internet scale10 Oct 2025
- 2025Fool the Stoplight: Realistic Adversarial Patch Attacks on Traffic Light Detectors5 Jun 2025
- 2025ROSA: Addressing text understanding challenges in photographs via ROtated SAmpling4 Jun 2025
- 2025Network Inversion for Uncertainty-Aware Out-of-Distribution Detection29 May 2025
- 2025A Cryptographic Perspective on Mitigation vs. Detection in Machine Learning28 Apr 2025
- 2024Brain-like emergent properties in deep networks: impact of network architecture, datasets and training25 Nov 2024
- 2024Adversarial Attacks and Defenses in Multivariate Time-Series Forecasting for Smart and Connected Infrastructures27 Aug 2024
38 more
- 2024Improving Out-of-Distribution Data Handling and Corruption Resistance via Modern Hopfield Networks21 Aug 2024
- 2024A Survey and Evaluation of Adversarial Attacks for Object Detection4 Aug 2024
- 2024Comparing Data Augmentation Methods for End-to-End Task-Oriented Dialog Systems10 Jun 2024
- 2024Machine Learning Robustness: A Primer1 Apr 2024
- 2024Verification of Neural Networks' Global Robustness29 Feb 2024
- 2024RAMP: Boosting Adversarial Robustness Against Multiple lp Perturbations for Universal Robustness9 Feb 2024
- 2023RetouchUAA: Unconstrained Adversarial Attack via Image Retouching27 Nov 2023
- 2023Instruct2Attack: Language-Guided Semantic Adversarial Attacks27 Nov 2023
- 2023Invariance Measures for Neural Networks26 Oct 2023
- 2023Adversarial Image Generation by Spatial Transformation in Perceptual Colorspaces21 Oct 2023
- 2023A Geometrical Approach to Evaluate the Adversarial Robustness of Deep Neural Networks10 Oct 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 2023Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learning14 Jul 2023
- 2023Restore Translation Using Equivariant Neural Networks29 Jun 2023
- 2023Cooperation or Competition: Avoiding Player Domination for Multi-Target Robustness via Adaptive Budgets27 Jun 2023
- 2023Diffusion-Based Adversarial Sample Generation for Improved Stealthiness and Controllability25 May 2023
- 2023HARD: Hard Augmentations for Robust Distillation24 May 2023
- 2023Policy Gradient Methods in the Presence of Symmetries and State Abstractions9 May 2023
- 2023Optimizing the AI Development Process by Providing the Best Support Environment29 Apr 2023
- 2023Black Box Adversarial Prompting for Foundation Models8 Feb 2023
- 2022Assessing Neural Network Robustness via Adversarial Pivotal Tuning17 Nov 2022
- 2022Combination of multiple neural networks using transfer learning and extensive geometric data augmentation for assessing cellularity scores in histopathology images9 Nov 2022
- 2022The Lie Derivative for Measuring Learned Equivariance6 Oct 2022
- 2022A Closer Look at Robustness to L-infinity and Spatial Perturbations and their Composition5 Oct 2022
- 2022A Simple Strategy to Provable Invariance via Orbit Mapping24 Sep 2022
- 2022On the Principles of Parsimony and Self-Consistency for the Emergence of Intelligence11 Jul 2022
- 2022Certified Robustness in Federated Learning6 Jun 2022
- 2022Repairing Group-Level Errors for DNNs Using Weighted Regularization24 Mar 2022
- 2022CapsNet for Medical Image Segmentation16 Mar 2022
- 2022Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformers2 Mar 2022
- 2022ReCasNet: Improving consistency within the two-stage mitosis detection framework28 Feb 2022
- 2021Provable Adversarial Robustness in the Quantum Model17 Dec 2021
- 2021ML Attack Models: Adversarial Attacks and Data Poisoning Attacks6 Dec 2021
- 2021Tightening the Approximation Error of Adversarial Risk with Auto Loss Function Search9 Nov 2021
- 2021Pareto Adversarial Robustness: Balancing Spatial Robustness and Sensitivity-based Robustness3 Nov 2021
- 2021Adversarial Token Attacks on Vision Transformers8 Oct 2021
- 2021Anti-aliasing Deep Image Classifiers using Novel Depth Adaptive Blurring and Activation Function3 Oct 2021
- 2021Unsolved Problems in ML Safety28 Sep 2021
50 newest of 81 All 81 (JSON)
- 2023Black Box Adversarial Prompting for Foundation Modelscited by 62
- 2021ML Attack Models: Adversarial Attacks and Data Poisoning Attackscited by 23
- 2021Unsolved Problems in ML Safetycited by 291
- 2023Diffusion-Based Adversarial Sample Generation for Improved Stealthiness and Controllabilitycited by 66
- 2021CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detectioncited by 64
- 2022The Lie Derivative for Measuring Learned Equivariancecited by 51
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2025SynthID-Image: Image watermarking at internet scalecited by 26
- 2022Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformerscited by 25
- 2021Exploring Adversarial Fake Images on Face Manifoldcited by 24
- 2021Towards Robust Neural Networks via Close-loop Controlcited by 23
- 2021Robustness and Generalization via Generative Adversarial Trainingcited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021CC-Cert: A Probabilistic Approach to Certify General Robustness of Neural Networkscited by 18
12 most cited of 77 All 77 (JSON)
- 2026Which Directions Matter? Sparse Design for Affine Robust Optimization12 Jun 2026
- 2026Latent Transfer Attack: Adversarial Examples via Generative Latent Spaces6 Mar 2026
- 2025TIE: A Training-Inversion-Exclusion Framework for Visually Interpretable and Uncertainty-Guided Out-of-Distribution Detection28 Nov 2025
- 2025Diffusion Guided Adversarial State Perturbations in Reinforcement Learning10 Nov 2025
- 2025SynthID-Image: Image watermarking at internet scale10 Oct 2025
- 2025Fool the Stoplight: Realistic Adversarial Patch Attacks on Traffic Light Detectors5 Jun 2025
- 2025ROSA: Addressing text understanding challenges in photographs via ROtated SAmpling4 Jun 2025
- 2025Network Inversion for Uncertainty-Aware Out-of-Distribution Detection29 May 2025
- 2025A Cryptographic Perspective on Mitigation vs. Detection in Machine Learning28 Apr 2025
- 2024Brain-like emergent properties in deep networks: impact of network architecture, datasets and training25 Nov 2024
- 2024Adversarial Attacks and Defenses in Multivariate Time-Series Forecasting for Smart and Connected Infrastructures27 Aug 2024
- 2024Improving Out-of-Distribution Data Handling and Corruption Resistance via Modern Hopfield Networks21 Aug 2024
12 newest of 77 All 77 (JSON)