Adversarial vulnerability for any classifier
Not on the map. Why?
Abstract (arXiv)
Despite achieving impressive performance, state-of-the-art classifiers remain highly vulnerable to small, imperceptible, adversarial perturbations. This vulnerability has proven empirically to be very intricate to address. In this paper, we study the phenomenon of adversarial perturbations under the assumption that the data is generated with a smooth generative model. We derive fundamental upper bounds on the robustness to perturbations of any classification function, and prove the existence of adversarial perturbations that transfer well across different classifiers with small risk. Our analysis of the robustness also provides insights onto key properties of generative models, such as their smoothness and dimensionality of latent space. We conclude with numerical experimental results showing that our bounds provide informative baselines to the maximal achievable robustness on several datasets.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 19; 2023: 9; 2024: 15; 2025: 8; 2026: 7.
78 papers.
Sort:
By area:
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Detecting Adversarial Examples from Sensitivity Inconsistency of Spatial-Transform Domaincited by 29
- 2022Gradient Methods Provably Converge to Non-Robust Networkscited by 27
- 2023The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networkscited by 23
- 2021Universal Adversarial Perturbations Through the Lens of Deep Steganography: Towards A Fourier Perspectivecited by 18
- 2021The mathematics of adversarial attacks in AI -- Why deep learning is unstable despite the existence of stable neural networkscited by 16
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attackcited by 15
- 2022Adversarial Examples in Random Neural Networks with General Activationscited by 13
- 2021Building Reliable Explanations of Unreliable Neural Networks: Locally Smoothing Perspective of Model Interpretationcited by 12
- 2022On the Robustness of Bayesian Neural Networks to Adversarial Attackscited by 12
- 2021Benign Overfitting in Adversarially Robust Linear Classificationcited by 11
- 2022Adversarial robustness of sparse local Lipschitz predictorscited by 11
38 more
- 2023Adversarial Examples Might be Avoidable: The Role of Data Concentration in Adversarial Robustnesscited by 11
- 2021Interpolated Joint Space Adversarial Training for Robust and Generalizable Defensescited by 10
- 2024Detecting Brittle Decisions for Free: Leveraging Margin Consistency in Deep Robust Classifierscited by 10
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustnesscited by 9
- 2021On the regularized risk of distributionally robust learning over deep neural networkscited by 8
- 2023Adversarial Examples Exist in Two-Layer ReLU Networks for Low Dimensional Linear Subspacescited by 8
- 2024Scaling Laws for Black box Adversarial Attackscited by 8
- 2022Towards Effective and Robust Neural Trojan Defenses via Input Filteringcited by 7
- 2024On the Computability of Robust PAC Learningcited by 6
- 2021Bridging the Gap Between Adversarial Robustness and Optimization Biascited by 5
- 2022Adversarial attacks on neural networks through canonical Riemannian foliationscited by 5
- 2024Can Implicit Bias Imply Adversarial Robustness?cited by 5
- 2024Towards Adversarial Robustness via Debiased High-Confidence Logit Alignmentcited by 5
- 2025Shifting the Paradigm: A Diffeomorphism Between Time Series Data Manifolds for Achieving Shift-Invariancy in Deep Learningcited by 5
- 2021Improved Estimation of Concentration Under ℓp-Norm Distance Metrics Using Half Spacescited by 4
- 2021Robustness of Bayesian Neural Networks to White-Box Adversarial Attackscited by 4
- 2022A Manifold View of Adversarial Riskcited by 4
- 2022Sample Complexity Bounds for Robustly Learning Decision Lists against Evasion Attackscited by 4
- 2023Investigating the Corruption Robustness of Image Classifiers with Random Lp-norm Corruptionscited by 4
- 2024The Price of Implicit Bias in Adversarially Robust Generalizationcited by 4
- 2021In-distribution adversarial attacks on object recognition models using gradient-free searchcited by 3
- 2021Understanding Intrinsic Robustness Using Label Uncertaintycited by 3
- 2022Origins of Low-dimensional Adversarial Perturbationscited by 3
- 2025Scanning Trojaned Models Using Out-of-Distribution Samplescited by 3
- 2021"What's in the box?!": Deflecting Adversarial Attacks by Randomly Deploying Adversarially-Disjoint Modelscited by 2
- 2021On some theoretical limitations of Generative Adversarial Networkscited by 2
- 2022Layer-wise Regularized Adversarial Training using Layers Sustainability Analysis (LSA) frameworkcited by 2
- 2022Adversarial Fine-tune with Dynamically Regulated Adversarycited by 2
- 2022Holistic Approach to Measure Sample-level Adversarial Vulnerability and its Utility in Building Trustworthy Systemscited by 2
- 2024Fermi-Bose Machine achieves both generalization and adversarial robustnesscited by 2
- 2025Exact Upper and Lower Bounds for the Output Distribution of Neural Networks with Random Inputscited by 2
- 2025Rethinking the Vulnerability of Concept Erasure and a New Methodcited by 2
- 2025GradEscape: A Gradient-Based Evader Against AI-Generated Text Detectorscited by 2
- 2026The Defense Trilemma: Why Prompt Injection Defense Wrappers Fail?cited by 2
- 2021Image classifiers can not be made robust to small perturbationscited by 1
- 2022Adversarial Noises Are Linearly Separable for (Nearly) Random Neural Networkscited by 1
- 2022Defense Against Multi-target Trojan Attackscited by 1
- 2022When are Local Queries Useful for Robust Learning?cited by 1
50 most cited of 78 All 78 (JSON)
- 2026Tubular Neighbourhoods of Pfaffian Sets and Applications to Neural Networks9 Jul 2026
- 2026The Role of Input Dimensionality in the Emergence and Targeted Control of Adversarial Examples24 Jun 2026
- 2026Adaptive Causal Alignment for High-Confidence Adversarial Training2 Jun 2026
- 2026Efficient Techniques for Data Reconstruction, with Finite-Width Recovery Guarantees7 May 2026
- 2026Perturb and Correct: Post-Hoc Ensembles using Affine Redundancy2 May 2026
- 2026The Defense Trilemma: Why Prompt Injection Defense Wrappers Fail?7 Apr 2026
- 2026Most Convolutional Networks Suffer from Small Adversarial Perturbations3 Feb 2026
- 2025Adversarial Robustness in Financial Machine Learning: Defenses, Economic Impact, and Governance Evidence14 Dec 2025
- 2025Nearest Neighbor Projection Removal Adversarial Training9 Sep 2025
- 2025Existence of Adversarial Examples for Random Convolutional Networks via Isoperimetric Inequalities on mathbbso(d)14 Jun 2025
- 2025GradEscape: A Gradient-Based Evader Against AI-Generated Text Detectors9 Jun 2025
- 2025Shifting the Paradigm: A Diffeomorphism Between Time Series Data Manifolds for Achieving Shift-Invariancy in Deep Learning27 Feb 2025
38 more
- 2025Rethinking the Vulnerability of Concept Erasure and a New Method24 Feb 2025
- 2025Exact Upper and Lower Bounds for the Output Distribution of Neural Networks with Random Inputs17 Feb 2025
- 2025Scanning Trojaned Models Using Out-of-Distribution Samples28 Jan 2025
- 2024Adversarial Transferability in Deep Denoising Models: Theoretical Insights and Robustness Enhancement via Out-of-Distribution Typical Set Sampling8 Dec 2024
- 2024Scaling Laws for Black box Adversarial Attacks25 Nov 2024
- 2024Computable Model-Independent Bounds for Adversarial Quantum Machine Learning11 Nov 2024
- 2024Adversarial Detection with a Dynamically Stable System11 Nov 2024
- 2024Golyadkin's Torment: Doppelg"angers and Adversarial Vulnerability17 Oct 2024
- 2024Towards Adversarial Robustness via Debiased High-Confidence Logit Alignment12 Aug 2024
- 2024Footprints of Data in a Classifier: Understanding the Privacy Risks and Solution Strategies2 Jul 2024
- 2024MALT Powers Up Adversarial Attacks2 Jul 2024
- 2024Detecting Brittle Decisions for Free: Leveraging Margin Consistency in Deep Robust Classifiers26 Jun 2024
- 2024On the Computability of Robust PAC Learning14 Jun 2024
- 2024The Price of Implicit Bias in Adversarially Robust Generalization7 Jun 2024
- 2024Can Implicit Bias Imply Adversarial Robustness?24 May 2024
- 2024Fermi-Bose Machine achieves both generalization and adversarial robustness21 Apr 2024
- 2024Robustness bounds on the successful adversarial examples in probabilistic models: Implications from Gaussian processes4 Mar 2024
- 2024Evaluating the Robustness of Off-Road Autonomous Driving Segmentation against Adversarial Attacks: A Dataset-Centric analysis3 Feb 2024
- 2023On The Relationship Between Universal Adversarial Attacks And Sparse Representations14 Nov 2023
- 2023Adversarial Examples Might be Avoidable: The Role of Data Concentration in Adversarial Robustness28 Sep 2023
- 2023A reading survey on adversarial machine learning: Adversarial attacks and their understanding7 Aug 2023
- 2023Exploiting Frequency Spectrum of Adversarial Images for General Robustness15 May 2023
- 2023Investigating the Corruption Robustness of Image Classifiers with Random Lp-norm Corruptions9 May 2023
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustness17 Mar 2023
- 2023The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks2 Mar 2023
- 2023Adversarial Examples Exist in Two-Layer ReLU Networks for Low Dimensional Linear Subspaces1 Mar 2023
- 2023Linking convolutional kernel size to generalization bias in face analysis CNNs7 Feb 2023
- 2022When are Local Queries Useful for Robust Learning?12 Oct 2022
- 2022On the Robustness of Bayesian Neural Networks to Adversarial Attacks13 Jul 2022
- 2022Defense Against Multi-target Trojan Attacks8 Jul 2022
- 2022Adversarial Example Detection in Deployed Tree Ensembles27 Jun 2022
- 2022Adversarial Noises Are Linearly Separable for (Nearly) Random Neural Networks9 Jun 2022
- 2022Sample Complexity Bounds for Robustly Learning Decision Lists against Evasion Attacks12 May 2022
- 2022Holistic Approach to Measure Sample-level Adversarial Vulnerability and its Utility in Building Trustworthy Systems5 May 2022
- 2022Adversarial Fine-tune with Dynamically Regulated Adversary28 Apr 2022
- 2022When adversarial examples are excusable25 Apr 2022
- 2022Scalable Whitebox Attacks on Tree-based Models31 Mar 2022
- 2022Adversarial Examples in Random Neural Networks with General Activations31 Mar 2022
50 newest of 78 All 78 (JSON)
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Detecting Adversarial Examples from Sensitivity Inconsistency of Spatial-Transform Domaincited by 29
- 2022Gradient Methods Provably Converge to Non-Robust Networkscited by 27
- 2023The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networkscited by 23
- 2021Universal Adversarial Perturbations Through the Lens of Deep Steganography: Towards A Fourier Perspectivecited by 18
- 2021The mathematics of adversarial attacks in AI -- Why deep learning is unstable despite the existence of stable neural networkscited by 16
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attackcited by 15
- 2022Adversarial Examples in Random Neural Networks with General Activationscited by 13
- 2021Building Reliable Explanations of Unreliable Neural Networks: Locally Smoothing Perspective of Model Interpretationcited by 12
- 2022On the Robustness of Bayesian Neural Networks to Adversarial Attackscited by 12
- 2021Benign Overfitting in Adversarially Robust Linear Classificationcited by 11
- 2022Adversarial robustness of sparse local Lipschitz predictorscited by 11
12 most cited of 75 All 75 (JSON)
- 2026Tubular Neighbourhoods of Pfaffian Sets and Applications to Neural Networks9 Jul 2026
- 2026The Role of Input Dimensionality in the Emergence and Targeted Control of Adversarial Examples24 Jun 2026
- 2026Adaptive Causal Alignment for High-Confidence Adversarial Training2 Jun 2026
- 2026Efficient Techniques for Data Reconstruction, with Finite-Width Recovery Guarantees7 May 2026
- 2026Perturb and Correct: Post-Hoc Ensembles using Affine Redundancy2 May 2026
- 2026Most Convolutional Networks Suffer from Small Adversarial Perturbations3 Feb 2026
- 2025Adversarial Robustness in Financial Machine Learning: Defenses, Economic Impact, and Governance Evidence14 Dec 2025
- 2025Nearest Neighbor Projection Removal Adversarial Training9 Sep 2025
- 2025Existence of Adversarial Examples for Random Convolutional Networks via Isoperimetric Inequalities on mathbbso(d)14 Jun 2025
- 2025GradEscape: A Gradient-Based Evader Against AI-Generated Text Detectors9 Jun 2025
- 2025Shifting the Paradigm: A Diffeomorphism Between Time Series Data Manifolds for Achieving Shift-Invariancy in Deep Learning27 Feb 2025
- 2025Exact Upper and Lower Bounds for the Output Distribution of Neural Networks with Random Inputs17 Feb 2025
12 newest of 75 All 75 (JSON)