The Many Faces of Adversarial Risk
Not on the map. Why?
Abstract (arXiv)
Adversarial risk quantifies the performance of classifiers on adversarially perturbed data. Numerous definitions of adversarial risk -- not all mathematically rigorous and differing subtly in the details -- have appeared in the literature. In this paper, we revisit these definitions, make them rigorous, and critically examine their similarities and differences. Our technical tools derive from optimal transport, robust statistics, functional analysis, and game theory. Our contributions include the following: generalizing Strassen's theorem to the unbalanced optimal transport setting with applications to adversarial classification with unequal priors; showing an equivalence between adversarial robustness and robust hypothesis testing with ∞-Wasserstein uncertainty sets; proving the existence of a pure Nash equilibrium in the two-player game between the adversary and the algorithm; and characterizing adversarial risk by the minimum Bayes error between a pair of distributions belonging to the ∞-Wasserstein uncertainty sets. Our results generalize and deepen recently discovered connections between optimal transport and adversarial robustness and reveal new connections to Choquet capacities and game theory.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 32 of its 63 references that are in the map. First posted on arXiv 22 Jan 2022.
Builds on
32 of 63 references.
References · 32
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 401
- 2017Certifying Some Distributional Robustness with Principled Adversarial Trainingcited by 333
- 2018Adversarial Risk and the Dangers of Evaluating Against Weak Attackscited by 221
- 2019Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systemscited by 151
- 2019Lower Bounds on Adversarial Robustness from Optimal Transportcited by 52
- 2018The Curse of Concentration in Robust Learning: Evasion and Poisoning Attacks from Concentration of Measurecited by 44
20 more
- 2020Randomization matters. How to defend against strong adversarial attackscited by 37
- 2019Adversarial Risk via Optimal Transport and Optimal Couplingscited by 36
- 2017The Robust Manifold Defense: Adversarial Training using Generative Modelscited by 35
- 2020Adversarial Example Gamescited by 34
- 2018Adversarial Risk and Robustness: General Definitions and Implications for the Uniform Distributioncited by 32
- 2018Theoretical Analysis of Adversarial Learning: A Minimax Approachcited by 31
- 2020Learn2Perturb: an End-to-end Feature Perturbation Learning to Improve Adversarial Robustnesscited by 27
- 2019On the Hardness of Robust Classificationcited by 23
- 2020On Linear Optimization over Wasserstein Ballscited by 23
- 2021Mixed Nash Equilibria in the Adversarial Examples Gamecited by 22
- 2020Adversarial Classification: Necessary conditions and geometric flowscited by 19
- 2018Learning to Defend by Learning to Attackcited by 17
- 2020When are Non-Parametric Methods Robust?cited by 15
- 2016Randomized Prediction Games for Adversarial Machine Learningcited by 11
- 2018Revisiting Adversarial Riskcited by 9
- 2018Law and Adversarial Machine Learningcited by 5
- 2017Asymptotic Coupling and Its Applications in Information Theorycited by 4
- 2019Robustifying deep networks for image segmentationcited by 2
- 2020Classifier-independent Lower-Bounds for Adversarial Robustnesscited by 1
- 2021Robustness-via-Synthesis: Robust Training with Generative Adversarial Perturbationscited by 1
Built on by
Citing papers per year: 2022: 6; 2023: 10; 2024: 6; 2025: 4; 2026: 2.
28 papers.
Sort:
- 2022The Multimarginal Optimal Transport Formulation of Adversarial Multiclass Classificationcited by 21
- 2022Existence and Minimax Theorems for Adversarial Surrogate Risks in Binary Classificationcited by 15
- 2022Towards Consistency in Adversarial Classificationcited by 12
- 2022Gamma-convergence of a nonlocal perimeter arising in adversarial machine learningcited by 10
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustnesscited by 9
- 2023On the existence of solutions to adversarial training in multiclass classificationcited by 9
- 2023Characterizing the Optimal 0-1 Loss for Multi-class Classification with a Test-time Attackercited by 6
- 2023The Adversarial Consistency of Surrogate Risks for Binary Classificationcited by 6
- 2023On adversarial robustness and the use of Wasserstein ascent-descent dynamics to enforce itcited by 4
- 2023On the Role of Randomization in Adversarially Robust Classificationcited by 4
- 2024A mean curvature flow arising in adversarial trainingcited by 4
- 2025Adversarial Attacks against Neural Ranking Models via In-Context Learningcited by 4
16 more
- 2022The Consistency of Adversarial Training for Binary Classificationcited by 3
- 2023It begins with a boundary: A geometric view on probabilistically robust learningcited by 3
- 2024A Notion of Uniqueness for the Adversarial Bayes Classifiercited by 3
- 2023On the Hardness of Robustness Transfer: A Perspective from Rademacher Complexity over Symmetric Difference Hypothesis Spacecited by 2
- 2023Non-Asymptotic Bounds for Adversarial Excess Risk under Misspecified Modelscited by 2
- 2024Adversarial Consistency and the Uniqueness of the Adversarial Bayes Classifiercited by 2
- 2022When are Local Queries Useful for Robust Learning?cited by 1
- 2023Selecting Models based on the Risk of Damage Caused by Adversarial Attackscited by 1
- 2024Position: Towards Resilience Against Adversarial Examplescited by 1
- 2024Uniform Convergence of Adversarially Robust Classifierscited by 1
- 2025Adversarial Surrogate Risk Bounds for Binary Classificationcited by 1
- 2025Lower Bounds on Adversarial Robustness for Multiclass Classification with General Loss Functionscited by 1
- 2024Distributionally and Adversarially Robust Logistic Regression via Intersecting Wasserstein Ballscited by 0
- 2025Unveiling the Role of Randomization in Multiclass Adversarial Classification: Insights from Graph Theorycited by 0
- 2026Statistical Inference for Adversarial Training: Central Limit Theorems via Optimal Transportcited by 0
- 2026Distributionally robust linear regression through the lens of adversarial trainingcited by 0
- 2026Distributionally robust linear regression through the lens of adversarial training30 Sep 2026
- 2026Statistical Inference for Adversarial Training: Central Limit Theorems via Optimal Transport4 Sep 2026
- 2025Lower Bounds on Adversarial Robustness for Multiclass Classification with General Loss Functions2 Oct 2025
- 2025Adversarial Attacks against Neural Ranking Models via In-Context Learning21 Aug 2025
- 2025Adversarial Surrogate Risk Bounds for Binary Classification11 Jun 2025
- 2025Unveiling the Role of Randomization in Multiclass Adversarial Classification: Insights from Graph Theory18 Mar 2025
- 2024Distributionally and Adversarially Robust Logistic Regression via Intersecting Wasserstein Balls18 Jul 2024
- 2024Uniform Convergence of Adversarially Robust Classifiers20 Jun 2024
- 2024Position: Towards Resilience Against Adversarial Examples2 May 2024
- 2024Adversarial Consistency and the Uniqueness of the Adversarial Bayes Classifier26 Apr 2024
- 2024A Notion of Uniqueness for the Adversarial Bayes Classifier25 Apr 2024
- 2024A mean curvature flow arising in adversarial training22 Apr 2024
16 more
- 2023Non-Asymptotic Bounds for Adversarial Excess Risk under Misspecified Models2 Sep 2023
- 2023It begins with a boundary: A geometric view on probabilistically robust learning30 May 2023
- 2023The Adversarial Consistency of Surrogate Risks for Binary Classification17 May 2023
- 2023On the existence of solutions to adversarial training in multiclass classification28 Apr 2023
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustness17 Mar 2023
- 2023On the Hardness of Robustness Transfer: A Perspective from Rademacher Complexity over Symmetric Difference Hypothesis Space23 Feb 2023
- 2023Characterizing the Optimal 0-1 Loss for Multi-class Classification with a Test-time Attacker21 Feb 2023
- 2023On the Role of Randomization in Adversarially Robust Classification14 Feb 2023
- 2023Selecting Models based on the Risk of Damage Caused by Adversarial Attacks28 Jan 2023
- 2023On adversarial robustness and the use of Wasserstein ascent-descent dynamics to enforce it9 Jan 2023
- 2022Gamma-convergence of a nonlocal perimeter arising in adversarial machine learning28 Nov 2022
- 2022When are Local Queries Useful for Robust Learning?12 Oct 2022
- 2022The Consistency of Adversarial Training for Binary Classification18 Jun 2022
- 2022Existence and Minimax Theorems for Adversarial Surrogate Risks in Binary Classification18 Jun 2022
- 2022Towards Consistency in Adversarial Classification20 May 2022
- 2022The Multimarginal Optimal Transport Formulation of Adversarial Multiclass Classification27 Apr 2022
- 2022The Multimarginal Optimal Transport Formulation of Adversarial Multiclass Classificationcited by 21
- 2022Existence and Minimax Theorems for Adversarial Surrogate Risks in Binary Classificationcited by 15
- 2022Towards Consistency in Adversarial Classificationcited by 12
- 2022Gamma-convergence of a nonlocal perimeter arising in adversarial machine learningcited by 10
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustnesscited by 9
- 2023On the existence of solutions to adversarial training in multiclass classificationcited by 9
- 2023Characterizing the Optimal 0-1 Loss for Multi-class Classification with a Test-time Attackercited by 6
- 2023The Adversarial Consistency of Surrogate Risks for Binary Classificationcited by 6
- 2023On adversarial robustness and the use of Wasserstein ascent-descent dynamics to enforce itcited by 4
- 2023On the Role of Randomization in Adversarially Robust Classificationcited by 4
- 2024A mean curvature flow arising in adversarial trainingcited by 4
- 2025Adversarial Attacks against Neural Ranking Models via In-Context Learningcited by 4
12 most cited of 28 All 28 (JSON)
- 2026Distributionally robust linear regression through the lens of adversarial training30 Sep 2026
- 2026Statistical Inference for Adversarial Training: Central Limit Theorems via Optimal Transport4 Sep 2026
- 2025Lower Bounds on Adversarial Robustness for Multiclass Classification with General Loss Functions2 Oct 2025
- 2025Adversarial Attacks against Neural Ranking Models via In-Context Learning21 Aug 2025
- 2025Adversarial Surrogate Risk Bounds for Binary Classification11 Jun 2025
- 2025Unveiling the Role of Randomization in Multiclass Adversarial Classification: Insights from Graph Theory18 Mar 2025
- 2024Distributionally and Adversarially Robust Logistic Regression via Intersecting Wasserstein Balls18 Jul 2024
- 2024Uniform Convergence of Adversarially Robust Classifiers20 Jun 2024
- 2024Position: Towards Resilience Against Adversarial Examples2 May 2024
- 2024Adversarial Consistency and the Uniqueness of the Adversarial Bayes Classifier26 Apr 2024
- 2024A Notion of Uniqueness for the Adversarial Bayes Classifier25 Apr 2024
- 2024A mean curvature flow arising in adversarial training22 Apr 2024
12 newest of 28 All 28 (JSON)