Randomization matters. How to defend against strong adversarial attacks
Not on the map. Why?
Abstract (arXiv)
Is there a classifier that ensures optimal robustness against all adversarial attacks? This paper answers this question by adopting a game-theoretic point of view. We show that adversarial attacks and defenses form an infinite zero-sum game where classical results (e.g. Sion theorem) do not apply. We demonstrate the non-existence of a Nash equilibrium in our game when the classifier and the Adversary are both deterministic, hence giving a negative answer to the above question in the deterministic regime. Nonetheless, the question remains open in the randomized regime. We tackle this problem by showing that, undermild conditions on the dataset distribution, any deterministic classifier can be outperformed by a randomized one. This gives arguments for using randomization, and leads us to a new algorithm for building randomized classifiers that are robust to strong adversarial attacks. Empirical results validate our theoretical analysis, and show that our defense method considerably outperforms Adversarial Training against state-of-the-art attacks.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 10; 2023: 9; 2024: 4; 2025: 5; 2026: 1.
37 papers.
Sort:
By area:
- 2022Diffusion Models for Adversarial Purificationcited by 476
- 2021Adversarial purification with Score-based generative modelscited by 134
- 2023How Does Information Bottleneck Help Deep Learning?cited by 93
- 2021A Dynamical System Perspective for Lipschitz Neural Networkscited by 60
- 2021Attacking Adversarial Attacks as A Defensecited by 32
- 2022The Many Faces of Adversarial Riskcited by 28
- 2021Mixed Nash Equilibria in the Adversarial Examples Gamecited by 22
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspectivecited by 18
- 2023The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attackscited by 15
- 2022Towards Consistency in Adversarial Classificationcited by 12
- 2023Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attackscited by 12
- 2022Building Robust Ensembles via Margin Boostingcited by 8
25 more
- 2022Nash Equilibria and Pitfalls of Adversarial Training in Adversarial Robustness Gamescited by 8
- 2021The art of defense: letting networks fool the attackercited by 6
- 2022Game Theoretic Mixed Experts for Combinational Adversarial Machine Learningcited by 6
- 2025Adversarial Training for Defense Against Label Poisoning Attackscited by 6
- 2022Adversarial Vulnerability of Randomized Ensemblescited by 5
- 2023On the Role of Randomization in Adversarially Robust Classificationcited by 4
- 2025Strategic Classification with Randomised Classifierscited by 4
- 2021When Should You Defend Your Classifier -- A Game-theoretical Analysis of Countermeasures against Adversarial Examplescited by 3
- 2023On the Robustness of Randomized Ensembles to Adversarial Perturbationscited by 3
- 2022Towards Evading the Limits of Randomized Smoothing: A Theoretical Analysiscited by 2
- 2022Metric-Fair Classifier Derandomizationcited by 2
- 2023Do we need entire training data for adversarial training?cited by 1
- 2023Adversarial attacks for mixtures of classifierscited by 1
- 2024Position: Towards Resilience Against Adversarial Examplescited by 1
- 2024Understanding Byzantine Robustness in Federated Learning with A Black-box Servercited by 1
- 2021Robustifying ℓ_∞ Adversarial Training to the Union of Perturbation Modelscited by 0
- 2021Scalable Optimal Classifiers for Adversarial Settings under Uncertaintycited by 0
- 2022Achieve Optimal Adversarial Accuracy for Adversarial Deep Learning using Stackelberg Gamecited by 0
- 2023Towards Optimal Randomized Strategies in Adversarial Example Gamecited by 0
- 2024LightPure: Realtime Adversarial Image Purification for Mobile Devices Using Diffusion Modelscited by 0
- 2024Adversarial Detection with a Dynamically Stable Systemcited by 0
- 2025Unveiling the Role of Randomization in Multiclass Adversarial Classification: Insights from Graph Theorycited by 0
- 2025Towards provable probabilistic safety for scalable embodied AI systemscited by 0
- 2025Lattice Climber Attack: Adversarial attacks for randomized mixtures of classifierscited by 0
- 2026Statistical Inference for Adversarial Training: Central Limit Theorems via Optimal Transportcited by 0
- 2026Statistical Inference for Adversarial Training: Central Limit Theorems via Optimal Transport4 Sep 2026
- 2025Lattice Climber Attack: Adversarial attacks for randomized mixtures of classifiers12 Jun 2025
- 2025Towards provable probabilistic safety for scalable embodied AI systems5 Jun 2025
- 2025Unveiling the Role of Randomization in Multiclass Adversarial Classification: Insights from Graph Theory18 Mar 2025
- 2025Adversarial Training for Defense Against Label Poisoning Attacks24 Feb 2025
- 2025Strategic Classification with Randomised Classifiers3 Feb 2025
- 2024Adversarial Detection with a Dynamically Stable System11 Nov 2024
- 2024LightPure: Realtime Adversarial Image Purification for Mobile Devices Using Diffusion Models31 Aug 2024
- 2024Understanding Byzantine Robustness in Federated Learning with A Black-box Server12 Aug 2024
- 2024Position: Towards Resilience Against Adversarial Examples2 May 2024
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspective30 Oct 2023
- 2023Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attacks24 Sep 2023
25 more
- 2023Adversarial attacks for mixtures of classifiers20 Jul 2023
- 2023Towards Optimal Randomized Strategies in Adversarial Example Game29 Jun 2023
- 2023How Does Information Bottleneck Help Deep Learning?30 May 2023
- 2023The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attacks23 May 2023
- 2023Do we need entire training data for adversarial training?10 Mar 2023
- 2023On the Role of Randomization in Adversarially Robust Classification14 Feb 2023
- 2023On the Robustness of Randomized Ensembles to Adversarial Perturbations2 Feb 2023
- 2022Game Theoretic Mixed Experts for Combinational Adversarial Machine Learning26 Nov 2022
- 2022Nash Equilibria and Pitfalls of Adversarial Training in Adversarial Robustness Games23 Oct 2022
- 2022Achieve Optimal Adversarial Accuracy for Adversarial Deep Learning using Stackelberg Game17 Jul 2022
- 2022Metric-Fair Classifier Derandomization15 Jun 2022
- 2022Adversarial Vulnerability of Randomized Ensembles14 Jun 2022
- 2022Building Robust Ensembles via Margin Boosting7 Jun 2022
- 2022Towards Evading the Limits of Randomized Smoothing: A Theoretical Analysis3 Jun 2022
- 2022Towards Consistency in Adversarial Classification20 May 2022
- 2022Diffusion Models for Adversarial Purification16 May 2022
- 2022The Many Faces of Adversarial Risk22 Jan 2022
- 2021A Dynamical System Perspective for Lipschitz Neural Networks25 Oct 2021
- 2021When Should You Defend Your Classifier -- A Game-theoretical Analysis of Countermeasures against Adversarial Examples17 Aug 2021
- 2021Scalable Optimal Classifiers for Adversarial Settings under Uncertainty28 Jun 2021
- 2021Adversarial purification with Score-based generative models11 Jun 2021
- 2021Attacking Adversarial Attacks as A Defense9 Jun 2021
- 2021Robustifying ℓ_∞ Adversarial Training to the Union of Perturbation Models31 May 2021
- 2021The art of defense: letting networks fool the attacker7 Apr 2021
- 2021Mixed Nash Equilibria in the Adversarial Examples Game13 Feb 2021
- 2023How Does Information Bottleneck Help Deep Learning?cited by 93
- 2021A Dynamical System Perspective for Lipschitz Neural Networkscited by 60
- 2021Attacking Adversarial Attacks as A Defensecited by 32
- 2022The Many Faces of Adversarial Riskcited by 28
- 2021Mixed Nash Equilibria in the Adversarial Examples Gamecited by 22
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspectivecited by 18
- 2023The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attackscited by 15
- 2022Towards Consistency in Adversarial Classificationcited by 12
- 2023Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attackscited by 12
- 2022Building Robust Ensembles via Margin Boostingcited by 8
- 2022Nash Equilibria and Pitfalls of Adversarial Training in Adversarial Robustness Gamescited by 8
- 2021The art of defense: letting networks fool the attackercited by 6
12 most cited of 34 All 34 (JSON)
- 2026Statistical Inference for Adversarial Training: Central Limit Theorems via Optimal Transport4 Sep 2026
- 2025Lattice Climber Attack: Adversarial attacks for randomized mixtures of classifiers12 Jun 2025
- 2025Towards provable probabilistic safety for scalable embodied AI systems5 Jun 2025
- 2025Unveiling the Role of Randomization in Multiclass Adversarial Classification: Insights from Graph Theory18 Mar 2025
- 2025Adversarial Training for Defense Against Label Poisoning Attacks24 Feb 2025
- 2025Strategic Classification with Randomised Classifiers3 Feb 2025
- 2024Adversarial Detection with a Dynamically Stable System11 Nov 2024
- 2024Understanding Byzantine Robustness in Federated Learning with A Black-box Server12 Aug 2024
- 2024Position: Towards Resilience Against Adversarial Examples2 May 2024
- 2023Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspective30 Oct 2023
- 2023Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attacks24 Sep 2023
- 2023Adversarial attacks for mixtures of classifiers20 Jul 2023
12 newest of 34 All 34 (JSON)