Position: Certified Robustness Does Not (Yet) Imply Model Security
Not on the map. Why?
Abstract (arXiv)
While certified robustness is widely promoted as a solution to adversarial examples in Artificial Intelligence systems, significant challenges remain before these techniques can be meaningfully deployed in real-world applications. We identify critical gaps in current research, including the paradox of detection without distinction, the lack of clear criteria for practitioners to evaluate certification schemes, and the potential security risks arising from users' expectations surrounding ``guaranteed" robustness claims. These create an alignment issue between how certifications are presented and perceived, relative to their actual capabilities. This position paper is a call to arms for the certification research community, proposing concrete steps to address these fundamental challenges and advance the field toward practical applicability.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 59 of its 95 references that are in the map. First posted on arXiv 16 Jun 2025.
Builds on
59 of 95 references.
References · 59
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2013Intriguing properties of neural networkscited by 5,155
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,318
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
- 2016Adversarial Machine Learning at Scalecited by 936
- 2016Practical Black-Box Attacks against Machine Learningcited by 903
- 2015The Limitations of Deep Learning in Adversarial Settingscited by 790
38 more
- 2017Evasion Attacks against Machine Learning at Test Timecited by 689
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 468
- 2018Efficient Neural Network Robustness Certification with General Activation Functionscited by 445
- 2019Provably Robust Deep Learning via Adversarially Trained Smoothed Classifierscited by 330
- 2017MagNet: a Two-Pronged Defense against Adversarial Examplescited by 269
- 2018Adversarial Attacks and Defences: A Surveycited by 259
- 2018Towards Fast Computation of Certified Robustness for ReLU Networkscited by 255
- 2021Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Robustness Verificationcited by 228
- 2018Spatially Transformed Adversarial Examplescited by 195
- 2018Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networkscited by 195
- 2017Formal Guarantees on the Robustness of a Classifier against Adversarial Manipulationcited by 185
- 2018Certified Adversarial Robustness with Additive Noisecited by 180
- 2019Making an Invisibility Cloak: Real World Adversarial Attacks on Object Detectorscited by 155
- 2020Randomized Smoothing of All Shapes and Sizescited by 147
- 2019A Convex Relaxation Barrier to Tight Robustness Verification of Neural Networkscited by 125
- 2020Adversarial Machine Learning -- Industry Perspectivescited by 122
- 2020Certified Defenses for Adversarial Patchescited by 101
- 2020(De)Randomized Smoothing for Certifiable Defense against Patch Attackscited by 98
- 2017Regularization for Deep Learning: A Taxonomycited by 91
- 2018Motivating the Rules of the Game for Adversarial Example Researchcited by 57
- 2019Certified Adversarial Robustness for Deep Reinforcement Learningcited by 47
- 2017MagNet and "Efficient Defenses Against Adversarial Attacks" are Not Robust to Adversarial Examplescited by 46
- 2021Policy Smoothing for Provably Robust Reinforcement Learningcited by 40
- 2022The Third International Verification of Neural Networks Competition (VNN-COMP 2022): Summary and Resultscited by 39
- 2023The Fourth International Verification of Neural Networks Competition (VNN-COMP 2023): Summary and Resultscited by 38
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attackscited by 26
- 2019Implicit Diversity in Image Summarizationcited by 18
- 2018Reinforcement Learning for Autonomous Defence in Software-Defined Networkingcited by 17
- 2023RS-Del: Edit Distance Robustness Certificates for Sequence Classifiers via Randomized Deletioncited by 17
- 2021Towards Evaluating and Training Verifiably Robust Neural Networkscited by 15
- 2022Double Bubble, Toil and Trouble: Enhancing Certified Robustness through Transitivitycited by 15
- 2020Politics of Adversarial Machine Learningcited by 12
- 2018Playing the Game of Universal Adversarial Perturbationscited by 9
- 2020Towards Effective Differential Privacy Communication for Users' Data Sharing Decision and Comprehensioncited by 9
- 2017Differential Privacy on Finite Computerscited by 8
- 2021Are We There Yet? Timing and Floating-Point Attacks on Differential Privacy Systemscited by 8
- 2022Reducing Certified Regression to Certified Classification for General Poisoning Attackscited by 7
- 2022Certified Policy Smoothing for Cooperative Multi-Agent Reinforcement Learningcited by 7
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attackscited by 21
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?cited by 0
- 2026Halt Fast! Early Stopping for Certified Robustnesscited by 0
- 2026An Investigation of the NeurIPS and ICML 2025 Position Trackscited by 0
- 2026An Investigation of the NeurIPS and ICML 2025 Position Tracks6 Jul 2026
- 2026Halt Fast! Early Stopping for Certified Robustness26 Jun 2026
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?11 Mar 2026
- 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks9 Feb 2026