Certified Defenses against Adversarial Examples
Not on the map. Why?
Abstract (arXiv)
While neural networks have achieved high accuracy on standard image classification benchmarks, their accuracy drops to nearly zero in the presence of small adversarial perturbations to test inputs. Defenses based on regularization and adversarial training have been proposed, but often followed by new, stronger attacks that defeat these defenses. Can we somehow end this arms race? In this work, we study this problem for neural networks with one hidden layer. We first propose a method based on a semidefinite relaxation that outputs a certificate that for a given network and test input, no attack can force the error to exceed a certain value. Second, as this certificate is differentiable, we jointly optimize it with the network parameters, providing an adaptive regularizer that encourages robustness against all attacks. On MNIST, our approach produces a network and a certificate that no attack that perturbs each pixel by at most ε = 0.1 can cause more than 35% test error.
Key facts. Cited by 305 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 105; 2022: 63; 2023: 66; 2024: 40; 2025: 14; 2026: 17.
305 papers.
Sort:
By area:
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
- 2021Unsolved Problems in ML Safetycited by 291
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 155
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 118
- 2021Globally-Robust Neural Networkscited by 106
- 2021Orthogonalizing Convolutional Layers with the Cayley Transformcited by 105
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2023Robust Classification via a Single Diffusion Modelcited by 79
38 more
- 2021PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifiercited by 63
- 2021A Dynamical System Perspective for Lipschitz Neural Networkscited by 59
- 2021Meta Gradient Adversarial Attackcited by 55
- 2022Planting Undetectable Backdoors in Machine Learning Modelscited by 55
- 2022Robust Counterfactual Explanations for Tree-Based Ensemblescited by 49
- 2023Direct Parameterization of Lipschitz-Bounded Deep Networkscited by 49
- 2022Rethinking Lipschitz Neural Networks and Certified Robustness: A Boolean Function Perspectivecited by 48
- 2021Boosting Randomized Smoothing with Variance Reduced Classifierscited by 47
- 2021Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Themcited by 46
- 2021Fast Certified Robust Training with Short Warmupcited by 45
- 2021Certified Patch Robustness via Smoothed Vision Transformerscited by 44
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
- 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 43
- 2021A Comprehensive Evaluation Framework for Deep Model Robustnesscited by 41
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 41
- 2021Reachability Analysis of Neural Feedback Loopscited by 41
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 41
- 2021Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neuronscited by 40
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2021CausalAdv: Adversarial Robustness through the Lens of Causalitycited by 37
- 2021Improving the Transferability of Adversarial Examples with Resized-Diverse-Inputs, Diversity-Ensemble and Region Fittingcited by 37
- 2021Adversarial Training Helps Transfer Learning via Better Representationscited by 36
- 2021Scalable Certified Segmentation via Randomized Smoothingcited by 35
- 2021Evading Adversarial Example Detection Defenses with Orthogonal Projected Gradient Descentcited by 34
- 2023Diversifying the High-level Features for better Adversarial Transferabilitycited by 34
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2021A Little Robustness Goes a Long Way: Leveraging Robust Features for Targeted Transfer Attackscited by 33
- 2022Visual Prompting for Adversarial Robustnesscited by 33
- 2022DensePure: Understanding Diffusion Models towards Adversarial Robustnesscited by 33
- 2021Deep Learning-Based Autonomous Driving Systems: A Survey of Attacks and Defensescited by 29
- 2021Learning to Give Checkable Answers with Prover-Verifier Gamescited by 29
- 2021DetectorGuard: Provably Securing Object Detectors against Localized Patch Hiding Attackscited by 28
- 2023Provably Bounding Neural Network Preimagescited by 28
- 2023Adversarial Illusions in Multi-Modal Embeddingscited by 28
- 2021Enhancing Adversarial Robustness via Test-time Transformation Ensemblingcited by 27
- 2023WAT: Improve the Worst-class Robustness in Adversarial Trainingcited by 27
- 2023Towards quantum enhanced adversarial robustness in machine learningcited by 26
- 2021Fooling LiDAR Perception via Adversarial Trajectory Perturbationcited by 25
50 most cited of 305 All 305 (JSON)
- 2026Reliable Virtual Sensing: A Multi-Domain Benchmark for Robustness Under Sensor Failures16 Sep 2026
- 2026Which Directions Matter? Sparse Design for Affine Robust Optimization12 Jun 2026
- 2026Bridging Control with Neural Network Verifier alpha-beta-CROWN: A Tutorial26 May 2026
- 2026A New Framework to Analyse the Distributional Robustness of Deep Neural Networks20 May 2026
- 2026Semantic Smoothing via Novel View Synthesis for Robust SAR Image Classification15 May 2026
- 2026Seed Hijacking of LLM Sampling and Quantum Random Number Defense8 May 2026
- 2026Certified vs. Empirical Adversarial Robust-ness via Hybrid Convolutions with Attention Stochasticity2 May 2026
- 2026A Theoretical Game of Attacks via Compositional Skills1 May 2026
- 2026Dummy-Aware Weighted Attack (DAWA): Breaking the Safe Sink in Dummy Class Defenses31 Mar 2026
- 2026Demystifying Lipschitz verification: positive matrices, negative results30 Mar 2026
- 2026Reward Sharpness-Aware Fine-Tuning for Diffusion Models22 Mar 2026
- 2026Understanding the geometry of deep learning with decision boundary volume16 Mar 2026
38 more
- 2026TorchLean: Formalizing Neural Networks in Lean26 Feb 2026
- 2026Adversarial Robustness of Deep Learning-Based Thyroid Nodule Segmentation in Ultrasound25 Feb 2026
- 2026Robustness Verification of Polynomial Neural Networks5 Feb 2026
- 2026Feature-Space Smoothing: Certified Robustness of Deep Representations22 Jan 2026
- 2026On damage of interpolation to adversarial robustness in regression22 Jan 2026
- 2025CluCERT: Certifying LLM Robustness via Clustering-Guided Denoising Smoothing1 Dec 2025
- 2025Systems Security Foundations for Agentic Computing1 Dec 2025
- 2025Lipschitz-aware Linearity Grafting for Certified Robustness29 Oct 2025
- 2025Towards Strong Certified Defense with Universal Asymmetric Randomization22 Oct 2025
- 2025Adversarial Attacks Leverage Interference Between Features in Superposition13 Oct 2025
- 2025Counterfactual Visual Explanation via Causally-Guided Adversarial Steering14 Jul 2025
- 2025A General Framework for Property-Driven Machine Learning1 May 2025
- 2025A Cryptographic Perspective on Mitigation vs. Detection in Machine Learning28 Apr 2025
- 2025On the Robustness of GUI Grounding Models Against Image Attacks7 Apr 2025
- 2025HiQ-Lip: A Hierarchical Quantum-Classical Method for Global Lipschitz Constant Estimation of ReLU Networks20 Mar 2025
- 2025Pulling Back the Curtain: Unsupervised Adversarial Detection via Contrastive Auxiliary Networks13 Feb 2025
- 2025Robust Representation Consistency Model via Contrastive Denoising22 Jan 2025
- 2025Enhancing Adversarial Transferability via Component-Wise Transformation21 Jan 2025
- 2025Towards Fair Class-wise Robustness: Class Optimal Distribution Adversarial Training8 Jan 2025
- 2024Certified Robustness for Deep Equilibrium Models via Serialized Random Smoothing1 Nov 2024
- 2024ARQ: A Mixed-Precision Quantization Framework for Accurate and Certifiably Robust DNNs31 Oct 2024
- 2024Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems30 Oct 2024
- 2024Towards Calibrated Losses for Adversarial Robust Reject Option Classification14 Oct 2024
- 2024Minimax rates of convergence for nonparametric regression under adversarial attacks12 Oct 2024
- 2024Towards a Law of Iterated Expectations for Heuristic Estimators2 Oct 2024
- 2024A constrained optimization approach to improve robustness of neural networks18 Sep 2024
- 2024Deep Learning at the Intersection: Certified Robustness as a Tool for 3D Vision23 Aug 2024
- 2024Privacy-preserving Universal Adversarial Defense for Black-box Models20 Aug 2024
- 2024Certified Continual Learning for Neural Network Regression9 Jul 2024
- 2024CAPM: Fast and Robust Verification on Maxpool-based CNN via Dual Network27 Jun 2024
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun 2024
- 2024Watch the Watcher! Backdoor Attacks on Security-Enhancing Diffusion Models14 Jun 2024
- 2024Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language Models9 Jun 2024
- 2024Principles of Designing Robust Remote Face Anti-Spoofing Systems6 Jun 2024
- 2024Distributional Adversarial Loss5 Jun 2024
- 2024VQUNet: Vector Quantization U-Net for Defending Adversarial Atacks by Regularizing Unwanted Noise5 Jun 2024
- 2024Certifying Global Robustness for Deep Neural Networks31 May 2024
- 2024Certifying Adapters: Enabling and Enhancing the Certification of Classifier Adversarial Robustness25 May 2024
50 newest of 305 All 305 (JSON)
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
- 2025CluCERT: Certifying LLM Robustness via Clustering-Guided Denoising Smoothingcited by 6
- 2024Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language Modelscited by 2
- 2023Differentially-Private Decision Trees and Provable Robustness to Data Poisoningcited by 1
- 2021A BIC-based Mixture Model Defense against Data Poisoning Attacks on Classifierscited by 0
- 2022HoneyModels: Machine Learning Honeypotscited by 0
- 2026A Theoretical Game of Attacks via Compositional Skillscited by 0
- 2026A Theoretical Game of Attacks via Compositional Skills1 May 2026
- 2025CluCERT: Certifying LLM Robustness via Clustering-Guided Denoising Smoothing1 Dec 2025
- 2024Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language Models9 Jun 2024
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks2 Apr 2024
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct 2023
- 2023Differentially-Private Decision Trees and Provable Robustness to Data Poisoning24 May 2023
- 2022HoneyModels: Machine Learning Honeypots21 Feb 2022
- 2021A BIC-based Mixture Model Defense against Data Poisoning Attacks on Classifiers28 May 2021
- 2023Robust Classification via a Single Diffusion Modelcited by 79
- 2022DensePure: Understanding Diffusion Models towards Adversarial Robustnesscited by 33
- 2023DiffSmooth: Certifiably Robust Learning via Diffusion Models and Local Smoothingcited by 20
- 2024Watch the Watcher! Backdoor Attacks on Security-Enhancing Diffusion Modelscited by 4
- 2026Reward Sharpness-Aware Fine-Tuning for Diffusion Modelscited by 2
- 2024Adversarial Examples are Misaligned in Diffusion Model Manifoldscited by 1
- 2025Robust Representation Consistency Model via Contrastive Denoisingcited by 1
- 2026Reward Sharpness-Aware Fine-Tuning for Diffusion Models22 Mar 2026
- 2025Robust Representation Consistency Model via Contrastive Denoising22 Jan 2025
- 2024Watch the Watcher! Backdoor Attacks on Security-Enhancing Diffusion Models14 Jun 2024
- 2024Adversarial Examples are Misaligned in Diffusion Model Manifolds12 Jan 2024
- 2023DiffSmooth: Certifiably Robust Learning via Diffusion Models and Local Smoothing28 Aug 2023
- 2023Robust Classification via a Single Diffusion Model24 May 2023
- 2022DensePure: Understanding Diffusion Models towards Adversarial Robustness1 Nov 2022
- 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 118
- 2025Systems Security Foundations for Agentic Computingcited by 9
- 2025Systems Security Foundations for Agentic Computing1 Dec 2025
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun 2024
- 2023Efficient Symbolic Reasoning for Neural-Network Verification23 Mar 2023
- 2021Unsolved Problems in ML Safetycited by 291
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 155
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Globally-Robust Neural Networkscited by 106
- 2021Orthogonalizing Convolutional Layers with the Cayley Transformcited by 105
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifiercited by 63
- 2021A Dynamical System Perspective for Lipschitz Neural Networkscited by 59
- 2021Meta Gradient Adversarial Attackcited by 55
- 2022Planting Undetectable Backdoors in Machine Learning Modelscited by 55
12 most cited of 286 All 286 (JSON)
- 2026Reliable Virtual Sensing: A Multi-Domain Benchmark for Robustness Under Sensor Failures16 Sep 2026
- 2026Which Directions Matter? Sparse Design for Affine Robust Optimization12 Jun 2026
- 2026Bridging Control with Neural Network Verifier alpha-beta-CROWN: A Tutorial26 May 2026
- 2026A New Framework to Analyse the Distributional Robustness of Deep Neural Networks20 May 2026
- 2026Semantic Smoothing via Novel View Synthesis for Robust SAR Image Classification15 May 2026
- 2026Seed Hijacking of LLM Sampling and Quantum Random Number Defense8 May 2026
- 2026Certified vs. Empirical Adversarial Robust-ness via Hybrid Convolutions with Attention Stochasticity2 May 2026
- 2026Dummy-Aware Weighted Attack (DAWA): Breaking the Safe Sink in Dummy Class Defenses31 Mar 2026
- 2026Demystifying Lipschitz verification: positive matrices, negative results30 Mar 2026
- 2026Understanding the geometry of deep learning with decision boundary volume16 Mar 2026
- 2026TorchLean: Formalizing Neural Networks in Lean26 Feb 2026
- 2026Adversarial Robustness of Deep Learning-Based Thyroid Nodule Segmentation in Ultrasound25 Feb 2026
12 newest of 286 All 286 (JSON)