Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
Not on the map. Why?
Abstract (arXiv)
Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to ℓ2-norm adversarial perturbations. In this paper, we employ adversarial training to improve the performance of randomized smoothing. We design an adapted attack for smoothed classifiers, and we show how this attack can be used in an adversarial training setting to boost the provable robustness of smoothed classifiers. We demonstrate through extensive experimentation that our method consistently outperforms all existing provably ℓ2-robust classifiers by a significant margin on ImageNet and CIFAR-10, establishing the state-of-the-art for provable ℓ2-defenses. Moreover, we find that pre-training and semi-supervised learning boost adversarially trained smoothed classifiers even further. Our code and trained models are available at http://github.com/Hadisalman/smoothing-adversarial .
Key facts. Cited by 328 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 74; 2022: 71; 2023: 59; 2024: 60; 2025: 32; 2026: 32.
328 papers.
Sort:
By area:
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
- 2021Robust fine-tuning of zero-shot modelscited by 785
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
- 2023Certifying LLM Safety against Adversarial Promptingcited by 248
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 155
- 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attackscited by 150
- 2021Adversarial purification with Score-based generative modelscited by 132
- 2022(Certified!!) Adversarial Robustness for Free!cited by 130
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?cited by 113
- 2021Globally-Robust Neural Networkscited by 106
- 2021PRIMA: General and Precise Neural Network Certification via Scalable Convex Hull Approximationscited by 77
- 2021Revisiting and Advancing Fast Adversarial Training Through The Lens of Bi-Level Optimizationcited by 75
38 more
- 2021FuseDream: Training-Free Text-to-Image Generation with Improved CLIP+GAN Space Optimizationcited by 71
- 2024Defending Large Language Models against Jailbreak Attacks via Semantic Smoothingcited by 68
- 2021Skew Orthogonal Convolutionscited by 67
- 2021Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Boundscited by 64
- 2021PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifiercited by 63
- 2021A Dynamical System Perspective for Lipschitz Neural Networkscited by 59
- 2023A Unified Algebraic Perspective on Lipschitz Neural Networkscited by 58
- 2022Planting Undetectable Backdoors in Machine Learning Modelscited by 55
- 2021Boosting Adversarial Transferability through Enhanced Momentumcited by 53
- 2022Certified Training: Small Boxes are All You Needcited by 51
- 2021PointGuard: Provably Robust 3D Point Cloud Classificationcited by 49
- 2021SmoothMix: Training Confidence-calibrated Smoothed Classifiers for Certified Robustnesscited by 49
- 2022Rethinking Lipschitz Neural Networks and Certified Robustness: A Boolean Function Perspectivecited by 48
- 2021Boosting Randomized Smoothing with Variance Reduced Classifierscited by 47
- 2021Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100cited by 47
- 2021Random Noise Defense Against Query-Based Black-Box Attackscited by 46
- 2021Fast Certified Robust Training with Short Warmupcited by 45
- 2021Certified Patch Robustness via Smoothed Vision Transformerscited by 44
- 2021Constrained Learning with Non-Convex Lossescited by 42
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 41
- 2021Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neuronscited by 40
- 2021On the Certified Robustness for Ensemble Models and Beyondcited by 40
- 2021Improved, Deterministic Smoothing for L_1 Certified Robustnesscited by 39
- 2021Policy Smoothing for Provably Robust Reinforcement Learningcited by 39
- 2021Adversarial Robustness with Semi-Infinite Constrained Learningcited by 39
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2021Scalable Certified Segmentation via Randomized Smoothingcited by 35
- 2022DensePure: Understanding Diffusion Models towards Adversarial Robustnesscited by 33
- 2024Understanding and Improving Training-free Loss-based Diffusion Guidancecited by 31
- 2021DetectorGuard: Provably Securing Object Detectors against Localized Patch Hiding Attackscited by 28
- 2022Benchmarking Adversarially Robust Quantum Machine Learning at Scalecited by 28
- 2021Enhancing Adversarial Robustness via Test-time Transformation Ensemblingcited by 27
- 2024Provably Robust Conformal Prediction with Improved Efficiencycited by 27
- 2023Towards quantum enhanced adversarial robustness in machine learningcited by 26
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attackscited by 25
- 2022Explicit Regularization in Overparametrized Models via Noise Injectioncited by 25
- 2023Probabilistically robust conformal predictioncited by 25
- 2021Adversarially Robust Learning with Unknown Perturbation Setscited by 24
50 most cited of 328 All 328 (JSON)
- 2026Psychoacoustically Aligned Latent Smoothing for Adversarial Robustness of Full-Duplex Speech-to-Speech Dialogue Models23 Sep 2026
- 2026Clustered Randomized Smoothing for Stochastic Prediction Functions12 Aug 2026
- 2026Traffic-Aware Randomized Smoothing for LLM-Based Network Intrusion Detection15 Jul 2026
- 2026Fast SDP certification of neural networks : towards large multi-class datasets3 Jul 2026
- 2026Halt Fast! Early Stopping for Certified Robustness26 Jun 2026
- 2026Online Shift Detection and Conformal Adaptation for Deployed Safety Classifiers10 Jun 2026
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustness5 Jun 2026
- 2026Representation Matters in Randomized Smoothing for Audio Classification2 Jun 2026
- 2026RRISE: Robust Radius Inference via a Surrogate Estimator1 Jun 2026
- 2026CEAR: Certified Ensemble Adversarial Robustness in DNNs31 May 2026
- 2026Cert-LAS: Toward Certified Model Ownership Verification for Text-to-Image Diffusion Models via Layer-Adaptive Smoothing28 May 2026
- 2026Certified Robustness from Approximate Gaussian Mixture Structures in Pretrained Latent Spaces25 May 2026
38 more
- 2026Provable Robustness against Backdoor Attacks via the Primal-Dual Perspective on Differential Privacy20 May 2026
- 2026Certified Robustness under Heterogeneous Perturbations via Hybrid Randomized Smoothing13 May 2026
- 2026Fortifying Time Series: DTW-Certified Robust Anomaly Detection8 May 2026
- 2026A Robust Out-of-Distribution Detection Framework via Synergistic Smoothing5 May 2026
- 2026Certified vs. Empirical Adversarial Robust-ness via Hybrid Convolutions with Attention Stochasticity2 May 2026
- 2026Embodied Interpretability: Linking Causal Understanding to Generalization in Vision-Language-Action Models1 May 2026
- 2026Laplace-Bridged Randomized Smoothing for Fast Certified Robustness27 Apr 2026
- 2026GF-Score: Certified Class-Conditional Robustness Evaluation with Fairness Guarantees14 Apr 2026
- 2026Safety, Security, and Cognitive Risks in World Models1 Apr 2026
- 2026PDA: Text-Augmented Defense Framework for Robust Vision-Language Models against Adversarial Image Attacks1 Apr 2026
- 2026Dummy-Aware Weighted Attack (DAWA): Breaking the Safe Sink in Dummy Class Defenses31 Mar 2026
- 2026Reward Sharpness-Aware Fine-Tuning for Diffusion Models22 Mar 2026
- 2026Adaptive Layerwise Perturbation: Unifying Off-Policy Corrections for LLM RL19 Mar 2026
- 2026Evaluating randomized smoothing as a defense against adversarial attacks in trajectory prediction11 Mar 2026
- 2026RobPI: Robust Private Inference against Malicious Client23 Feb 2026
- 2026LipNeXt: Scaling up Lipschitz-based Certified Robustness to Billion-parameter Models26 Jan 2026
- 2026Feature-Space Smoothing: Certified Robustness of Deep Representations22 Jan 2026
- 2026How Worst-Case Are Adversarial Attacks? Linking Adversarial and Perturbation Robustness20 Jan 2026
- 2026On the Extreme Variance of Certified Local Robustness Across Model Seeds19 Jan 2026
- 2026Auditing Fairness under Model Updates: Fundamental Complexity and Property-Preserving Updates9 Jan 2026
- 2025Fast and Flexible Robustness Certificates for Semantic Segmentation3 Dec 2025
- 2025Dual Randomized Smoothing: Beyond Global Noise Variance1 Dec 2025
- 2025Towards Strong Certified Defense with Universal Asymmetric Randomization22 Oct 2025
- 2025When Flatness Does (Not) Guarantee Adversarial Robustness16 Oct 2025
- 2025Tight Robustness Certificates and Wasserstein Distributional Attacks for Deep Neural Networks11 Oct 2025
- 2025Reconcile Certified Robustness and Accuracy for DNN-based Smoothed Majority Vote Classifier30 Sep 2025
- 2025DRIFT: Divergent Response in Filtered Transformations for Robust Adversarial Defense29 Sep 2025
- 2025Randomized Smoothing Meets Vision-Language Models19 Sep 2025
- 2025Sy-FAR: Symmetry-based Fair Adversarial Robustness16 Sep 2025
- 2025Robustifying Diffusion-Denoised Smoothing Against Covariate Shift13 Sep 2025
- 2025Get Global Guarantees: On the Probabilistic Nature of Perturbation Robustness26 Aug 2025
- 2025The Cost of Compression: Tight Quadratic Black-Box Attacks on Sketches for ℓ2 Norm Estimation22 Jul 2025
- 2025One Sample is Enough to Make Conformal Prediction Robust19 Jun 2025
- 2025Position: Certified Robustness Does Not (Yet) Imply Model Security16 Jun 2025
- 2025Efficient Robust Conformal Prediction via Lipschitz-Bounded Networks5 Jun 2025
- 2025Towards Better Generalization via Distributional Input Projection Network5 Jun 2025
- 2025Multi-level Certified Defense Against Poisoning Attacks in Offline Reinforcement Learning27 May 2025
- 2025Provably Robust Training of Quantum Circuit Classifiers Against Parameter Noise24 May 2025
50 newest of 328 All 328 (JSON)
- 2021Adversarial purification with Score-based generative modelscited by 132
- 2022(Certified!!) Adversarial Robustness for Free!cited by 130
- 2022DensePure: Understanding Diffusion Models towards Adversarial Robustnesscited by 33
- 2024Understanding and Improving Training-free Loss-based Diffusion Guidancecited by 31
- 2024Your Diffusion Model is Secretly a Certifiably Robust Classifiercited by 24
- 2023DiffSmooth: Certifiably Robust Learning via Diffusion Models and Local Smoothingcited by 20
- 2023Multi-scale Diffusion Denoised Smoothingcited by 9
- 2024Referee Can Play: An Alternative Approach to Conditional Generation via Model Inversioncited by 4
- 2024Adversarial Robustification via Text-to-Image Diffusion Modelscited by 3
- 2026Cert-LAS: Toward Certified Model Ownership Verification for Text-to-Image Diffusion Models via Layer-Adaptive Smoothingcited by 3
- 2023Towards Better Certified Segmentation via Diffusion Modelscited by 2
- 2024Consistency Purification: Effective and Efficient Diffusion Purification towards Certified Robustnesscited by 2
12 most cited of 15 All 15 (JSON)
- 2026Cert-LAS: Toward Certified Model Ownership Verification for Text-to-Image Diffusion Models via Layer-Adaptive Smoothing28 May 2026
- 2026Reward Sharpness-Aware Fine-Tuning for Diffusion Models22 Mar 2026
- 2025Robustifying Diffusion-Denoised Smoothing Against Covariate Shift13 Sep 2025
- 2025Robust Representation Consistency Model via Contrastive Denoising22 Jan 2025
- 2024Adversarial Robustification via Text-to-Image Diffusion Models26 Jul 2024
- 2024Consistency Purification: Effective and Efficient Diffusion Purification towards Certified Robustness30 Jun 2024
- 2024Understanding and Improving Training-free Loss-based Diffusion Guidance19 Mar 2024
- 2024Referee Can Play: An Alternative Approach to Conditional Generation via Model Inversion26 Feb 2024
- 2024Your Diffusion Model is Secretly a Certifiably Robust Classifier4 Feb 2024
- 2023Multi-scale Diffusion Denoised Smoothing25 Oct 2023
- 2023DiffSmooth: Certifiably Robust Learning via Diffusion Models and Local Smoothing28 Aug 2023
- 2023Towards Better Certified Segmentation via Diffusion Models16 Jun 2023
12 newest of 15 All 15 (JSON)
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
- 2023Certifying LLM Safety against Adversarial Promptingcited by 248
- 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attackscited by 150
- 2025Smoothed Embeddings for Robust Language Modelscited by 8
- 2024RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guaranteescited by 7
- 2025Improving LLM Unlearning Robustness via Random Perturbationscited by 6
- 2022Pre-trained Encoders in Self-Supervised Learning Improve Secure and Privacy-preserving Supervised Learningcited by 4
- 2025AMUN: Adversarial Machine UNlearningcited by 2
- 2026Psychoacoustically Aligned Latent Smoothing for Adversarial Robustness of Full-Duplex Speech-to-Speech Dialogue Modelscited by 0
- 2026Psychoacoustically Aligned Latent Smoothing for Adversarial Robustness of Full-Duplex Speech-to-Speech Dialogue Models23 Sep 2026
- 2025AMUN: Adversarial Machine UNlearning2 Mar 2025
- 2025Improving LLM Unlearning Robustness via Random Perturbations31 Jan 2025
- 2025Smoothed Embeddings for Robust Language Models27 Jan 2025
- 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks30 Jan 2024
- 2024RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guarantees23 Jan 2024
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct 2023
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct 2023
- 2023Certifying LLM Safety against Adversarial Prompting6 Sep 2023
- 2022Pre-trained Encoders in Self-Supervised Learning Improve Secure and Privacy-preserving Supervised Learning6 Dec 2022
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2023Fast Certification of Vision-Language Models Using Incremental Randomized Smoothingcited by 4
- 2025Randomized Smoothing Meets Vision-Language Modelscited by 1
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustnesscited by 1
- 2026PDA: Text-Augmented Defense Framework for Robust Vision-Language Models against Adversarial Image Attackscited by 0
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustness5 Jun 2026
- 2026PDA: Text-Augmented Defense Framework for Robust Vision-Language Models against Adversarial Image Attacks1 Apr 2026
- 2025Randomized Smoothing Meets Vision-Language Models19 Sep 2025
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2023Fast Certification of Vision-Language Models Using Incremental Randomized Smoothing15 Nov 2023
- 2026Safety, Security, and Cognitive Risks in World Modelscited by 3
- 2026Safety, Security, and Cognitive Risks in World Models1 Apr 2026
- 2021Robust fine-tuning of zero-shot modelscited by 785
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 155
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?cited by 113
- 2021Globally-Robust Neural Networkscited by 106
- 2021PRIMA: General and Precise Neural Network Certification via Scalable Convex Hull Approximationscited by 77
- 2021Revisiting and Advancing Fast Adversarial Training Through The Lens of Bi-Level Optimizationcited by 75
- 2021FuseDream: Training-Free Text-to-Image Generation with Improved CLIP+GAN Space Optimizationcited by 71
- 2021Skew Orthogonal Convolutionscited by 67
- 2021Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Boundscited by 64
- 2021PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifiercited by 63
- 2021A Dynamical System Perspective for Lipschitz Neural Networkscited by 59
- 2023A Unified Algebraic Perspective on Lipschitz Neural Networkscited by 58
12 most cited of 291 All 291 (JSON)
- 2026Clustered Randomized Smoothing for Stochastic Prediction Functions12 Aug 2026
- 2026Traffic-Aware Randomized Smoothing for LLM-Based Network Intrusion Detection15 Jul 2026
- 2026Fast SDP certification of neural networks : towards large multi-class datasets3 Jul 2026
- 2026Halt Fast! Early Stopping for Certified Robustness26 Jun 2026
- 2026Representation Matters in Randomized Smoothing for Audio Classification2 Jun 2026
- 2026RRISE: Robust Radius Inference via a Surrogate Estimator1 Jun 2026
- 2026CEAR: Certified Ensemble Adversarial Robustness in DNNs31 May 2026
- 2026Certified Robustness from Approximate Gaussian Mixture Structures in Pretrained Latent Spaces25 May 2026
- 2026Provable Robustness against Backdoor Attacks via the Primal-Dual Perspective on Differential Privacy20 May 2026
- 2026Certified Robustness under Heterogeneous Perturbations via Hybrid Randomized Smoothing13 May 2026
- 2026Fortifying Time Series: DTW-Certified Robust Anomaly Detection8 May 2026
- 2026A Robust Out-of-Distribution Detection Framework via Synergistic Smoothing5 May 2026
12 newest of 291 All 291 (JSON)