Double Sampling Randomized Smoothing
Not on the map. Why?
Abstract (arXiv)
Neural networks (NNs) are known to be vulnerable against adversarial perturbations, and thus there is a line of work aiming to provide robustness certification for NNs, such as randomized smoothing, which samples smoothing noises from a certain distribution to certify the robustness for a smoothed classifier. However, as shown by previous work, the certified robust radius in randomized smoothing suffers from scaling to large datasets ("curse of dimensionality"). To overcome this hurdle, we propose a Double Sampling Randomized Smoothing (DSRS) framework, which exploits the sampled probability from an additional smoothing distribution to tighten the robustness certification of the previous smoothed classifier. Theoretically, under mild assumptions, we prove that DSRS can certify Theta(√ d) robust radius under ℓ2 norm where d is the input dimension, implying that DSRS may be able to break the curse of dimensionality of randomized smoothing. We instantiate DSRS for a generalized family of Gaussian smoothing and propose an efficient and sound computing method based on customized dual optimization considering sampling error. Extensive experiments on MNIST, CIFAR-10, and ImageNet verify our theory and show that DSRS certifies larger robust radii than existing baselines consistently under different settings. Code is available at https://github.com/llylly/DSRS.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 39 of its 66 references that are in the map. First posted on arXiv 16 Jun 2022.
Builds on
39 of 66 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 564
- 2020On Adaptive Attacks to Adversarial Example Defensescited by 547
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 462
- 2019Unlabeled Data Improves Adversarial Robustnesscited by 415
- 2019Provably Robust Deep Learning via Adversarially Trained Smoothed Classifierscited by 328
- 2018Certified Defenses against Adversarial Examplescited by 305
27 more
- 2021Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Modelscited by 227
- 2019Algorithms for Verifying Deep Neural Networkscited by 221
- 2019Towards Stable and Efficient Training of Verifiably Robust Neural Networkscited by 204
- 2018Certified Adversarial Robustness with Additive Noisecited by 178
- 2020Randomized Smoothing of All Shapes and Sizescited by 146
- 2020MACER: Attack-free and Scalable Robust Training via Maximizing Certified Radiuscited by 114
- 2020QEBA: Query-Efficient Boundary-Based Blackbox Attackcited by 103
- 2019SemanticAdv: Generating Adversarial Examples via Attribute-conditional Image Editingcited by 93
- 2020Consistency Regularization for Certified Robustness of Smoothed Classifierscited by 73
- 2019Tight Certificates of Adversarial Robustness for Randomly Smoothed Classifierscited by 65
- 2021Introduction to Neural Network Verificationcited by 63
- 2020Curse of Dimensionality on Randomized Smoothing for Certifiable Robustnesscited by 56
- 2020TSS: Transformation-Specific Smoothing for Robustness Certificationcited by 49
- 2021SmoothMix: Training Confidence-calibrated Smoothed Classifiers for Certified Robustnesscited by 49
- 2020Detection as Regression: Certified Object Detection by Median Smoothingcited by 47
- 2020Black-Box Certification with Randomized Smoothing: A Functional Optimization Based Frameworkcited by 45
- 2021On the Certified Robustness for Ensemble Models and Beyondcited by 40
- 2021Improved, Deterministic Smoothing for L_1 Certified Robustnesscited by 39
- 2020Data-Dependent Randomized Smoothingcited by 37
- 2020Certifying Confidence via Randomized Smoothingcited by 36
- 2020Random Smoothing Might be Unable to Certify ℓ_∞ Robustness for High-Dimensional Imagescited by 35
- 2021Intriguing Properties of Input-dependent Randomized Smoothingcited by 24
- 2021ANCER: Anisotropic Certification via Sample-wise Volume Maximizationcited by 23
- 2020Extensions and limitations of randomized smoothing for robustness guaranteescited by 15
- 2020Adversarial robustness via robust low rank representationscited by 14
- 2020Tight Second-Order Certificates for Randomized Smoothingcited by 10
- 2021Progressive-Scale Boundary Blackbox Attack via Projective Gradient Estimationcited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 5; 2024: 8; 2025: 5; 2026: 2.
22 papers.
Sort:
By area:
- 2022LOT: Layer-wise Orthogonal Training on Improving ℓ2 Certified Robustnesscited by 32
- 2025SafeAuto: Knowledge-Enhanced Safe Autonomous Driving with Multimodal Foundation Modelscited by 22
- 2024Provably Unlearnable Data Examplescited by 18
- 2022Double Bubble, Toil and Trouble: Enhancing Certified Robustness through Transitivitycited by 15
- 2023Projected Randomized Smoothing for Certified Adversarial Robustnesscited by 11
- 2023Multi-scale Diffusion Denoised Smoothingcited by 9
- 2024COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuitscited by 9
- 2024Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defencescited by 9
- 2023Node-aware Bi-smoothing: Certified Robustness against Graph Injection Attackscited by 8
- 2024Relational DNN Verification With Cross Executional Bound Refinementcited by 5
- 2023Rethinking Randomized Smoothing from the Perspective of Scalabilitycited by 3
- 2024COMMIT: Certifying Robustness of Multi-Sensor Fusion Systems against Semantic Attackscited by 2
10 more
- 2025BEAVER: An Efficient Deterministic LLM Verifiercited by 2
- 2024Accelerated Smoothing: A Scalable Approach to Randomized Smoothingcited by 1
- 2024Effects of Exponential Gaussian Distribution on (Double Sampling) Randomized Smoothingcited by 1
- 2024Average Certified Radius is a Poor Metric for Randomized Smoothingcited by 1
- 2025CAMP in the Odyssey: Provably Robust Reinforcement Learning with Certified Radius Maximizationcited by 1
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)cited by 1
- 2023[Re] Double Sampling Randomized Smoothingcited by 0
- 2025Dual Randomized Smoothing: Beyond Global Noise Variancecited by 0
- 2026Laplace-Bridged Randomized Smoothing for Fast Certified Robustnesscited by 0
- 2026The Geometry of Randomized Smoothing on Feasible Setscited by 0
- 2026The Geometry of Randomized Smoothing on Feasible Sets30 Sep 2026
- 2026Laplace-Bridged Randomized Smoothing for Fast Certified Robustness27 Apr 2026
- 2025BEAVER: An Efficient Deterministic LLM Verifier5 Dec 2025
- 2025Dual Randomized Smoothing: Beyond Global Noise Variance1 Dec 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025SafeAuto: Knowledge-Enhanced Safe Autonomous Driving with Multimodal Foundation Models28 Feb 2025
- 2025CAMP in the Odyssey: Provably Robust Reinforcement Learning with Certified Radius Maximization29 Jan 2025
- 2024Average Certified Radius is a Poor Metric for Randomized Smoothing9 Oct 2024
- 2024Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defences14 Jun 2024
- 2024Effects of Exponential Gaussian Distribution on (Double Sampling) Randomized Smoothing4 Jun 2024
- 2024Relational DNN Verification With Cross Executional Bound Refinement16 May 2024
- 2024Provably Unlearnable Data Examples6 May 2024
10 more
- 2024COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuits17 Mar 2024
- 2024COMMIT: Certifying Robustness of Multi-Sensor Fusion Systems against Semantic Attacks4 Mar 2024
- 2024Accelerated Smoothing: A Scalable Approach to Randomized Smoothing12 Feb 2024
- 2023Rethinking Randomized Smoothing from the Perspective of Scalability19 Dec 2023
- 2023Node-aware Bi-smoothing: Certified Robustness against Graph Injection Attacks7 Dec 2023
- 2023Multi-scale Diffusion Denoised Smoothing25 Oct 2023
- 2023Projected Randomized Smoothing for Certified Adversarial Robustness25 Sep 2023
- 2023[Re] Double Sampling Randomized Smoothing27 Jun 2023
- 2022LOT: Layer-wise Orthogonal Training on Improving ℓ2 Certified Robustness20 Oct 2022
- 2022Double Bubble, Toil and Trouble: Enhancing Certified Robustness through Transitivity12 Oct 2022
- 2023Multi-scale Diffusion Denoised Smoothingcited by 9
- 2023Multi-scale Diffusion Denoised Smoothing25 Oct 2023
- 2022LOT: Layer-wise Orthogonal Training on Improving ℓ2 Certified Robustnesscited by 32
- 2024Provably Unlearnable Data Examplescited by 18
- 2022Double Bubble, Toil and Trouble: Enhancing Certified Robustness through Transitivitycited by 15
- 2023Projected Randomized Smoothing for Certified Adversarial Robustnesscited by 11
- 2024COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuitscited by 9
- 2024Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defencescited by 9
- 2023Node-aware Bi-smoothing: Certified Robustness against Graph Injection Attackscited by 8
- 2024Relational DNN Verification With Cross Executional Bound Refinementcited by 5
- 2023Rethinking Randomized Smoothing from the Perspective of Scalabilitycited by 3
- 2024COMMIT: Certifying Robustness of Multi-Sensor Fusion Systems against Semantic Attackscited by 2
- 2025BEAVER: An Efficient Deterministic LLM Verifiercited by 2
- 2024Accelerated Smoothing: A Scalable Approach to Randomized Smoothingcited by 1
12 most cited of 20 All 20 (JSON)
- 2026The Geometry of Randomized Smoothing on Feasible Sets30 Sep 2026
- 2026Laplace-Bridged Randomized Smoothing for Fast Certified Robustness27 Apr 2026
- 2025BEAVER: An Efficient Deterministic LLM Verifier5 Dec 2025
- 2025Dual Randomized Smoothing: Beyond Global Noise Variance1 Dec 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025CAMP in the Odyssey: Provably Robust Reinforcement Learning with Certified Radius Maximization29 Jan 2025
- 2024Average Certified Radius is a Poor Metric for Randomized Smoothing9 Oct 2024
- 2024Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defences14 Jun 2024
- 2024Effects of Exponential Gaussian Distribution on (Double Sampling) Randomized Smoothing4 Jun 2024
- 2024Relational DNN Verification With Cross Executional Bound Refinement16 May 2024
- 2024Provably Unlearnable Data Examples6 May 2024
- 2024COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuits17 Mar 2024
12 newest of 20 All 20 (JSON)