Privacy-preserving Universal Adversarial Defense for Black-box Models
Not on the map. Why?
Abstract (arXiv)
Deep neural networks (DNNs) are increasingly used in critical applications such as identity authentication and autonomous driving, where robustness against adversarial attacks is crucial. These attacks can exploit minor perturbations to cause significant prediction errors, making it essential to enhance the resilience of DNNs. Traditional defense methods often rely on access to detailed model information, which raises privacy concerns, as model owners may be reluctant to share such data. In contrast, existing black-box defense methods fail to offer a universal defense against various types of adversarial attacks. To address these challenges, we introduce DUCD, a universal black-box defense method that does not require access to the target model's parameters or architecture. Our approach involves distilling the target model by querying it with data, creating a white-box surrogate while preserving data privacy. We further enhance this surrogate model using a certified defense based on randomized smoothing and optimized noise selection, enabling robust defense against a broad range of adversarial attacks. Comparative evaluations between the certified defenses of the surrogate and target models demonstrate the effectiveness of our approach. Experiments on multiple image classification datasets show that DUCD not only outperforms existing black-box defenses but also matches the accuracy of white-box defenses, all while enhancing data privacy and reducing the success rate of membership inference attacks.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 54 of its 76 references that are in the map. First posted on arXiv 20 Aug 2024.
Builds on
54 of 76 references.
References · 54
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2013Intriguing properties of neural networkscited by 5,155
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 685
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 678
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 468
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
- 2019HopSkipJumpAttack: A Query-Efficient Decision-Based Attackcited by 333
- 2018Certified Defenses against Adversarial Examplescited by 306
38 more
- 2018Adversarial Robustness Toolbox v1.0.0cited by 215
- 2020Understanding and Improving Fast Adversarial Trainingcited by 214
- 2023Better Diffusion Models Further Improve Adversarial Trainingcited by 208
- 2018Do CIFAR-10 Classifiers Generalize to CIFAR-10?cited by 200
- 2018Stochastic Activation Pruning for Robust Adversarial Defensecited by 171
- 2020Randomized Smoothing of All Shapes and Sizescited by 147
- 2019Privacy Risks of Securing Machine Learning Models against Adversarial Examplescited by 141
- 2022(Certified!!) Adversarial Robustness for Free!cited by 132
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 95
- 2023Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networkscited by 95
- 2019Data-Free Adversarial Distillationcited by 90
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 90
- 2023Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunitiescited by 90
- 2020Adversarial Distributional Training for Robust Deep Learningcited by 79
- 2023Split Learning in 6G Edge Networkscited by 68
- 2019Tight Certificates of Adversarial Robustness for Randomly Smoothed Classifierscited by 65
- 2024AdaptSFL: Adaptive Split Federated Learning in Resource-constrained Edge Networkscited by 64
- 2024SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Modelscited by 62
- 2019Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablationcited by 60
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 52
- 2022Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregationcited by 52
- 2020Can We Use Split Learning on 1D CNN Models for Privacy Preserving Training?cited by 50
- 2024Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 49
- 2020Black-Box Certification with Randomized Smoothing: A Functional Optimization Based Frameworkcited by 46
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2023FedSN: A Federated Learning Framework over Heterogeneous LEO Satellite Networkscited by 38
- 2019Robust Local Features for Improving the Generalization of Adversarial Trainingcited by 30
- 2021Detecting Adversarial Examples from Sensitivity Inconsistency of Spatial-Transform Domaincited by 29
- 2023Randomized Adversarial Training via Taylor Expansioncited by 28
- 2021Input-Specific Robustness Certification for Randomized Smoothingcited by 11
- 2022Towards A Critical Evaluation of Robustness for Deep Learning Backdoor Countermeasurescited by 11
- 2022Diversified Adversarial Attacks based on Conjugate Gradient Methodcited by 11
- 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoisercited by 11
- 2022UniCR: Universally Approximated Certified Robustness via Randomized Smoothingcited by 10
- 2024Can Distillation Mitigate Backdoor Attacks in Pre-trained Encoders?cited by 6
- 2023Provable Robustness Against a Union of ℓ0 Adversarial Attackscited by 5
- 2023Certified Adversarial Robustness Within Multiple Perturbation Boundscited by 4
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Differentially Private and Adversarially Robust Machine Learning: An Empirical Evaluation
- 2023Discriminative Adversarial Privacy: Balancing Accuracy and Membership Privacy in Neural Networks
- 2022Threat Model-Agnostic Adversarial Defense using Diffusion Models
- 2023Efficient Defense Against Model Stealing Attacks on Convolutional Neural Networks
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?
- 2024Towards Unified Robustness Against Both Backdoor and Adversarial Attacks
- 2022Audit and Improve Robustness of Private Neural Networks on Encrypted Data
- 2022Membership Privacy Protection for Image Translation Models via Adversarial Knowledge Distillation