mlsanityData to 14 Oct 2026

Privacy-preserving Universal Adversarial Defense for Black-box Models

arXiv 2408.10647 ↗First posted 20 Aug 2024cs.LG cs.AI cs.CRcited by 3

Not on the map. Why?

Abstract (arXiv)

Deep neural networks (DNNs) are increasingly used in critical applications such as identity authentication and autonomous driving, where robustness against adversarial attacks is crucial. These attacks can exploit minor perturbations to cause significant prediction errors, making it essential to enhance the resilience of DNNs. Traditional defense methods often rely on access to detailed model information, which raises privacy concerns, as model owners may be reluctant to share such data. In contrast, existing black-box defense methods fail to offer a universal defense against various types of adversarial attacks. To address these challenges, we introduce DUCD, a universal black-box defense method that does not require access to the target model's parameters or architecture. Our approach involves distilling the target model by querying it with data, creating a white-box surrogate while preserving data privacy. We further enhance this surrogate model using a certified defense based on randomized smoothing and optimized noise selection, enabling robust defense against a broad range of adversarial attacks. Comparative evaluations between the certified defenses of the surrogate and target models demonstrate the effectiveness of our approach. Experiments on multiple image classification datasets show that DUCD not only outperforms existing black-box defenses but also matches the accuracy of white-box defenses, all while enhancing data privacy and reducing the success rate of membership inference attacks.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 54 of its 76 references that are in the map. First posted on arXiv 20 Aug 2024.

Builds on

54 of 76 references.

References · 54

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  3. 2013Intriguing properties of neural networkscited by 5,155
  4. 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
  5. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
  6. 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 685
  7. 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 678
  8. 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
  9. 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 468
  10. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
  11. 2019HopSkipJumpAttack: A Query-Efficient Decision-Based Attackcited by 333
  12. 2018Certified Defenses against Adversarial Examplescited by 306
38 more
  1. 2018Adversarial Robustness Toolbox v1.0.0cited by 215
  2. 2020Understanding and Improving Fast Adversarial Trainingcited by 214
  3. 2023Better Diffusion Models Further Improve Adversarial Trainingcited by 208
  4. 2018Do CIFAR-10 Classifiers Generalize to CIFAR-10?cited by 200
  5. 2018Stochastic Activation Pruning for Robust Adversarial Defensecited by 171
  6. 2020Randomized Smoothing of All Shapes and Sizescited by 147
  7. 2019Privacy Risks of Securing Machine Learning Models against Adversarial Examplescited by 141
  8. 2022(Certified!!) Adversarial Robustness for Free!cited by 132
  9. 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 95
  10. 2023Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networkscited by 95
  11. 2019Data-Free Adversarial Distillationcited by 90
  12. 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 90
  13. 2023Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunitiescited by 90
  14. 2020Adversarial Distributional Training for Robust Deep Learningcited by 79
  15. 2023Split Learning in 6G Edge Networkscited by 68
  16. 2019Tight Certificates of Adversarial Robustness for Randomly Smoothed Classifierscited by 65
  17. 2024AdaptSFL: Adaptive Split Federated Learning in Resource-constrained Edge Networkscited by 64
  18. 2024SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Modelscited by 62
  19. 2019Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablationcited by 60
  20. 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 52
  21. 2022Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregationcited by 52
  22. 2020Can We Use Split Learning on 1D CNN Models for Privacy Preserving Training?cited by 50
  23. 2024Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 49
  24. 2020Black-Box Certification with Randomized Smoothing: A Functional Optimization Based Frameworkcited by 46
  25. 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
  26. 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
  27. 2023FedSN: A Federated Learning Framework over Heterogeneous LEO Satellite Networkscited by 38
  28. 2019Robust Local Features for Improving the Generalization of Adversarial Trainingcited by 30
  29. 2021Detecting Adversarial Examples from Sensitivity Inconsistency of Spatial-Transform Domaincited by 29
  30. 2023Randomized Adversarial Training via Taylor Expansioncited by 28
  31. 2021Input-Specific Robustness Certification for Randomized Smoothingcited by 11
  32. 2022Towards A Critical Evaluation of Robustness for Deep Learning Backdoor Countermeasurescited by 11
  33. 2022Diversified Adversarial Attacks based on Conjugate Gradient Methodcited by 11
  34. 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoisercited by 11
  35. 2022UniCR: Universally Approximated Certified Robustness via Randomized Smoothingcited by 10
  36. 2024Can Distillation Mitigate Backdoor Attacks in Pre-trained Encoders?cited by 6
  37. 2023Provable Robustness Against a Union of ℓ0 Adversarial Attackscited by 5
  38. 2023Certified Adversarial Robustness Within Multiple Perturbation Boundscited by 4

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Differentially Private and Adversarially Robust Machine Learning: An Empirical Evaluation
  2. 2023Discriminative Adversarial Privacy: Balancing Accuracy and Membership Privacy in Neural Networks
  3. 2022Threat Model-Agnostic Adversarial Defense using Diffusion Models
  4. 2023Efficient Defense Against Model Stealing Attacks on Convolutional Neural Networks
  5. 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?
  6. 2024Towards Unified Robustness Against Both Backdoor and Adversarial Attacks
  7. 2022Audit and Improve Robustness of Private Neural Networks on Encrypted Data
  8. 2022Membership Privacy Protection for Image Translation Models via Adversarial Knowledge Distillation