NATTACK: Learning the Distributions of Adversarial Examples for an Improved Black-Box Attack on Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
Powerful adversarial attack methods are vital for understanding how to construct robust deep neural networks (DNNs) and for thoroughly testing defense techniques. In this paper, we propose a black-box adversarial attack algorithm that can defeat both vanilla DNNs and those generated by various defense techniques developed recently. Instead of searching for an "optimal" adversarial example for a benign input to a targeted DNN, our algorithm finds a probability density distribution over a small region centered around the input, such that a sample drawn from this distribution is likely an adversarial example, without the need of accessing the DNN's internal layers or weights. Our approach is universal as it can successfully attack different neural networks by a single algorithm. It is also strong; according to the testing against 2 vanilla DNNs and 13 defended ones, it outperforms state-of-the-art black-box or white-box attack methods for most test cases. Additionally, our results reveal that adversarial training remains one of the best defense techniques, and the adversarial examples are not as transferable across defended DNNs as them across vanilla DNNs.
Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 23; 2023: 25; 2024: 10; 2025: 5; 2026: 1.
94 papers.
Sort:
By area:
- 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 242
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 155
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2021Improving Adversarial Robustness via Channel-wise Activation Suppressingcited by 76
- 2021Black-box Detection of Backdoor Attacks with Limited Information and Datacited by 71
- 2023Structure Invariant Transformation for better Adversarial Transferabilitycited by 61
- 2021Probabilistic Margins for Instance Reweighting in Adversarial Trainingcited by 57
- 2021Meta Gradient Adversarial Attackcited by 55
- 2021Boosting Adversarial Transferability through Enhanced Momentumcited by 53
- 2021A Comprehensive Evaluation Framework for Deep Model Robustnesscited by 41
- 2022Query-Efficient Black-box Adversarial Attacks Guided by a Transfer-based Priorcited by 38
- 2023Unlearnable Examples for Diffusion Models: Protect Data from Unauthorized Exploitationcited by 37
38 more
- 2023Diversifying the High-level Features for better Adversarial Transferabilitycited by 34
- 2021Analysis and Applications of Class-wise Robustness in Adversarial Trainingcited by 33
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2022Boosting the Transferability of Adversarial Attacks with Global Momentum Initializationcited by 29
- 2023Generalizable Black-Box Adversarial Attack with Meta Learningcited by 29
- 2023Probabilistically robust conformal predictioncited by 25
- 2024Learning to Transform Dynamically for Better Adversarial Transferabilitycited by 23
- 2021Adaptive Image Transformations for Transfer-based Adversarial Attackcited by 22
- 2022Towards Understanding and Mitigating Audio Adversarial Examples for Speaker Recognitioncited by 22
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021Zeroth-Order Methods for Convex-Concave Minmax Problems: Applications to Decision-Dependent Risk Minimizationcited by 18
- 2022Attacking deep networks with surrogate-based adversarial black-box methods is easycited by 18
- 2022PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognitioncited by 16
- 2023Feature Separation and Recalibration for Adversarial Robustnesscited by 16
- 2021Adversarial Imaging Pipelinescited by 15
- 2022Strong Transferable Adversarial Attacks via Ensembled Asymptotically Normal Distribution Learningcited by 15
- 2021Universal Spectral Adversarial Attacks for Deformable Shapescited by 14
- 2022Understanding Adversarial Robustness Against On-manifold Adversarial Examplescited by 12
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domaincited by 12
- 2022PointCAT: Contrastive Adversarial Training for Robust Point Cloud Recognitioncited by 10
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Priorcited by 10
- 2025Response Attack: Exploiting Contextual Priming to Jailbreak Large Language Modelscited by 10
- 2021Practical Relative Order Attack in Deep Rankingcited by 9
- 2021A Simple and Strong Baseline for Universal Targeted Attacks on Siamese Visual Trackingcited by 9
- 2022Bandits for Structure Perturbation-based Black-box Attacks to Graph Neural Networks with Theoretical Guaranteescited by 9
- 2023Fast Propagation is Better: Accelerating Single-Step Adversarial Training via Sampling Subnetworkscited by 8
- 2021Performance Evaluation of Adversarial Attacks: Discrepancies and Solutionscited by 7
- 2022RSTAM: An Effective Black-Box Impersonation Attack on Face Recognition using a Mobile and Compact Printercited by 7
- 2023Adversarial Attack with Raindropscited by 7
- 2021Statistical Inference for Polyak-Ruppert Averaged Zeroth-order Stochastic Gradient Algorithmcited by 6
- 2021Improving the Robustness of Adversarial Attacks Using an Affine-Invariant Gradient Estimatorcited by 6
- 2021Adaptive Perturbation for Adversarial Attackcited by 6
- 2023SoK: Pitfalls in Evaluating Black-Box Attackscited by 6
- 2021All You Need is RAW: Defending Against Adversarial Attacks with Camera Image Pipelinescited by 5
- 2022PublicCheck: Public Integrity Verification for Services of Run-time Deep Modelscited by 5
- 2023A Certified Radius-Guided Attack Framework to Image Segmentation Modelscited by 5
- 2023Certifiable Black-Box Attacks with Randomized Adversarial Examples: Breaking Defenses with Provable Confidencecited by 5
50 most cited of 94 All 94 (JSON)
- 2026Evaluating False Alarm and Missing Attacks in CAN IDS2 Feb 2026
- 2025SPOOF: Simple Pixel Operations for Out-of-Distribution Fooling5 Dec 2025
- 2025Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environments24 Jul 2025
- 2025Response Attack: Exploiting Contextual Priming to Jailbreak Large Language Models7 Jul 2025
- 2025Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategies30 Jun 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domain16 Oct 2024
- 2024Improving Adversarial Robustness for 3D Point Cloud Recognition at Test-Time through Purified Self-Training23 Sep 2024
- 2024Resilience and Security of Deep Neural Networks Against Intentional and Unintentional Perturbations: Survey and Research Challenges31 Jul 2024
- 2024SemiAdv: Query-Efficient Black-Box Adversarial Attack with Unlabeled Images13 Jul 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Prior29 May 2024
38 more
- 2024Learning to Transform Dynamically for Better Adversarial Transferability23 May 2024
- 2024Towards a Novel Perspective on Adversarial Examples Driven by Frequency16 Apr 2024
- 2024STBA: Towards Evaluating the Robustness of DNNs for Query-Limited Black-box Scenario30 Mar 2024
- 2024A Random Ensemble of Encrypted Vision Transformers for Adversarially Robust Defense11 Feb 2024
- 2023ARBiBench: Benchmarking Adversarial Robustness of Binarized Neural Networks21 Dec 2023
- 2023DTA: Distribution Transform-based Attack for Query-Limited Scenario12 Dec 2023
- 2023Generating Visually Realistic Adversarial Patch5 Dec 2023
- 2023SoK: Pitfalls in Evaluating Black-Box Attacks26 Oct 2023
- 2023Fast Propagation is Better: Accelerating Single-Step Adversarial Training via Sampling Subnetworks24 Oct 2023
- 2023A Geometrical Approach to Evaluate the Adversarial Robustness of Deep Neural Networks10 Oct 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 2023Adversarial Attacks to Latent Representations of Distributed Neural Networks in Split Computing29 Sep 2023
- 2023Structure Invariant Transformation for better Adversarial Transferability26 Sep 2023
- 2023Probabilistically robust conformal prediction31 Jul 2023
- 2023Common Knowledge Learning for Generating Transferable Adversarial Examples1 Jul 2023
- 2023Cooperation or Competition: Avoiding Player Domination for Multi-Target Robustness via Adaptive Budgets27 Jun 2023
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking21 Jun 2023
- 2023Faithful Knowledge Distillation7 Jun 2023
- 2023Unlearnable Examples for Diffusion Models: Protect Data from Unauthorized Exploitation2 Jun 2023
- 2023Earning Extra Performance from Restrictive Feedbacks28 Apr 2023
- 2023Diversifying the High-level Features for better Adversarial Transferability20 Apr 2023
- 2023Certifiable Black-Box Attacks with Randomized Adversarial Examples: Breaking Defenses with Provable Confidence10 Apr 2023
- 2023A Certified Radius-Guided Attack Framework to Image Segmentation Models5 Apr 2023
- 2023Feature Separation and Recalibration for Adversarial Robustness24 Mar 2023
- 2023Adversarial Attack with Raindrops28 Feb 2023
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective19 Feb 2023
- 2023Improving Adversarial Transferability with Scheduled Step Size and Dual Example30 Jan 2023
- 2023AdvBiom: Adversarial Attacks on Biometric Matchers10 Jan 2023
- 2023Generalizable Black-Box Adversarial Attack with Meta Learning1 Jan 2023
- 2022Publishing Efficient On-device Models Increases Adversarial Vulnerability28 Dec 2022
- 2022Boosting the Transferability of Adversarial Attacks with Global Momentum Initialization21 Nov 2022
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey19 Oct 2022
- 2022Understanding Adversarial Robustness Against On-manifold Adversarial Examples2 Oct 2022
- 2022Strong Transferable Adversarial Attacks via Ensembled Asymptotically Normal Distribution Learning24 Sep 2022
- 2022On the Adversarial Transferability of ConvMixer Models19 Sep 2022
- 2022PointCAT: Contrastive Adversarial Training for Robust Point Cloud Recognition16 Sep 2022
- 2022On the Transferability of Adversarial Examples between Encrypted Models7 Sep 2022
- 2022Cross-domain Cross-architecture Black-box Attacks on Fine-tuned Models with Transferred Evolutionary Strategies28 Aug 2022
50 newest of 94 All 94 (JSON)
- 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 242
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 155
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2021Improving Adversarial Robustness via Channel-wise Activation Suppressingcited by 76
- 2021Black-box Detection of Backdoor Attacks with Limited Information and Datacited by 71
- 2023Structure Invariant Transformation for better Adversarial Transferabilitycited by 61
- 2021Probabilistic Margins for Instance Reweighting in Adversarial Trainingcited by 57
- 2021Meta Gradient Adversarial Attackcited by 55
- 2021Boosting Adversarial Transferability through Enhanced Momentumcited by 53
- 2021A Comprehensive Evaluation Framework for Deep Model Robustnesscited by 41
- 2022Query-Efficient Black-box Adversarial Attacks Guided by a Transfer-based Priorcited by 38
- 2023Diversifying the High-level Features for better Adversarial Transferabilitycited by 34
12 most cited of 92 All 92 (JSON)
- 2026Evaluating False Alarm and Missing Attacks in CAN IDS2 Feb 2026
- 2025SPOOF: Simple Pixel Operations for Out-of-Distribution Fooling5 Dec 2025
- 2025Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environments24 Jul 2025
- 2025Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategies30 Jun 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domain16 Oct 2024
- 2024Improving Adversarial Robustness for 3D Point Cloud Recognition at Test-Time through Purified Self-Training23 Sep 2024
- 2024Resilience and Security of Deep Neural Networks Against Intentional and Unintentional Perturbations: Survey and Research Challenges31 Jul 2024
- 2024SemiAdv: Query-Efficient Black-Box Adversarial Attack with Unlabeled Images13 Jul 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Prior29 May 2024
- 2024Learning to Transform Dynamically for Better Adversarial Transferability23 May 2024
12 newest of 92 All 92 (JSON)