Query-Efficient Black-box Adversarial Attacks Guided by a Transfer-based Prior
Not on the map. Why?
Abstract (arXiv)
Adversarial attacks have been extensively studied in recent years since they can identify the vulnerability of deep learning models before deployed. In this paper, we consider the black-box adversarial setting, where the adversary needs to craft adversarial examples without access to the gradients of a target model. Previous methods attempted to approximate the true gradient either by using the transfer gradient of a surrogate white-box model or based on the feedback of model queries. However, the existing methods inevitably suffer from low attack success rates or poor query efficiency since it is difficult to estimate the gradient in a high-dimensional input space with limited information. To address these problems and improve black-box attacks, we propose two prior-guided random gradient-free (PRGF) algorithms based on biased sampling and gradient averaging, respectively. Our methods can take the advantage of a transfer-based prior given by the gradient of a surrogate model and the query information simultaneously. Through theoretical analyses, the transfer-based prior is appropriately integrated with model queries by an optimal coefficient in each method. Extensive experiments demonstrate that, in comparison with the alternative state-of-the-arts, both of our methods require much fewer queries to attack black-box models with higher success rates.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 13 Mar 2022.
Builds on
36 of 52 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2016Wide Residual Networkscited by 3,057
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
24 more
- 2016Adversarial examples in the physical worldcited by 1,762
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
- 2013Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programmingcited by 716
- 2017Evasion Attacks against Machine Learning at Test Timecited by 686
- 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 656
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 591
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
- 2018Black-box Adversarial Attacks with Limited Queries and Informationcited by 499
- 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 459
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 440
- 2016Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samplescited by 439
- 2018Adversarial Risk and the Dangers of Evaluating Against Weak Attackscited by 221
- 2020Bag of Tricks for Adversarial Trainingcited by 199
- 2013Optimal rates for zero-order convex optimization: the power of two function evaluationscited by 190
- 2019Efficient Decision-based Black-box Adversarial Attacks on Face Recognitioncited by 173
- 2018Prior Convictions: Black-Box Adversarial Attacks with Bandits and Priorscited by 145
- 2018AutoZOOM: Autoencoder-based Zeroth Order Optimization Method for Attacking Black-box Neural Networkscited by 137
- 2018Is Robustness the Cost of Accuracy? -- A Comprehensive Study on the Robustness of 18 Deep Image Classification Modelscited by 135
- 2019Improving Black-box Adversarial Attacks with a Transfer-based Priorcited by 121
- 2019NATTACK: Learning the Distributions of Adversarial Examples for an Improved Black-Box Attack on Deep Neural Networkscited by 94
- 2018Low Frequency Adversarial Perturbationcited by 80
- 2018Guessing Smart: Biased Sampling for Efficient Black-Box Adversarial Attackscited by 46
Built on by
Citing papers per year: 2022: 4; 2023: 12; 2024: 10; 2025: 8; 2026: 4.
38 papers.
Sort:
By area:
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 281
- 2023How Robust is Google's Bard to Adversarial Image Attacks?cited by 177
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attackscited by 37
- 2023Improving Fast Adversarial Training with Prior-Guided Knowledgecited by 34
- 2025A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1cited by 34
- 2022Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Modelscited by 28
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2023Efficient Robustness Assessment via Adversarial Spatial-Temporal Focus on Videoscited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2023Exploring Transferability of Multimodal Adversarial Samples for Vision-Language Pre-training Models with Contrastive Learningcited by 16
- 2023Adversarial Infrared Blocks: A Multi-view Black-box Attack to Thermal Infrared Detectors in Physical Worldcited by 11
- 2023Adversarial Infrared Curves: An Attack on Infrared Pedestrian Detectors in the Physical Worldcited by 10
26 more
- 2024Hard-label based Small Query Black-box Adversarial Attackcited by 10
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Priorcited by 10
- 2025V-Attack: Targeting Disentangled Value Features for Controllable Adversarial Attacks on LVLMscited by 9
- 2024Scaling Laws for Black box Adversarial Attackscited by 8
- 2022Adversarial Neon Beam: A Light-based Physical Attack to DNNscited by 6
- 2024Box-Free Model Watermarks Are Prone to Black-Box Removal Attackscited by 6
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Surveycited by 5
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarkingcited by 5
- 2025Decoder Gradient Shield: Provable and High-Fidelity Prevention of Gradient-Based Box-Free Watermark Removalcited by 5
- 2026Pushing the Frontier of Black-Box LVLM Attacks via Fine-Grained Detail Targetingcited by 5
- 2024Transcending Adversarial Perturbations: Manifold-Aided Adversarial Examples with Legitimate Semanticscited by 4
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectorscited by 4
- 2024Attack Anything: Blind DNNs via Universal Background Adversarial Attackcited by 3
- 2023INK: Inheritable Natural Backdoor Attack Against Model Distillationcited by 2
- 2024STBA: Towards Evaluating the Robustness of DNNs for Query-Limited Black-box Scenariocited by 2
- 2022Adversarial Color Projection: A Projector-based Physical Attack to DNNscited by 1
- 2022Adversarial Catoptric Light: An Effective, Stealthy and Robust Physical-World Attack to DNNscited by 1
- 2025Class-Conditional Neural Polarizer: A Lightweight and Effective Backdoor Defense by Purifying Poisoned Featurescited by 1
- 2025Boosting Ray Search Procedure of Hard-label Attacks with Transfer-based Priorscited by 1
- 2026Decoder Gradient Shields: A Family of Provable and High-Fidelity Methods Against Gradient-Based Box-Free Watermark Removalcited by 1
- 2023DTA: Distribution Transform-based Attack for Query-Limited Scenariocited by 0
- 2025Seeking Flat Minima over Diverse Surrogates for Improved Adversarial Transferability: A Theoretical Framework and Algorithmic Instantiationcited by 0
- 2025Attention-aggregated Attack for Boosting the Transferability of Facial Adversarial Examplescited by 0
- 2025Generating Risky Samples with Conformity Constraints via Diffusion Modelscited by 0
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluationcited by 0
- 2026REPLICANT: Learning Policies for Evading and Hardening Malware Detectorscited by 0
- 2026REPLICANT: Learning Policies for Evading and Hardening Malware Detectors28 Aug 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2026Pushing the Frontier of Black-Box LVLM Attacks via Fine-Grained Detail Targeting19 Feb 2026
- 2026Decoder Gradient Shields: A Family of Provable and High-Fidelity Methods Against Gradient-Based Box-Free Watermark Removal17 Jan 2026
- 2025Generating Risky Samples with Conformity Constraints via Diffusion Models21 Dec 2025
- 2025V-Attack: Targeting Disentangled Value Features for Controllable Adversarial Attacks on LVLMs25 Nov 2025
- 2025Boosting Ray Search Procedure of Hard-label Attacks with Transfer-based Priors23 Jul 2025
- 2025Attention-aggregated Attack for Boosting the Transferability of Facial Adversarial Examples6 May 2025
- 2025Seeking Flat Minima over Diverse Surrogates for Improved Adversarial Transferability: A Theoretical Framework and Algorithmic Instantiation23 Apr 2025
- 2025A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o113 Mar 2025
- 2025Decoder Gradient Shield: Provable and High-Fidelity Prevention of Gradient-Based Box-Free Watermark Removal28 Feb 2025
- 2025Class-Conditional Neural Polarizer: A Lightweight and Effective Backdoor Defense by Purifying Poisoned Features23 Feb 2025
26 more
- 2024Scaling Laws for Black box Adversarial Attacks25 Nov 2024
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks24 Nov 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Attack Anything: Blind DNNs via Universal Background Adversarial Attack17 Aug 2024
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Prior29 May 2024
- 2024Box-Free Model Watermarks Are Prone to Black-Box Removal Attacks16 May 2024
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectors18 Apr 2024
- 2024STBA: Towards Evaluating the Robustness of DNNs for Query-Limited Black-box Scenario30 Mar 2024
- 2024Hard-label based Small Query Black-box Adversarial Attack9 Mar 2024
- 2024Transcending Adversarial Perturbations: Manifold-Aided Adversarial Examples with Legitimate Semantics5 Feb 2024
- 2023Adversarial Infrared Curves: An Attack on Infrared Pedestrian Detectors in the Physical World21 Dec 2023
- 2023DTA: Distribution Transform-based Attack for Query-Limited Scenario12 Dec 2023
- 2023How Robust is Google's Bard to Adversarial Image Attacks?21 Sep 2023
- 2023Exploring Transferability of Multimodal Adversarial Samples for Vision-Language Pre-training Models with Contrastive Learning24 Aug 2023
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking21 Jun 2023
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Models26 May 2023
- 2023INK: Inheritable Natural Backdoor Attack Against Model Distillation21 Apr 2023
- 2023Adversarial Infrared Blocks: A Multi-view Black-box Attack to Thermal Infrared Detectors in Physical World21 Apr 2023
- 2023Improving Fast Adversarial Training with Prior-Guided Knowledge1 Apr 2023
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey11 Mar 2023
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective19 Feb 2023
- 2023Efficient Robustness Assessment via Adversarial Spatial-Temporal Focus on Videos3 Jan 2023
- 2022Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Models5 Oct 2022
- 2022Adversarial Catoptric Light: An Effective, Stealthy and Robust Physical-World Attack to DNNs19 Sep 2022
- 2022Adversarial Color Projection: A Projector-based Physical Attack to DNNs19 Sep 2022
- 2022Adversarial Neon Beam: A Light-based Physical Attack to DNNs2 Apr 2022
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 281
- 2023How Robust is Google's Bard to Adversarial Image Attacks?cited by 177
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attackscited by 37
- 2025A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1cited by 34
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2023Exploring Transferability of Multimodal Adversarial Samples for Vision-Language Pre-training Models with Contrastive Learningcited by 16
- 2025V-Attack: Targeting Disentangled Value Features for Controllable Adversarial Attacks on LVLMscited by 9
- 2026Pushing the Frontier of Black-Box LVLM Attacks via Fine-Grained Detail Targetingcited by 5
- 2026Pushing the Frontier of Black-Box LVLM Attacks via Fine-Grained Detail Targeting19 Feb 2026
- 2025V-Attack: Targeting Disentangled Value Features for Controllable Adversarial Attacks on LVLMs25 Nov 2025
- 2025A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o113 Mar 2025
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks24 Nov 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2023How Robust is Google's Bard to Adversarial Image Attacks?21 Sep 2023
- 2023Exploring Transferability of Multimodal Adversarial Samples for Vision-Language Pre-training Models with Contrastive Learning24 Aug 2023
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Models26 May 2023
- 2023Improving Fast Adversarial Training with Prior-Guided Knowledgecited by 34
- 2022Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Modelscited by 28
- 2023Efficient Robustness Assessment via Adversarial Spatial-Temporal Focus on Videoscited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2023Adversarial Infrared Blocks: A Multi-view Black-box Attack to Thermal Infrared Detectors in Physical Worldcited by 11
- 2023Adversarial Infrared Curves: An Attack on Infrared Pedestrian Detectors in the Physical Worldcited by 10
- 2024Hard-label based Small Query Black-box Adversarial Attackcited by 10
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Priorcited by 10
- 2024Scaling Laws for Black box Adversarial Attackscited by 8
- 2022Adversarial Neon Beam: A Light-based Physical Attack to DNNscited by 6
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Surveycited by 5
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarkingcited by 5
12 most cited of 28 All 28 (JSON)
- 2026REPLICANT: Learning Policies for Evading and Hardening Malware Detectors28 Aug 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2026Decoder Gradient Shields: A Family of Provable and High-Fidelity Methods Against Gradient-Based Box-Free Watermark Removal17 Jan 2026
- 2025Boosting Ray Search Procedure of Hard-label Attacks with Transfer-based Priors23 Jul 2025
- 2025Attention-aggregated Attack for Boosting the Transferability of Facial Adversarial Examples6 May 2025
- 2025Seeking Flat Minima over Diverse Surrogates for Improved Adversarial Transferability: A Theoretical Framework and Algorithmic Instantiation23 Apr 2025
- 2025Decoder Gradient Shield: Provable and High-Fidelity Prevention of Gradient-Based Box-Free Watermark Removal28 Feb 2025
- 2025Class-Conditional Neural Polarizer: A Lightweight and Effective Backdoor Defense by Purifying Poisoned Features23 Feb 2025
- 2024Scaling Laws for Black box Adversarial Attacks25 Nov 2024
- 2024Attack Anything: Blind DNNs via Universal Background Adversarial Attack17 Aug 2024
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Prior29 May 2024
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectors18 Apr 2024
12 newest of 28 All 28 (JSON)