Improving Black-box Adversarial Attacks with a Transfer-based Prior
Not on the map. Why?
Abstract (arXiv)
We consider the black-box adversarial setting, where the adversary has to generate adversarial perturbations without access to the target models to compute gradients. Previous methods tried to approximate the gradient either by using a transfer gradient of a surrogate white-box model, or based on the query feedback. However, these methods often suffer from low attack success rates or poor query efficiency since it is non-trivial to estimate the gradient in a high-dimensional space with limited information. To address these problems, we propose a prior-guided random gradient-free (P-RGF) method to improve black-box adversarial attacks, which takes the advantage of a transfer-based prior and the query information simultaneously. The transfer-based prior given by the gradient of a surrogate model is appropriately integrated into our algorithm by an optimal coefficient derived by a theoretical analysis. Extensive experiments demonstrate that our method requires much fewer queries to attack black-box models with higher success rates compared with the alternative state-of-the-art methods.
Key facts. Cited by 121 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 32; 2023: 23; 2024: 16; 2025: 11; 2026: 5.
121 papers.
Sort:
By area:
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 284
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Datacited by 119
- 2022Narcissus: A Practical Clean-Label Backdoor Attack with Limited Informationcited by 103
- 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
- 2023Structure Invariant Transformation for better Adversarial Transferabilitycited by 62
- 2024Query-Based Adversarial Prompt Generationcited by 62
- 2021Meta Gradient Adversarial Attackcited by 55
- 2024PAL: Proxy-Guided Black-Box Attack on Large Language Modelscited by 50
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 49
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothnesscited by 38
- 2022Query-Efficient Black-box Adversarial Attacks Guided by a Transfer-based Priorcited by 38
38 more
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensuscited by 37
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
- 2022Transferable Adversarial Attack based on Integrated Gradientscited by 35
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2023Generalizable Black-Box Adversarial Attack with Meta Learningcited by 29
- 2023Make Them Spill the Beans! Coercive Knowledge Extraction from (Production) LLMscited by 27
- 2021On the Convergence of Prior-Guided Zeroth-Order Optimization Algorithmscited by 23
- 2021Unrestricted Adversarial Attacks on ImageNet Competitioncited by 23
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
- 2021QAIR: Practical Query-efficient Black-Box Attacks for Image Retrievalcited by 22
- 2021Adaptive Image Transformations for Transfer-based Adversarial Attackcited by 22
- 2022TextGrad: Advancing Robustness Evaluation in NLP by Gradient-Driven Optimizationcited by 21
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 20
- 2021Just Noticeable Difference for Deep Machine Visioncited by 19
- 2022Adversarial Attack on Attackers: Post-Process to Mitigate Black-Box Score-Based Query Attackscited by 19
- 2022On the Versatile Uses of Partial Distance Correlation in Deep Learningcited by 19
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021Context-Aware Transfer Attacks for Object Detectioncited by 18
- 2022Attacking deep networks with surrogate-based adversarial black-box methods is easycited by 18
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challengescited by 17
- 2021Back in Black: A Comparative Evaluation of Recent State-Of-The-Art Black-Box Attackscited by 16
- 2023Ensemble-based Blackbox Attacks on Dense Predictioncited by 16
- 2021Training Meta-Surrogate Model for Transferable Adversarial Attackcited by 15
- 2021Attack as the Best Defense: Nullifying Image-to-image Translation GANs via Limit-aware Adversarial Attackcited by 15
- 2024Robust Neural Information Retrieval: An Adversarial and Out-of-distribution Perspectivecited by 15
- 2023Mutual-modality Adversarial Attack with Semantic Perturbationcited by 14
- 2022Towards Transferable Unrestricted Adversarial Examples with Minimum Changescited by 13
- 2022Blackbox Attacks via Surrogate Ensemble Searchcited by 13
- 2023Boosting Black-box Attack to Deep Neural Networks with Conditional Diffusion Modelscited by 12
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domaincited by 12
- 2021Finding Optimal Tangent Points for Reducing Distortions of Hard-label Attackscited by 11
- 2021RamBoAttack: A Robust Query Efficient Deep Neural Network Decision Exploitcited by 11
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Priorcited by 11
- 2022Squeeze Training for Adversarial Robustnesscited by 10
- 2025Towards Model Resistant to Transferable Adversarial Examples via Trigger Activationcited by 10
- 2021Nonlinear Projection Based Gradient Estimation for Query Efficient Blackbox Attackscited by 9
- 2022Bandits for Structure Perturbation-based Black-box Attacks to Graph Neural Networks with Theoretical Guaranteescited by 9
- 2022On the Role of Generalization in Transferability of Adversarial Examplescited by 9
50 most cited of 121 All 121 (JSON)
- 2026SegPAR: Class-Centric Decision-Based Sparse Attack for Semantic Segmentation11 Aug 2026
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026Black-Box Continual Learning for Vision-Language Models22 Jun 2026
- 2026Accelerating Zeroth-Order Spectral Optimization with Partial Orthogonalization from Power Iteration9 May 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2025Black-box Optimization of LLM Outputs by Asking for Directions19 Oct 2025
- 2025Certifiably robust malware detectors by design10 Aug 2025
- 2025Exploiting Edge Features for Transferable Adversarial Attacks in Distributed Machine Learning9 Jul 2025
- 2025Accelerating Targeted Hard-Label Adversarial Attacks in Low-Query Black-Box Settings22 May 2025
- 2025Towards Model Resistant to Transferable Adversarial Examples via Trigger Activation20 Apr 2025
- 2025Overlap-Aware Feature Learning for Robust Unsupervised Domain Adaptation for 3D Semantic Segmentation2 Apr 2025
- 2025TenAd: A Tensor-based Low-rank Black Box Adversarial Attack for Video Classification1 Apr 2025
38 more
- 2025GSBAK: top-K Geometric Score-based Black-box Attack17 Mar 2025
- 2025ExtremeAIGC: Benchmarking LMM Vulnerability to AI-Generated Extremist Content13 Mar 2025
- 2025Amnesia as a Catalyst for Enhancing Black Box Pixel Attacks in Image Classification and Object Detection10 Feb 2025
- 2025Reinforcement Learning Platform for Adversarial Black-box Attacks with Custom Distortion Filters23 Jan 2025
- 2024Poor Man's Training on MCUs: A Memory-Efficient Quantized Back-Propagation-Free Approach7 Nov 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domain16 Oct 2024
- 2024Robust Neural Information Retrieval: An Adversarial and Out-of-distribution Perspective9 Jul 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Prior29 May 2024
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectors18 Apr 2024
- 2024Towards a Novel Perspective on Adversarial Examples Driven by Frequency16 Apr 2024
- 2024BSPA: Exploring Black-box Stealthy Prompt Attacks against Image Generators23 Feb 2024
- 2024Query-Based Adversarial Prompt Generation19 Feb 2024
- 2024PAL: Proxy-Guided Black-Box Attack on Large Language Models15 Feb 2024
- 2024FoolSDEdit: Deceptively Steering Your Edits Towards Targeted Attribute-aware Distribution6 Feb 2024
- 2024Privacy and Security Implications of Cloud-Based AI Services : A Survey31 Jan 2024
- 2024AdvGPS: Adversarial GPS for Multi-Agent Perception Attack30 Jan 2024
- 2024Left-right Discrepancy for Adversarial Attack on Stereo Networks14 Jan 2024
- 2024GE-AdvGAN: Improving the transferability of adversarial samples by gradient editing-based adversarial generative model11 Jan 2024
- 2023Mutual-modality Adversarial Attack with Semantic Perturbation20 Dec 2023
- 2023Make Them Spill the Beans! Coercive Knowledge Extraction from (Production) LLMs8 Dec 2023
- 2023Generating Visually Realistic Adversarial Patch5 Dec 2023
- 2023Towards Robust and Accurate Visual Prompting18 Nov 2023
- 2023SoK: Pitfalls in Evaluating Black-Box Attacks26 Oct 2023
- 2023DANAA: Towards transferable attacks with double adversarial neuron attribution16 Oct 2023
- 2023Boosting Black-box Attack to Deep Neural Networks with Conditional Diffusion Models11 Oct 2023
- 2023Raze to the Ground: Query-Efficient Adversarial HTML Attacks on Machine-Learning Phishing Webpage Detectors4 Oct 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 2023Structure Invariant Transformation for better Adversarial Transferability26 Sep 2023
- 2023DifAttack: Query-Efficient Black-Box Attack via Disentangled Feature Space26 Sep 2023
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Models26 May 2023
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistency23 Apr 2023
- 2023Ensemble-based Blackbox Attacks on Dense Prediction25 Mar 2023
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challenges24 Mar 2023
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensus16 Mar 2023
- 2023Data-Free Sketch-Based Image Retrieval14 Mar 2023
- 2023Decision-BADGE: Decision-based Adversarial Batch Attack with Directional Gradient Estimation9 Mar 2023
50 newest of 121 All 121 (JSON)
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 284
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
- 2025ExtremeAIGC: Benchmarking LMM Vulnerability to AI-Generated Extremist Contentcited by 1
- 2026Black-Box Continual Learning for Vision-Language Modelscited by 0
- 2026Black-Box Continual Learning for Vision-Language Models22 Jun 2026
- 2025ExtremeAIGC: Benchmarking LMM Vulnerability to AI-Generated Extremist Content13 Mar 2025
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Models26 May 2023
- 2024Query-Based Adversarial Prompt Generationcited by 62
- 2024Query-Based Adversarial Prompt Generation19 Feb 2024
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022Narcissus: A Practical Clean-Label Backdoor Attack with Limited Informationcited by 103
- 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
- 2023Structure Invariant Transformation for better Adversarial Transferabilitycited by 62
- 2021Meta Gradient Adversarial Attackcited by 55
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 49
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothnesscited by 38
- 2022Query-Efficient Black-box Adversarial Attacks Guided by a Transfer-based Priorcited by 38
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensuscited by 37
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
- 2022Transferable Adversarial Attack based on Integrated Gradientscited by 35
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
12 most cited of 108 All 108 (JSON)
- 2026SegPAR: Class-Centric Decision-Based Sparse Attack for Semantic Segmentation11 Aug 2026
- 2026Accelerating Zeroth-Order Spectral Optimization with Partial Orthogonalization from Power Iteration9 May 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2025Certifiably robust malware detectors by design10 Aug 2025
- 2025Exploiting Edge Features for Transferable Adversarial Attacks in Distributed Machine Learning9 Jul 2025
- 2025Accelerating Targeted Hard-Label Adversarial Attacks in Low-Query Black-Box Settings22 May 2025
- 2025Towards Model Resistant to Transferable Adversarial Examples via Trigger Activation20 Apr 2025
- 2025Overlap-Aware Feature Learning for Robust Unsupervised Domain Adaptation for 3D Semantic Segmentation2 Apr 2025
- 2025TenAd: A Tensor-based Low-rank Black Box Adversarial Attack for Video Classification1 Apr 2025
- 2025GSBAK: top-K Geometric Score-based Black-box Attack17 Mar 2025
- 2025Amnesia as a Catalyst for Enhancing Black Box Pixel Attacks in Image Classification and Object Detection10 Feb 2025
- 2024Poor Man's Training on MCUs: A Memory-Efficient Quantized Back-Propagation-Free Approach7 Nov 2024
12 newest of 108 All 108 (JSON)