Simple Black-box Adversarial Attacks
Not on the map. Why?
Abstract (arXiv)
We propose an intriguingly simple method for the construction of adversarial images in the black-box setting. In constrast to the white-box scenario, constructing black-box adversarial images has the additional constraint on query budget, and efficient attacks remain an open problem to date. With only the mild assumption of continuous-valued confidence scores, our highly query-efficient algorithm utilizes the following simple iterative principle: we randomly sample a vector from a predefined orthonormal basis and either add or subtract it to the target image. Despite its simplicity, the proposed method can be used for both untargeted and targeted attacks -- resulting in previously unprecedented query efficiency in both settings. We demonstrate the efficacy and efficiency of our algorithm on several real world settings including the Google Cloud Vision API. We argue that our proposed algorithm should serve as a strong baseline for future black-box attacks, in particular because it is extremely fast and its implementation requires less than 20 lines of PyTorch code.
Key facts. Cited by 251 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 43; 2023: 47; 2024: 53; 2025: 35; 2026: 22.
251 papers.
Sort:
By area:
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 137
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradientscited by 96
- 2021Adversarial Sticker: A Stealthy Attack Method in the Physical Worldcited by 93
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trendscited by 84
- 2021Adversarial Laser Beam: Effective Physical-World Attack to DNNs in a Blinkcited by 75
- 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
- 2023Boosting Adversarial Transferability by Block Shuffle and Rotationcited by 64
- 2023Black Box Adversarial Prompting for Foundation Modelscited by 62
- 2023Structure Invariant Transformation for better Adversarial Transferabilitycited by 62
- 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 60
- 2021Adversarial Robustness Comparison of Vision Transformer and MLP-Mixer to CNNscited by 57
38 more
- 2022Shape-invariant 3D Adversarial Point Cloudscited by 50
- 2022Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations?cited by 49
- 2021Random Noise Defense Against Query-Based Black-Box Attackscited by 47
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Modelscited by 40
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attackscited by 39
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
- 2021Imperceptible Transfer Attack and Defense on 3D Point Cloud Classificationcited by 36
- 2023Improving the Transferability of Adversarial Samples by Path-Augmented Methodcited by 36
- 2021ModelDiff: Testing-Based DNN Similarity Comparison for Model Reuse Detectioncited by 33
- 2021GeCo: Quality Counterfactual Explanations in Real Timecited by 32
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defensescited by 30
- 2021Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networkscited by 29
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2023Generalizable Black-Box Adversarial Attack with Meta Learningcited by 29
- 2023Adversarial Illusions in Multi-Modal Embeddingscited by 29
- 2021AdvRush: Searching for Adversarially Robust Neural Architecturescited by 28
- 2021Combating Adversaries with Anti-Adversariescited by 27
- 2021Delving into Data: Effectively Substitute Training for Black-box Attackcited by 27
- 2022Universal Adversarial Examples in Remote Sensing: Methodology and Benchmarkcited by 24
- 2022Rank List Sensitivity of Recommender Systems to Interaction Perturbationscited by 20
- 2022Adversarial Attack and Defense of YOLO Detectors in Autonomous Driving Scenarioscited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 20
- 2022Adversarial Attack on Attackers: Post-Process to Mitigate Black-Box Score-Based Query Attackscited by 19
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021Context-Aware Transfer Attacks for Object Detectioncited by 18
- 2022Boosting 3D Adversarial Attacks with Attacking On Frequencycited by 18
- 2022Attacking deep networks with surrogate-based adversarial black-box methods is easycited by 18
- 2024Improved Generation of Adversarial Examples Against Safety-aligned LLMscited by 18
- 2025Adversarial Training of Reward Modelscited by 18
- 2021On the Effectiveness of Small Input Noise for Defending Against Query-based Black-Box Attackscited by 17
- 2022Zero-Query Transfer Attacks on Context-Aware Object Detectorscited by 17
- 2022Robust Structured Declarative Classifiers for 3D Point Clouds: Defending Adversarial Attacks with Implicit Gradientscited by 17
- 2023Ensemble-based Blackbox Attacks on Dense Predictioncited by 16
- 2021Meta-Learning with Neural Tangent Kernelscited by 15
- 2021Convolutional Normalization: Improving Deep Convolutional Network Robustness and Trainingcited by 15
- 2022Towards Good Practices in Evaluating Transfer Adversarial Attackscited by 15
- 2024A Short Survey on Importance Weighting for Machine Learningcited by 15
- 2021On Robustness of Neural Semantic Parserscited by 14
50 most cited of 251 All 251 (JSON)
- 2026Mitigating Black-Box Score-Based Query Attacks via Gradient Confusion12 Oct 2026
- 2026One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs27 Sep 2026
- 2026Reinforcement Learning Inspired Black-box Adversarial Attacks for Computer Vision21 Sep 2026
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026ARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake Detectors16 Jul 2026
- 2026Random Logit Scaling: Defending Deep Neural Networks Against Black-Box Score-Based Adversarial Example Attacks16 Jul 2026
- 2026Rendering-Aware Bayesian 3D Gaussian Splatting with Native Uncertainty and Adaptive Complexity Control6 Jul 2026
- 2026Adaptive Causal Alignment for High-Confidence Adversarial Training2 Jun 2026
- 2026Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms26 May 2026
- 2026Opportunistic Target Selection: Early Directional Commitment for Query-Efficient Black-Box Adversarial Attacks25 May 2026
- 2026Redefining AI Red Teaming in the Agentic Era: From Weeks to Hours5 May 2026
- 2026Almost for Free: Crafting Adversarial Examples with Convolutional Image Filters1 May 2026
38 more
- 2026Adversarial Label Invariant Graph Data Augmentations for Out-of-Distribution Generalization9 Apr 2026
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Models3 Apr 2026
- 2026AdvSplat: Adversarial Attacks on Feed-Forward Gaussian Splatting Models24 Mar 2026
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?11 Mar 2026
- 2026RobPI: Robust Private Inference against Malicious Client23 Feb 2026
- 2026Operational Robustness of LLMs on Code Generation21 Feb 2026
- 2026Dashed Line Defense: Plug-And-Play Defense Against Adaptive Score-Based Query Attacks9 Feb 2026
- 2026Just Noticeable Difference Modeling for Deep Visual Features29 Jan 2026
- 2026ARMOR: Agentic Reasoning for Methods Orchestration and Reparameterization for Robust Adversarial Attacks26 Jan 2026
- 2026Low-Cost Hard-Label Adversarial Attack with Theoretical Foundations17 Jan 2026
- 2025FBA2D: Frequency-based Black-box Attack for AI-generated Image Detection10 Dec 2025
- 2025SPOOF: Simple Pixel Operations for Out-of-Distribution Fooling5 Dec 2025
- 2025Power Homotopy for Zeroth-Order Non-Convex Optimizations17 Nov 2025
- 2025Shedding Light on VLN Robustness: A Black-box Framework for Indoor Lighting-based Adversarial Attack17 Nov 2025
- 2025Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detection22 Oct 2025
- 2025FeatureFool: Zero-Query Fooling of Video Models via Feature Map21 Oct 2025
- 2025Sequence-Preserving Dual-FoV Defense for Traffic Sign and Light Recognition in Autonomous Vehicles3 Oct 2025
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025Adversarial Patch Attack for Ship Detection via Localized Augmentation29 Aug 2025
- 2025Mini-Batch Robustness Verification of Deep Neural Networks21 Aug 2025
- 2025Non-Adaptive Adversarial Face Generation16 Jul 2025
- 2025Exploiting Edge Features for Transferable Adversarial Attacks in Distributed Machine Learning9 Jul 2025
- 2025Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategies30 Jun 2025
- 2025VLMInferSlow: Evaluating the Efficiency Robustness of Large Vision-Language Models as a Service18 Jun 2025
- 2025PatchGuard: Adversarially Robust Anomaly Detection and Localization through Vision Transformers and Pseudo Anomalies10 Jun 2025
- 2025How stealthy is stealthy? Studying the Efficacy of Black-Box Adversarial Attacks in the Real World3 Jun 2025
- 2025Privacy Leaks by Adversaries: Adversarial Iterations for Membership Inference Attack3 Jun 2025
- 2025Black-box Adversarial Attacks on CNN-based SLAM Algorithms30 May 2025
- 2025Are Time-Series Foundation Models Deployment-Ready? A Systematic Study of Adversarial Robustness Across Domains26 May 2025
- 2025A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detection19 May 2025
- 2025LatentStealth: Unnoticeable and Efficient Adversarial Attacks on Expressive Human Pose and Shape Estimation17 May 2025
- 2025DP-TRAE: A Dual-Phase Merging Transferable Reversible Adversarial Example for Image Privacy Protection11 May 2025
- 2025Towards Model Resistant to Transferable Adversarial Examples via Trigger Activation20 Apr 2025
- 2025RDI: An adversarial robustness evaluation metric for deep neural networks based on model statistical features16 Apr 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025Adversarial Training of Reward Models8 Apr 2025
- 2025GSBAK: top-K Geometric Score-based Black-box Attack17 Mar 2025
- 2025Boosting the Local Invariance for Better Adversarial Transferability8 Mar 2025
50 newest of 251 All 251 (JSON)
- 2023Black Box Adversarial Prompting for Foundation Modelscited by 62
- 2024Improved Generation of Adversarial Examples Against Safety-aligned LLMscited by 18
- 2024Red-Teaming Segment Anything Modelcited by 4
- 2025Privacy Leaks by Adversaries: Adversarial Iterations for Membership Inference Attackcited by 2
- 2024Precision Guided Approach to Mitigate Data Poisoning Attacks in Federated Learningcited by 1
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Modelscited by 0
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Models3 Apr 2026
- 2025Privacy Leaks by Adversaries: Adversarial Iterations for Membership Inference Attack3 Jun 2025
- 2024Improved Generation of Adversarial Examples Against Safety-aligned LLMs28 May 2024
- 2024Precision Guided Approach to Mitigate Data Poisoning Attacks in Federated Learning5 Apr 2024
- 2024Red-Teaming Segment Anything Model2 Apr 2024
- 2023Black Box Adversarial Prompting for Foundation Models8 Feb 2023
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trendscited by 84
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Modelscited by 40
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attackscited by 39
- 2023RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Modelscited by 7
- 2025VLMInferSlow: Evaluating the Efficiency Robustness of Large Vision-Language Models as a Servicecited by 3
- 2025VLMInferSlow: Evaluating the Efficiency Robustness of Large Vision-Language Models as a Service18 Jun 2025
- 2024Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks24 Nov 2024
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends10 Jul 2024
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models8 Jun 2024
- 2023RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models21 Apr 2023
- 2025Adversarial Training of Reward Modelscited by 18
- 2025Adversarial Training of Reward Models8 Apr 2025
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 137
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2021Adversarial Sticker: A Stealthy Attack Method in the Physical Worldcited by 93
- 2021Adversarial Laser Beam: Effective Physical-World Attack to DNNs in a Blinkcited by 75
- 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
- 2023Boosting Adversarial Transferability by Block Shuffle and Rotationcited by 64
- 2023Structure Invariant Transformation for better Adversarial Transferabilitycited by 62
- 2021Adversarial Robustness Comparison of Vision Transformer and MLP-Mixer to CNNscited by 57
- 2022Shape-invariant 3D Adversarial Point Cloudscited by 50
- 2022Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations?cited by 49
- 2021Random Noise Defense Against Query-Based Black-Box Attackscited by 47
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
12 most cited of 228 All 228 (JSON)
- 2026Mitigating Black-Box Score-Based Query Attacks via Gradient Confusion12 Oct 2026
- 2026One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs27 Sep 2026
- 2026Random Logit Scaling: Defending Deep Neural Networks Against Black-Box Score-Based Adversarial Example Attacks16 Jul 2026
- 2026Rendering-Aware Bayesian 3D Gaussian Splatting with Native Uncertainty and Adaptive Complexity Control6 Jul 2026
- 2026Adaptive Causal Alignment for High-Confidence Adversarial Training2 Jun 2026
- 2026Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms26 May 2026
- 2026Opportunistic Target Selection: Early Directional Commitment for Query-Efficient Black-Box Adversarial Attacks25 May 2026
- 2026Almost for Free: Crafting Adversarial Examples with Convolutional Image Filters1 May 2026
- 2026Adversarial Label Invariant Graph Data Augmentations for Out-of-Distribution Generalization9 Apr 2026
- 2026AdvSplat: Adversarial Attacks on Feed-Forward Gaussian Splatting Models24 Mar 2026
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?11 Mar 2026
- 2026RobPI: Robust Private Inference against Malicious Client23 Feb 2026
12 newest of 228 All 228 (JSON)