A Survey of Black-Box Adversarial Attacks on Computer Vision Models
Not on the map. Why?
Abstract (arXiv)
Machine learning has seen tremendous advances in the past few years, which has lead to deep learning models being deployed in varied applications of day-to-day life. Attacks on such models using perturbations, particularly in real-life scenarios, pose a severe challenge to their applicability, pushing research into the direction which aims to enhance the robustness of these models. After the introduction of these perturbations by Szegedy et al. [1], significant amount of research has focused on the reliability of such models, primarily in two aspects - white-box, where the adversary has access to the targeted model and related parameters; and the black-box, which resembles a real-life scenario with the adversary having almost no knowledge of the model to be attacked. To provide a comprehensive security cover, it is essential to identify, study, and build defenses against such attacks. Hence, in this paper, we propose to present a comprehensive comparative study of various black-box adversarial attacks and defense techniques.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 8; 2023: 5; 2024: 9; 2025: 5; 2026: 1.
36 papers.
Sort:
By area:
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanationscited by 27
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022Pixle: a fast and effective black-box attack based on rearranging pixelscited by 20
- 2021On the Effectiveness of Small Input Noise for Defending Against Query-based Black-Box Attackscited by 17
- 2022Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Surveycited by 17
- 2021Back in Black: A Comparative Evaluation of Recent State-Of-The-Art Black-Box Attackscited by 16
- 2023Understanding and Improving Ensemble Adversarial Defensecited by 14
- 2021Black-box adversarial attacks using Evolution Strategiescited by 11
- 2021Selection of Source Images Heavily Influences the Effectiveness of Adversarial Attackscited by 6
- 2023SoK: Pitfalls in Evaluating Black-Box Attackscited by 6
24 more
- 2023Certifiable Black-Box Attacks with Randomized Adversarial Examples: Breaking Defenses with Provable Confidencecited by 5
- 2024Robustness and Visual Explanation for Black Box Image, Video, and ECG Signal Classification with Reinforcement Learningcited by 4
- 2025Adversarial Attacks against Neural Ranking Models via In-Context Learningcited by 4
- 2021Attention-Guided Black-box Adversarial Attacks with Large-Scale Multiobjective Evolutionary Optimizationcited by 3
- 2022RES-HD: Resilient Intelligent Fault Diagnosis Against Adversarial Attacks Using Hyper-Dimensional Computingcited by 3
- 2024Exploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolumecited by 3
- 2021Saliency Diversified Deep Ensemble for Robustness to Adversariescited by 2
- 2024Enhancing TinyML Security: Study of Adversarial Attack Transferabilitycited by 2
- 2024Edge-Only Universal Adversarial Attacks in Distributed Learningcited by 2
- 2025False Alarms, Real Damage: Adversarial Attacks Using LLM-based Models on Text-based Cyber Threat Intelligence Systemscited by 2
- 2022Red Teaming with Mind Reading: White-Box Adversarial Policies Against RL Agentscited by 1
- 2022Physics-Guided Adversarial Machine Learning for Aircraft Systems Simulationcited by 1
- 2024Transparency Attacks: How Imperceptible Image Layers Can Fool AI Perceptioncited by 1
- 2025Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategiescited by 1
- 2021Distributionally Robust Multi-Output Regression Rankingcited by 0
- 2022Evaluation of Four Black-box Adversarial Attacks and Some Query-efficient Improvement Analysiscited by 0
- 2022Distributed Black-box Attack: Do Not Overestimate Black-box Attackscited by 0
- 2023General Lipschitz: Certified Robustness Against Resolvable Semantic Transformations via Transformation-Dependent Randomized Smoothingcited by 0
- 2024TA3: Testing Against Adversarial Attacks on Machine Learning Modelscited by 0
- 2024Deep Model Merging: The Sister of Neural Network Interpretability -- A Surveycited by 0
- 2024PEAS: A Strategy for Crafting Transferable Adversarial Examplescited by 0
- 2025With Great Backbones Comes Great Adversarial Transferabilitycited by 0
- 2025Decoding Deception: Understanding Automatic Speech Recognition Vulnerabilities in Evasion and Poisoning Attackscited by 0
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Modelscited by 0
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Models3 Apr 2026
- 2025Decoding Deception: Understanding Automatic Speech Recognition Vulnerabilities in Evasion and Poisoning Attacks26 Sep 2025
- 2025Adversarial Attacks against Neural Ranking Models via In-Context Learning21 Aug 2025
- 2025False Alarms, Real Damage: Adversarial Attacks Using LLM-based Models on Text-based Cyber Threat Intelligence Systems5 Jul 2025
- 2025Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategies30 Jun 2025
- 2025With Great Backbones Comes Great Adversarial Transferability21 Jan 2025
- 2024Edge-Only Universal Adversarial Attacks in Distributed Learning15 Nov 2024
- 2024PEAS: A Strategy for Crafting Transferable Adversarial Examples20 Oct 2024
- 2024Deep Model Merging: The Sister of Neural Network Interpretability -- A Survey16 Oct 2024
- 2024TA3: Testing Against Adversarial Attacks on Machine Learning Models6 Oct 2024
- 2024Enhancing TinyML Security: Study of Adversarial Attack Transferability16 Jul 2024
- 2024Robustness and Visual Explanation for Black Box Image, Video, and ECG Signal Classification with Reinforcement Learning27 Mar 2024
24 more
- 2024Exploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolume8 Mar 2024
- 2024Transparency Attacks: How Imperceptible Image Layers Can Fool AI Perception29 Jan 2024
- 2024Black-Box Access is Insufficient for Rigorous AI Audits25 Jan 2024
- 2023Understanding and Improving Ensemble Adversarial Defense27 Oct 2023
- 2023SoK: Pitfalls in Evaluating Black-Box Attacks26 Oct 2023
- 2023General Lipschitz: Certified Robustness Against Resolvable Semantic Transformations via Transformation-Dependent Randomized Smoothing17 Aug 2023
- 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanations16 Aug 2023
- 2023Certifiable Black-Box Attacks with Randomized Adversarial Examples: Breaking Defenses with Provable Confidence10 Apr 2023
- 2022Distributed Black-box Attack: Do Not Overestimate Black-box Attacks28 Oct 2022
- 2022Physics-Guided Adversarial Machine Learning for Aircraft Systems Simulation7 Sep 2022
- 2022Red Teaming with Mind Reading: White-Box Adversarial Policies Against RL Agents5 Sep 2022
- 2022Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Survey16 Jun 2022
- 2022RES-HD: Resilient Intelligent Fault Diagnosis Against Adversarial Attacks Using Hyper-Dimensional Computing14 Mar 2022
- 2022A Survey of Adversarial Defences and Robustness in NLP12 Mar 2022
- 2022Pixle: a fast and effective black-box attack based on rearranging pixels4 Feb 2022
- 2022Evaluation of Four Black-box Adversarial Attacks and Some Query-efficient Improvement Analysis13 Jan 2022
- 2021Saliency Diversified Deep Ensemble for Robustness to Adversaries7 Dec 2021
- 2021Trustworthy AI: From Principles to Practices4 Oct 2021
- 2021Back in Black: A Comparative Evaluation of Recent State-Of-The-Art Black-Box Attacks29 Sep 2021
- 2021Distributionally Robust Multi-Output Regression Ranking27 Sep 2021
- 2021Selection of Source Images Heavily Influences the Effectiveness of Adversarial Attacks14 Jun 2021
- 2021Black-box adversarial attacks using Evolution Strategies30 Apr 2021
- 2021Attention-Guided Black-box Adversarial Attacks with Large-Scale Multiobjective Evolutionary Optimization19 Jan 2021
- 2021On the Effectiveness of Small Input Noise for Defending Against Query-based Black-Box Attacks13 Jan 2021
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2023Interpretability Benchmark for Evaluating Spatial Misalignment of Prototypical Parts Explanationscited by 27
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022Pixle: a fast and effective black-box attack based on rearranging pixelscited by 20
- 2021On the Effectiveness of Small Input Noise for Defending Against Query-based Black-Box Attackscited by 17
- 2022Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Surveycited by 17
- 2021Back in Black: A Comparative Evaluation of Recent State-Of-The-Art Black-Box Attackscited by 16
- 2023Understanding and Improving Ensemble Adversarial Defensecited by 14
- 2021Black-box adversarial attacks using Evolution Strategiescited by 11
- 2021Selection of Source Images Heavily Influences the Effectiveness of Adversarial Attackscited by 6
- 2023SoK: Pitfalls in Evaluating Black-Box Attackscited by 6
12 most cited of 33 All 33 (JSON)
- 2025Decoding Deception: Understanding Automatic Speech Recognition Vulnerabilities in Evasion and Poisoning Attacks26 Sep 2025
- 2025Adversarial Attacks against Neural Ranking Models via In-Context Learning21 Aug 2025
- 2025False Alarms, Real Damage: Adversarial Attacks Using LLM-based Models on Text-based Cyber Threat Intelligence Systems5 Jul 2025
- 2025Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategies30 Jun 2025
- 2025With Great Backbones Comes Great Adversarial Transferability21 Jan 2025
- 2024Edge-Only Universal Adversarial Attacks in Distributed Learning15 Nov 2024
- 2024PEAS: A Strategy for Crafting Transferable Adversarial Examples20 Oct 2024
- 2024Deep Model Merging: The Sister of Neural Network Interpretability -- A Survey16 Oct 2024
- 2024TA3: Testing Against Adversarial Attacks on Machine Learning Models6 Oct 2024
- 2024Enhancing TinyML Security: Study of Adversarial Attack Transferability16 Jul 2024
- 2024Robustness and Visual Explanation for Black Box Image, Video, and ECG Signal Classification with Reinforcement Learning27 Mar 2024
- 2024Exploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolume8 Mar 2024
12 newest of 33 All 33 (JSON)