Adversarial Machine Learning in Image Classification: A Survey Towards the Defender's Perspective
Not on the map. Why?
Abstract (arXiv)
Deep Learning algorithms have achieved the state-of-the-art performance for Image Classification and have been used even in security-critical applications, such as biometric recognition systems and self-driving cars. However, recent works have shown those algorithms, which can even surpass the human capabilities, are vulnerable to adversarial examples. In Computer Vision, adversarial examples are images containing subtle perturbations generated by malicious optimization algorithms in order to fool classifiers. As an attempt to mitigate these vulnerabilities, numerous countermeasures have been constantly proposed in literature. Nevertheless, devising an efficient defense mechanism has proven to be a difficult task, since many approaches have already shown to be ineffective to adaptive attackers. Thus, this self-containing paper aims to provide all readerships with a review of the latest research progress on Adversarial Machine Learning in Image Classification, however with a defender's perspective. Here, novel taxonomies for categorizing adversarial attacks and defenses are introduced and discussions about the existence of adversarial examples are provided. Further, in contrast to exisiting surveys, it is also given relevant guidance that should be taken into consideration by researchers when devising and evaluating defenses. Finally, based on the reviewed literature, it is discussed some promising paths for future research.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 11; 2023: 10; 2024: 16; 2025: 6; 2026: 7.
58 papers.
Sort:
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 51
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
- 2022On the Robustness of Safe Reinforcement Learning under Observational Perturbationscited by 38
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 24
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021Adversarial Attacks against Windows PE Malware Detection: A Survey of the State-of-the-Artcited by 18
- 2022Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Surveycited by 17
- 2021Back in Black: A Comparative Evaluation of Recent State-Of-The-Art Black-Box Attackscited by 16
- 2024PB-UAP: Hybrid Universal Adversarial Attack For Image Segmentationcited by 14
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Surveycited by 11
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustnesscited by 9
38 more
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunitiescited by 9
- 2022Reliable Robustness Evaluation via Automatically Constructed Attack Ensemblescited by 6
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Riskscited by 6
- 2024A Survey of Privacy-Preserving Model Explanations: Privacy Risks, Attacks, and Countermeasurescited by 6
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarkingcited by 5
- 2025Energy-Latency Attacks: A New Adversarial Threat to Deep Learningcited by 5
- 2022Risk-Driven Design of Perception Systemscited by 4
- 2024Secure Traffic Sign Recognition: An Attention-Enabled Universal Image Inpainting Mechanism against Light Patch Attackscited by 4
- 2022Adversarial Attacks on Speech Recognition Systems for Mission-Critical Applications: A Surveycited by 3
- 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challengescited by 3
- 2024A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligencecited by 3
- 2024Exploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolumecited by 3
- 2024RenderBender: A Survey on Adversarial Attacks Using Differentiable Renderingcited by 3
- 2023Evaluating Adversarial Robustness on Document Image Classificationcited by 2
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directionscited by 2
- 2024EaTVul: ChatGPT-based Evasion Attack Against Software Vulnerability Detectioncited by 2
- 2024Combining Machine Learning Defenses without Conflictscited by 2
- 2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systemscited by 2
- 2021Fortify Machine Learning Production Systems: Detect and Classify Adversarial Attackscited by 1
- 2021Image classifiers can not be made robust to small perturbationscited by 1
- 2022A Simple Structure For Building A Robust Modelcited by 1
- 2022Guiding the retraining of convolutional neural networks against adversarial inputscited by 1
- 2022Towards Robust Recommender Systems via Triple Cooperative Defensecited by 1
- 2023EnTri: Ensemble Learning with Tri-level Representations for Explainable Scene Recognitioncited by 1
- 2024Investigating and unmasking feature-level vulnerabilities of CNNs to adversarial perturbationscited by 1
- 2025Adversarial Defense in Cybersecurity: A Systematic Review of GANs for Threat Detection and Mitigationcited by 1
- 2026TestifAI: Tomography-Based Testing for Deep Learning Systemscited by 1
- 2021BOSS: Bidirectional One-Shot Synthesis of Adversarial Examplescited by 0
- 2021Enhanced countering adversarial attacks via input denoising and feature restoringcited by 0
- 2023Toward Defensive Letter Designcited by 0
- 2023Attack Tree Analysis for Adversarial Evasion Attackscited by 0
- 2024Securing Recommender System via Cooperative Trainingcited by 0
- 2024Counter-Samples: A Stateless Strategy to Neutralize Black Box Adversarial Attackscited by 0
- 2024Adversarial Attacks and Defense for Conversation Entailment Taskcited by 0
- 2024Robust Explainable Recommendationcited by 0
- 2024A constrained optimization approach to improve robustness of neural networkscited by 0
- 2024Hiding-in-Plain-Sight (HiPS) Attack on CLIP for Targetted Object Removal from Imagescited by 0
- 2025Real-Time Privacy Risk Measurement with Privacy Tokens for Gradient Leakagecited by 0
50 most cited of 58 All 58 (JSON)
- 2026TestifAI: Tomography-Based Testing for Deep Learning Systems19 Aug 2026
- 2026SoK: A Comprehensive Analysis of the Current Status of Neural Tangent Generalization Attacks with Research Directions12 May 2026
- 2026Auto-ART: Structured Literature Synthesis and Automated Adversarial Robustness Testing22 Apr 2026
- 2026Multi-Task Anti-Causal Learning for Reconstructing Urban Events from Residents' Reports12 Mar 2026
- 2026Identifying Adversary Characteristics from an Observed Attack5 Mar 2026
- 2026Multiclass Calibration Assessment and Recalibration of Probability Predictions via the Linear Log Odds Calibration Function20 Feb 2026
- 2026DDSA: Dual-Domain Strategic Attack for Spatial-Temporal Efficiency in Adversarial Robustness Testing18 Jan 2026
- 2025Adversarial Defense in Cybersecurity: A Systematic Review of GANs for Threat Detection and Mitigation24 Sep 2025
- 2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systems22 Aug 2025
- 2025Energy-Latency Attacks: A New Adversarial Threat to Deep Learning6 Mar 2025
- 2025From Pixels to Trajectory: Universal Adversarial Example Detection via Temporal Imprints6 Mar 2025
- 2025Optimistic Gradient Learning with Hessian Corrections for High-Dimensional Black-Box Optimization7 Feb 2025
38 more
- 2025Real-Time Privacy Risk Measurement with Privacy Tokens for Gradient Leakage5 Feb 2025
- 2024PB-UAP: Hybrid Universal Adversarial Attack For Image Segmentation21 Dec 2024
- 2024Combining Machine Learning Defenses without Conflicts14 Nov 2024
- 2024RenderBender: A Survey on Adversarial Attacks Using Differentiable Rendering14 Nov 2024
- 2024Hiding-in-Plain-Sight (HiPS) Attack on CLIP for Targetted Object Removal from Images16 Oct 2024
- 2024A constrained optimization approach to improve robustness of neural networks18 Sep 2024
- 2024Secure Traffic Sign Recognition: An Attention-Enabled Universal Image Inpainting Mechanism against Light Patch Attacks6 Sep 2024
- 2024EaTVul: ChatGPT-based Evasion Attack Against Software Vulnerability Detection27 Jul 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
- 2024Investigating and unmasking feature-level vulnerabilities of CNNs to adversarial perturbations31 May 2024
- 2024Robust Explainable Recommendation3 May 2024
- 2024Adversarial Attacks and Defense for Conversation Entailment Task1 May 2024
- 2024A Survey of Privacy-Preserving Model Explanations: Privacy Risks, Attacks, and Countermeasures31 Mar 2024
- 2024Counter-Samples: A Stateless Strategy to Neutralize Black Box Adversarial Attacks14 Mar 2024
- 2024Exploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolume8 Mar 2024
- 2024A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence20 Feb 2024
- 2024Securing Recommender System via Cooperative Training23 Jan 2024
- 2023Attack Tree Analysis for Adversarial Evasion Attacks28 Dec 2023
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Risks7 Dec 2023
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities12 Oct 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 2023Toward Defensive Letter Design4 Sep 2023
- 2023EnTri: Ensemble Learning with Tri-level Representations for Explainable Scene Recognition23 Jul 2023
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking21 Jun 2023
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A survey6 Jun 2023
- 2023Evaluating Adversarial Robustness on Document Image Classification24 Apr 2023
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustness17 Mar 2023
- 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challenges27 Nov 2022
- 2022Reliable Robustness Evaluation via Automatically Constructed Attack Ensembles23 Nov 2022
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Survey3 Nov 2022
- 2022Towards Robust Recommender Systems via Triple Cooperative Defense25 Oct 2022
- 2022A Survey on Physical Adversarial Attack in Computer Vision28 Sep 2022
- 2022Guiding the retraining of convolutional neural networks against adversarial inputs8 Jul 2022
- 2022Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Survey16 Jun 2022
- 2022On the Robustness of Safe Reinforcement Learning under Observational Perturbations29 May 2022
- 2022Risk-Driven Design of Perception Systems21 May 2022
- 2022A Simple Structure For Building A Robust Model25 Apr 2022
- 2022Adversarial Attacks on Speech Recognition Systems for Mission-Critical Applications: A Survey22 Feb 2022
50 newest of 58 All 58 (JSON)
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 51
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
- 2022On the Robustness of Safe Reinforcement Learning under Observational Perturbationscited by 38
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 24
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021Adversarial Attacks against Windows PE Malware Detection: A Survey of the State-of-the-Artcited by 18
- 2022Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Surveycited by 17
- 2021Back in Black: A Comparative Evaluation of Recent State-Of-The-Art Black-Box Attackscited by 16
- 2024PB-UAP: Hybrid Universal Adversarial Attack For Image Segmentationcited by 14
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Surveycited by 11
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustnesscited by 9
12 most cited of 58 All 58 (JSON)
- 2026TestifAI: Tomography-Based Testing for Deep Learning Systems19 Aug 2026
- 2026SoK: A Comprehensive Analysis of the Current Status of Neural Tangent Generalization Attacks with Research Directions12 May 2026
- 2026Auto-ART: Structured Literature Synthesis and Automated Adversarial Robustness Testing22 Apr 2026
- 2026Multi-Task Anti-Causal Learning for Reconstructing Urban Events from Residents' Reports12 Mar 2026
- 2026Identifying Adversary Characteristics from an Observed Attack5 Mar 2026
- 2026Multiclass Calibration Assessment and Recalibration of Probability Predictions via the Linear Log Odds Calibration Function20 Feb 2026
- 2026DDSA: Dual-Domain Strategic Attack for Spatial-Temporal Efficiency in Adversarial Robustness Testing18 Jan 2026
- 2025Adversarial Defense in Cybersecurity: A Systematic Review of GANs for Threat Detection and Mitigation24 Sep 2025
- 2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systems22 Aug 2025
- 2025Energy-Latency Attacks: A New Adversarial Threat to Deep Learning6 Mar 2025
- 2025From Pixels to Trajectory: Universal Adversarial Example Detection via Temporal Imprints6 Mar 2025
- 2025Optimistic Gradient Learning with Hessian Corrections for High-Dimensional Black-Box Optimization7 Feb 2025
12 newest of 58 All 58 (JSON)