Adversarial Examples: Opportunities and Challenges
Not on the map. Why?
Abstract (arXiv)
Deep neural networks (DNNs) have shown huge superiority over humans in image recognition, speech processing, autonomous vehicles and medical diagnosis. However, recent studies indicate that DNNs are vulnerable to adversarial examples (AEs), which are designed by attackers to fool deep learning models. Different from real examples, AEs can mislead the model to predict incorrect outputs while hardly be distinguished by human eyes, therefore threaten security-critical deep-learning applications. In recent years, the generation and defense of AEs have become a research hotspot in the field of artificial intelligence (AI) security. This article reviews the latest research progress of AEs. First, we introduce the concept, cause, characteristics and evaluation metrics of AEs, then give a survey on the state-of-the-art AE generation methods with the discussion of advantages and disadvantages. After that, we review the existing defenses and discuss their limitations. Finally, future research opportunities and challenges on AEs are prospected.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 11; 2023: 14; 2024: 13; 2025: 8; 2026: 2.
62 papers.
Sort:
By area:
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trendscited by 82
- 2023A Survey on Transferability of Adversarial Examples across Deep Neural Networkscited by 43
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensuscited by 37
- 2022On the Real-World Adversarial Robustness of Real-Time Semantic Segmentation Models for Autonomous Drivingcited by 30
- 2022Fooling the Eyes of Autonomous Vehicles: Robust Physical Adversarial Examples Against Traffic Sign Recognition Systemscited by 27
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 24
- 2021Robustness of on-device Models: Adversarial Attack to Deep Learning Models on Android Appscited by 19
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2021Adversarial Attacks against Windows PE Malware Detection: A Survey of the State-of-the-Artcited by 18
- 2021Detecting Adversarial Examples by Input Transformations, Defense Perturbations, and Votingcited by 16
- 2021Security and Privacy for Artificial Intelligence: Opportunities and Challengescited by 16
38 more
- 2023Adv-Bot: Realistic Adversarial Botnet Attacks against Network Intrusion Detection Systemscited by 14
- 2022On the Robustness of Bayesian Neural Networks to Adversarial Attackscited by 12
- 2021Towards a Robust and Trustworthy Machine Learning System Development: An Engineering Perspectivecited by 9
- 2021Demystifying the Transferability of Adversarial Attacks in Computer Networkscited by 9
- 2023SoK: Realistic Adversarial Attacks and Defenses for Intelligent Network Intrusion Detectioncited by 9
- 2023In Search of the Long-Tail: Systematic Generation of Long-Tail Inferential Knowledge via Logical Rule Guided Searchcited by 9
- 2022CARLA-GeAR: a Dataset Generator for a Systematic Evaluation of Adversarial Robustness of Vision Modelscited by 8
- 2023State-of-the-art optical-based physical adversarial attacks for deep learning computer vision systemscited by 8
- 2021Data-Centric Engineering: integrating simulation, machine learning and statistics. Challenges and Opportunitiescited by 7
- 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AIcited by 7
- 2022Towards a Fair Comparison and Realistic Evaluation Framework of Android Malware Detectors based on Static Analysis and Machine Learningcited by 6
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systemscited by 6
- 2024Structure-Preserving Physics-Informed Neural Networks With Energy or Lyapunov Structurecited by 6
- 2024Understanding Model Ensemble in Transferable Adversarial Attackcited by 6
- 2022Resisting Deep Learning Models Against Adversarial Attack Transferability via Feature Randomizationcited by 5
- 2023Towards Robust and Accurate Visual Promptingcited by 5
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
- 2021Attention-Guided Black-box Adversarial Attacks with Large-Scale Multiobjective Evolutionary Optimizationcited by 3
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Surveycited by 3
- 2023Adversary Aware Continual Learningcited by 3
- 2024Table Integration in Data Lakes Unleashed: Pairwise Integrability Judgment, Integrable Set Discovery, and Multi-Tuple Conflict Resolutioncited by 3
- 2021Adversarial Examples Detection with Bayesian Neural Networkcited by 2
- 2022Employing Deep Ensemble Learning for Improving the Security of Computer Networks against Adversarial Attackscited by 2
- 2024CPSDBench: A Large Language Model Evaluation Benchmark and Baseline for Chinese Public Security Domaincited by 2
- 2024Edge Detectors Can Make Deep Convolutional Neural Networks More Robustcited by 2
- 2021PICA: A Pixel Correlation-based Attentional Black-box Adversarial Attackcited by 1
- 2021STARdom: an architecture for trusted and secure human-centered manufacturing systemscited by 1
- 2023The Pros and Cons of Adversarial Robustnesscited by 1
- 2024Cloud-based XAI Services for Assessing Open Repository Models Under Adversarial Attackscited by 1
- 2025CP-uniGuard: A Unified, Probability-Agnostic, and Adaptive Framework for Malicious Agent Detection and Defense in Multi-Agent Embodied Perception Systemscited by 1
- 2025Wormhole Dynamics in Deep Neural Networkscited by 1
- 2025A Versatile Framework for Designing Group-Sparse Adversarial Attackscited by 1
- 2026Hierarchically Robust Zero-shot Vision-language Modelscited by 1
- 2021Deep Bayesian Image Set Classification: A Defence Approach against Adversarial Attackscited by 0
- 2021Enhanced countering adversarial attacks via input denoising and feature restoringcited by 0
- 2021Using a GAN to Generate Adversarial Examples to Facial Image Recognitioncited by 0
- 2022Robust DNN Surrogate Models with Uncertainty Quantification via Adversarial Trainingcited by 0
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunitiescited by 0
50 most cited of 62 All 62 (JSON)
- 2026Risk and Anomaly Identification for Distribution Network Optimal Operation Based on Reinforcement Learning and Uncertainty Quantification3 Sep 2026
- 2026Hierarchically Robust Zero-shot Vision-language Models20 Apr 2026
- 2025Adversarial Robustness in Zero-Shot Learning:An Empirical Study on Class and Concept-Level Vulnerabilities21 Dec 2025
- 2025Adversarially Robust Detection of Harmful Online Content: A Computational Design Science Approach19 Dec 2025
- 2025A Versatile Framework for Designing Group-Sparse Adversarial Attacks18 Oct 2025
- 2025Wormhole Dynamics in Deep Neural Networks20 Aug 2025
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025The Endless Tuning. An Artificial Intelligence Design To Avoid Human Replacement and Trace Back Responsibilities20 Jul 2025
- 2025CP-uniGuard: A Unified, Probability-Agnostic, and Adaptive Framework for Malicious Agent Detection and Defense in Multi-Agent Embodied Perception Systems28 Jun 2025
- 2025Vulnerability Disclosure through Adaptive Black-Box Adversarial Attacks on NIDS25 Jun 2025
- 2024Backdoor attacks on DNN and GBDT -- A Case Study from the insurance domain11 Dec 2024
- 2024Table Integration in Data Lakes Unleashed: Pairwise Integrability Judgment, Integrable Set Discovery, and Multi-Tuple Conflict Resolution30 Nov 2024
38 more
- 2024Deep Model Merging: The Sister of Neural Network Interpretability -- A Survey16 Oct 2024
- 2024Understanding Model Ensemble in Transferable Adversarial Attack9 Oct 2024
- 2024Linking in Style: Understanding learned features in deep learning models25 Sep 2024
- 2024FedAT: Federated Adversarial Training for Distributed Insider Threat Detection19 Sep 2024
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends10 Jul 2024
- 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AI22 Apr 2024
- 2024Impart: An Imperceptible and Effective Label-Specific Backdoor Attack18 Mar 2024
- 2024Edge Detectors Can Make Deep Convolutional Neural Networks More Robust26 Feb 2024
- 2024CPSDBench: A Large Language Model Evaluation Benchmark and Baseline for Chinese Public Security Domain11 Feb 2024
- 2024Cloud-based XAI Services for Assessing Open Repository Models Under Adversarial Attacks22 Jan 2024
- 2024Structure-Preserving Physics-Informed Neural Networks With Energy or Lyapunov Structure10 Jan 2024
- 2023AIJack: Let's Hijack AI! Security and Privacy Risk Simulator for Machine Learning29 Dec 2023
- 2023The Pros and Cons of Adversarial Robustness18 Dec 2023
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems20 Nov 2023
- 2023Towards Robust and Accurate Visual Prompting18 Nov 2023
- 2023In Search of the Long-Tail: Systematic Generation of Long-Tail Inferential Knowledge via Logical Rule Guided Search13 Nov 2023
- 2023A Survey on Transferability of Adversarial Examples across Deep Neural Networks26 Oct 2023
- 2023SoK: Realistic Adversarial Attacks and Defenses for Intelligent Network Intrusion Detection13 Aug 2023
- 2023OrcoDCS: An IoT-Edge Orchestrated Online Deep Compressed Sensing Framework5 Aug 2023
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback27 Jul 2023
- 2023Adversary Aware Continual Learning27 Apr 2023
- 2023State-of-the-art optical-based physical adversarial attacks for deep learning computer vision systems22 Mar 2023
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensus16 Mar 2023
- 2023Adv-Bot: Realistic Adversarial Botnet Attacks against Network Intrusion Detection Systems12 Mar 2023
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective19 Feb 2023
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunities26 Nov 2022
- 2022Robust DNN Surrogate Models with Uncertainty Quantification via Adversarial Training10 Nov 2022
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey19 Oct 2022
- 2022A Survey on Physical Adversarial Attack in Computer Vision28 Sep 2022
- 2022Employing Deep Ensemble Learning for Improving the Security of Computer Networks against Adversarial Attacks25 Sep 2022
- 2022Resisting Deep Learning Models Against Adversarial Attack Transferability via Feature Randomization11 Sep 2022
- 2022On the Robustness of Bayesian Neural Networks to Adversarial Attacks13 Jul 2022
- 2022CARLA-GeAR: a Dataset Generator for a Systematic Evaluation of Adversarial Robustness of Vision Models9 Jun 2022
- 2022Towards a Fair Comparison and Realistic Evaluation Framework of Android Malware Detectors based on Static Analysis and Machine Learning25 May 2022
- 2022Fooling the Eyes of Autonomous Vehicles: Robust Physical Adversarial Examples Against Traffic Sign Recognition Systems17 Jan 2022
- 2022On the Real-World Adversarial Robustness of Real-Time Semantic Segmentation Models for Autonomous Driving5 Jan 2022
- 2021Adversarial Attacks against Windows PE Malware Detection: A Survey of the State-of-the-Art23 Dec 2021
- 2021Using a GAN to Generate Adversarial Examples to Facial Image Recognition30 Nov 2021
50 newest of 62 All 62 (JSON)
- 2023A Survey on Transferability of Adversarial Examples across Deep Neural Networkscited by 43
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensuscited by 37
- 2022On the Real-World Adversarial Robustness of Real-Time Semantic Segmentation Models for Autonomous Drivingcited by 30
- 2022Fooling the Eyes of Autonomous Vehicles: Robust Physical Adversarial Examples Against Traffic Sign Recognition Systemscited by 27
- 2022A Survey on Physical Adversarial Attack in Computer Visioncited by 24
- 2021Robustness of on-device Models: Adversarial Attack to Deep Learning Models on Android Appscited by 19
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2021Adversarial Attacks against Windows PE Malware Detection: A Survey of the State-of-the-Artcited by 18
- 2021Detecting Adversarial Examples by Input Transformations, Defense Perturbations, and Votingcited by 16
- 2021Security and Privacy for Artificial Intelligence: Opportunities and Challengescited by 16
- 2023Adv-Bot: Realistic Adversarial Botnet Attacks against Network Intrusion Detection Systemscited by 14
- 2022On the Robustness of Bayesian Neural Networks to Adversarial Attackscited by 12
12 most cited of 56 All 56 (JSON)
- 2026Risk and Anomaly Identification for Distribution Network Optimal Operation Based on Reinforcement Learning and Uncertainty Quantification3 Sep 2026
- 2025Adversarial Robustness in Zero-Shot Learning:An Empirical Study on Class and Concept-Level Vulnerabilities21 Dec 2025
- 2025A Versatile Framework for Designing Group-Sparse Adversarial Attacks18 Oct 2025
- 2025Wormhole Dynamics in Deep Neural Networks20 Aug 2025
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025The Endless Tuning. An Artificial Intelligence Design To Avoid Human Replacement and Trace Back Responsibilities20 Jul 2025
- 2025CP-uniGuard: A Unified, Probability-Agnostic, and Adaptive Framework for Malicious Agent Detection and Defense in Multi-Agent Embodied Perception Systems28 Jun 2025
- 2025Vulnerability Disclosure through Adaptive Black-Box Adversarial Attacks on NIDS25 Jun 2025
- 2024Backdoor attacks on DNN and GBDT -- A Case Study from the insurance domain11 Dec 2024
- 2024Table Integration in Data Lakes Unleashed: Pairwise Integrability Judgment, Integrable Set Discovery, and Multi-Tuple Conflict Resolution30 Nov 2024
- 2024Deep Model Merging: The Sister of Neural Network Interpretability -- A Survey16 Oct 2024
- 2024Understanding Model Ensemble in Transferable Adversarial Attack9 Oct 2024
12 newest of 56 All 56 (JSON)