Adversarial Attacks and Defenses in Images, Graphs and Text: A Review
Not on the map. Why?
Abstract (arXiv)
Deep neural networks (DNN) have achieved unprecedented success in numerous machine learning tasks in various domains. However, the existence of adversarial examples has raised concerns about applying deep learning to safety-critical applications. As a result, we have witnessed increasing interests in studying attack and defense mechanisms for DNN models on different data types, such as images, graphs and text. Thus, it is necessary to provide a systematic and comprehensive overview of the main threats of attacks and the success of corresponding countermeasures. In this survey, we review the state of the art algorithms for generating adversarial examples and the countermeasures against adversarial examples, for the three popular data types, i.e., images, graphs and text.
Key facts. Cited by 234 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 62; 2022: 52; 2023: 52; 2024: 36; 2025: 26; 2026: 6.
234 papers.
Sort:
By area:
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 203
- 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMcited by 173
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 147
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021Node-Level Membership Inference Attacks Against Graph Neural Networkscited by 80
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 76
- 2021Robust Counterfactual Explanations on Graph Neural Networkscited by 72
38 more
- 2023BlackVIP: Black-Box Visual Prompting for Robust Transfer Learningcited by 70
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 65
- 2021Relating Adversarially Robust Generalization to Flat Minimacited by 57
- 2021Certified Robustness to Text Adversarial Attacks by Randomized [MASK]cited by 57
- 2022MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statisticcited by 53
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 51
- 2021Model Stealing Attacks Against Inductive Graph Neural Networkscited by 50
- 2021How Framelets Enhance Graph Neural Networkscited by 46
- 2021Single Node Injection Attack against Graph Neural Networkscited by 45
- 2021Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-Level Backdoor Attackscited by 44
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021Reveal of Vision Transformers Robustness against Adversarial Attackscited by 43
- 2022Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networkscited by 39
- 2021The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Failcited by 38
- 2021Generalization of Neural Combinatorial Solvers Through the Lens of Adversarial Robustnesscited by 35
- 2023MathAttack: Attacking Large Language Models Towards Math Solving Abilitycited by 31
- 2021On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learningcited by 29
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2022Post-Training Detection of Backdoor Attacks for Two-Class and Multi-Attack Scenarioscited by 29
- 2022Synthetic Data in Human Analysis: A Surveycited by 28
- 2022Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Modelscited by 28
- 2022Repairing Neural Networks by Leaving the Right Past Behindcited by 27
- 2022Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformerscited by 25
- 2021Adversarial Attacks on Deep Models for Financial Transaction Recordscited by 24
- 2022Universal Adversarial Examples in Remote Sensing: Methodology and Benchmarkcited by 24
- 2021Understanding the Robustness of Skeleton-based Action Recognition under Adversarial Attackcited by 23
- 2021ML Attack Models: Adversarial Attacks and Data Poisoning Attackscited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022TextGrad: Advancing Robustness Evaluation in NLP by Gradient-Driven Optimizationcited by 21
- 2023Towards Viewpoint-Invariant Visual Recognition via Adversarial Trainingcited by 19
- 2021Jointly Attacking Graph Neural Network and its Explanationscited by 18
- 2023Continual Graph Learning: A Surveycited by 17
- 2021Detecting Adversarial Examples by Input Transformations, Defense Perturbations, and Votingcited by 16
- 2021Deep neural network enabled corrective source term approach to hybrid analysis and modelingcited by 16
- 2021Adversarial Attacks on Knowledge Graph Embeddings via Instance Attribution Methodscited by 16
- 2022A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flowcited by 16
- 2023Collective Robustness Certificates: Exploiting Interdependence in Graph Neural Networkscited by 16
- 2023Towards Reasonable Budget Allocation in Untargeted Graph Structure Attacks via Gradient Debiascited by 16
50 most cited of 234 All 234 (JSON)
- 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Study22 Sep 2026
- 2026SegPAR: Class-Centric Decision-Based Sparse Attack for Semantic Segmentation11 Aug 2026
- 2026Adversarial Attacks on Online Handwriting using Salience-based Temporal Editing14 Jul 2026
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective25 Mar 2026
- 2026Robust Spiking Neural Networks Against Adversarial Attacks24 Feb 2026
- 2026Sample-wise Constrained Learning via a Sequential Penalty Approach with Applications in Image Processing23 Jan 2026
- 2025MiniFool -- Physics-Constraint-Aware Minimizer-Based Adversarial Attacks in Deep Neural Networks3 Nov 2025
- 2025FrameShield: Adversarially Robust Video Anomaly Detection24 Oct 2025
- 2025NAPPure: Adversarial Purification for Robust Image Classification under Non-Additive Perturbations15 Oct 2025
- 2025Adversarially Robust Few-Shot Anomaly Detection with Vision Foundation Models15 Oct 2025
- 2025Decoding Deception: Understanding Automatic Speech Recognition Vulnerabilities in Evasion and Poisoning Attacks26 Sep 2025
- 2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systems22 Aug 2025
38 more
- 2025Robust Convolution Neural ODEs via Contractivity-promoting regularization15 Aug 2025
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment12 Aug 2025
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025Adversarial Training Improves Generalization Under Distribution Shifts in Bird Sound Classification18 Jul 2025
- 2025Beyond Statistical Learning: Exact Learning Is Essential for General Intelligence30 Jun 2025
- 2025Vision Transformer with Adversarial Indicator Token against Adversarial Attacks in Radio Signal Classifications13 Jun 2025
- 2025PatchGuard: Adversarially Robust Anomaly Detection and Localization through Vision Transformers and Pseudo Anomalies10 Jun 2025
- 2025Coordinated Robustness Evaluation Framework for Vision-Language Models5 Jun 2025
- 2025Does Low Rank Adaptation Lead to Lower Robustness against Training-Time Attacks?19 May 2025
- 2025REVEAL: Multi-turn Evaluation of Image-Input Harms for Vision LLM7 May 2025
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videos21 Apr 2025
- 2025CDUPatch: Color-Driven Universal Adversarial Patch Attack for Dual-Modal Visible-Infrared Detectors15 Apr 2025
- 2025PapMOT: Exploring Adversarial Patch Attack against Multiple Object Tracking12 Apr 2025
- 2025Understanding Cross-Model Perceptual Invariances Through Ensemble Metamers2 Apr 2025
- 2025Leveraging Generalizability of Image-to-Image Translation for Enhanced Adversarial Defense2 Apr 2025
- 2025Quantitative Analysis of Deeply Quantized Tiny Neural Networks Robust to Adversarial Attacks12 Mar 2025
- 2025From Pixels to Trajectory: Universal Adversarial Example Detection via Temporal Imprints6 Mar 2025
- 2025REINFORCE Adversarial Attacks on Large Language Models: An Adaptive, Distributional, and Semantic Objective24 Feb 2025
- 2025Rigid Body Adversarial Attacks8 Feb 2025
- 2025Rethinking Adversarial Attacks in Reinforcement Learning from Policy Distribution Perspective7 Jan 2025
- 2024Adversarial Vulnerabilities in Large Language Models for Time Series Forecasting11 Dec 2024
- 2024Addressing Key Challenges of Adversarial Attacks and Defenses in the Tabular Domain: A Methodological Framework for Coherence and Consistency10 Dec 2024
- 2024Gentle Local Robustness implies Generalization9 Dec 2024
- 2024If you can describe it, they can see it: Cross-Modal Learning of Visual Concepts from Textual Descriptions23 Nov 2024
- 2024Establishing and Evaluating Trustworthy AI: Overview and Research Challenges15 Nov 2024
- 2024GaGSL: Global-augmented Graph Structure Learning via Graph Information Bottleneck7 Nov 2024
- 2024Undermining Image and Text Classification Algorithms Using Adversarial Attacks3 Nov 2024
- 2024Vulnerabilities in Machine Learning-Based Voice Disorder Detection Systems21 Oct 2024
- 2024Impact of White-Box Adversarial Attacks on Convolutional Neural Networks2 Oct 2024
- 2024Lipschitz-Driven Noise Robustness in VQ-AE for High-Frequency Texture Repair in ID-Specific Talking Heads1 Oct 2024
- 2024ID-Free Not Risk-Free: LLM-Powered Agents Unveil Risks in ID-Free Recommender Systems18 Sep 2024
- 2024Adversarial Attacks on Machine Learning-Aided Visualizations4 Sep 2024
- 2024Evaluating Model Robustness Using Adaptive Sparse L0 Regularization28 Aug 2024
- 2024Securing the Diagnosis of Medical Imaging: An In-depth Analysis of AI-Resistant Attacks1 Aug 2024
- 2024On Feasibility of Intent Obfuscating Attacks22 Jul 2024
- 2024Robust Adaptation of Foundation Models with Black-Box Visual Prompting4 Jul 2024
- 2024Adversarial Evasion Attack Efficiency against Large Language Models12 Jun 2024
- 2024VQUNet: Vector Quantization U-Net for Defending Adversarial Atacks by Regularizing Unwanted Noise5 Jun 2024
50 newest of 234 All 234 (JSON)
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 203
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 147
- 2021ML Attack Models: Adversarial Attacks and Data Poisoning Attackscited by 23
- 2021Adversarial Attacks on Knowledge Graph Embeddings via Instance Attribution Methodscited by 16
- 2021Poisoning Knowledge Graph Embeddings via Relation Inference Patternscited by 12
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systemscited by 6
- 2025Does Low Rank Adaptation Lead to Lower Robustness against Training-Time Attacks?cited by 4
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessmentcited by 2
- 2022Defend Data Poisoning Attacks on Voice Authenticationcited by 1
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspectivecited by 1
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective25 Mar 2026
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment12 Aug 2025
- 2025Does Low Rank Adaptation Lead to Lower Robustness against Training-Time Attacks?19 May 2025
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal6 Feb 2024
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems20 Nov 2023
- 2022Defend Data Poisoning Attacks on Voice Authentication9 Sep 2022
- 2022Red Teaming Language Models with Language Models7 Feb 2022
- 2021ML Attack Models: Adversarial Attacks and Data Poisoning Attacks6 Dec 2021
- 2021Poisoning Knowledge Graph Embeddings via Relation Inference Patterns11 Nov 2021
- 2021Adversarial Attacks on Knowledge Graph Embeddings via Instance Attribution Methods4 Nov 2021
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer14 Oct 2021
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger26 May 2021
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMcited by 173
- 2025REINFORCE Adversarial Attacks on Large Language Models: An Adaptive, Distributional, and Semantic Objectivecited by 15
- 2025REINFORCE Adversarial Attacks on Large Language Models: An Adaptive, Distributional, and Semantic Objective24 Feb 2025
- 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLM18 Sep 2023
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned23 Aug 2022
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021Node-Level Membership Inference Attacks Against Graph Neural Networkscited by 80
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 76
- 2021Robust Counterfactual Explanations on Graph Neural Networkscited by 72
- 2023BlackVIP: Black-Box Visual Prompting for Robust Transfer Learningcited by 70
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 65
- 2021Relating Adversarially Robust Generalization to Flat Minimacited by 57
- 2021Certified Robustness to Text Adversarial Attacks by Randomized [MASK]cited by 57
- 2022MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statisticcited by 53
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 51
12 most cited of 216 All 216 (JSON)
- 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Study22 Sep 2026
- 2026SegPAR: Class-Centric Decision-Based Sparse Attack for Semantic Segmentation11 Aug 2026
- 2026Adversarial Attacks on Online Handwriting using Salience-based Temporal Editing14 Jul 2026
- 2026Robust Spiking Neural Networks Against Adversarial Attacks24 Feb 2026
- 2026Sample-wise Constrained Learning via a Sequential Penalty Approach with Applications in Image Processing23 Jan 2026
- 2025MiniFool -- Physics-Constraint-Aware Minimizer-Based Adversarial Attacks in Deep Neural Networks3 Nov 2025
- 2025FrameShield: Adversarially Robust Video Anomaly Detection24 Oct 2025
- 2025NAPPure: Adversarial Purification for Robust Image Classification under Non-Additive Perturbations15 Oct 2025
- 2025Adversarially Robust Few-Shot Anomaly Detection with Vision Foundation Models15 Oct 2025
- 2025Decoding Deception: Understanding Automatic Speech Recognition Vulnerabilities in Evasion and Poisoning Attacks26 Sep 2025
- 2025A Survey of Threats Against Voice Authentication and Anti-Spoofing Systems22 Aug 2025
- 2025Robust Convolution Neural ODEs via Contractivity-promoting regularization15 Aug 2025
12 newest of 216 All 216 (JSON)