Adversarial Attacks and Defences: A Survey
Not on the map. Why?
Abstract (arXiv)
Deep learning has emerged as a strong and efficient framework that can be applied to a broad spectrum of complex learning problems which were difficult to solve using the traditional machine learning techniques in the past. In the last few years, deep learning has advanced radically in such a way that it can surpass human-level performance on a number of tasks. As a consequence, deep learning is being extensively used in most of the recent day-to-day applications. However, security of deep learning systems are vulnerable to crafted adversarial examples, which may be imperceptible to the human eye, but can lead the model to misclassify the output. In recent times, different types of adversaries based on their threat model leverage these vulnerabilities to compromise a deep learning system where adversaries have high incentives. Hence, it is extremely important to provide robustness to deep learning algorithms against these adversaries. However, there are only a few strong countermeasures which can be used in all types of attack scenarios to design a robust deep learning system. In this paper, we attempt to provide a detailed discussion on different types of adversarial attacks with various threat models and also elaborate the efficiency and challenges of recent countermeasures against them.
Key facts. Cited by 259 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 59; 2022: 55; 2023: 61; 2024: 47; 2025: 30; 2026: 7.
259 papers.
Sort:
By area:
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
- 2021Trustworthy AI: From Principles to Practicescited by 207
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 118
- 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
- 2021Towards Robust and Reliable Algorithmic Recoursecited by 102
- 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 97
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 94
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trendscited by 84
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 82
- 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methodscited by 79
38 more
- 2021Black-box Detection of Backdoor Attacks with Limited Information and Datacited by 73
- 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 67
- 2021Probabilistic Margins for Instance Reweighting in Adversarial Trainingcited by 57
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 52
- 2022Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations?cited by 49
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021Reveal of Vision Transformers Robustness against Adversarial Attackscited by 43
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learningcited by 43
- 2024A Language Model's Guide Through Latent Spacecited by 43
- 2022Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networkscited by 39
- 2024Threats, Attacks, and Defenses in Machine Unlearning: A Surveycited by 39
- 2021The Threat of Offensive AI to Organizationscited by 38
- 2021Improved Text Classification via Contrastive Adversarial Trainingcited by 38
- 2023UP5: Unbiased Foundation Model for Fairness-aware Recommendationcited by 38
- 2024Leveraging the Context through Multi-Round Interactions for Jailbreaking Attackscited by 36
- 2022Invariant Feature Learning for Generalized Long-Tailed Classificationcited by 34
- 2022DISCO: Adversarial Defense with Local Implicit Functionscited by 34
- 2024Understanding and Improving Training-free Loss-based Diffusion Guidancecited by 32
- 2021Pay attention to your loss: understanding misconceptions about 1-Lipschitz neural networkscited by 30
- 2024Exploring the Deceptive Power of LLM-Generated Fake News: A Study of Real-World Detection Challengescited by 30
- 2021Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networkscited by 29
- 2021Verification of Image-based Neural Network Controllers Using Generative Modelscited by 27
- 2021BASAR:Black-box Attack on Skeletal Action Recognitioncited by 26
- 2024GPT-4 Jailbreaks Itself with Near-Perfect Success Using Self-Explanationcited by 25
- 2021Adversarial Attacks on Deep Models for Financial Transaction Recordscited by 24
- 2023Learngene: Inheriting Condensed Knowledge from the Ancestry Model to Descendant Modelscited by 24
- 2021Universal Adversarial Examples and Perturbations for Quantum Classifierscited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 23
- 2022Robust Conversational Agents against Imperceptible Toxicity Triggerscited by 23
- 2021Medical Image Segmentation with Limited Supervision: A Review of Deep Network Modelscited by 22
- 2022Dangerous Cloaking: Natural Trigger based Backdoor Attacks on Object Detectors in the Physical Worldcited by 22
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
- 2023Model Leeching: An Extraction Attack Targeting LLMscited by 22
- 2023A Survey on the Robustness of Computer Vision Models against Common Corruptionscited by 21
- 2021Poisoning Attacks on Fair Machine Learningcited by 19
- 2022Transferable Graph Backdoor Attackcited by 19
- 2021Adversarial Attacks against Windows PE Malware Detection: A Survey of the State-of-the-Artcited by 18
50 most cited of 259 All 259 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026Self-Review Reinforcement Learning (SRRL) with Cross-Episode Memory and Policy Distillation6 Jul 2026
- 2026Fortifying Time Series: DTW-Certified Robust Anomaly Detection8 May 2026
- 2026Downsides of Smartness Across Edge-Cloud Continuum in Modern Industry31 Mar 2026
- 2026Attack Assessment and Augmented Identity Recognition for Human Skeleton Data25 Mar 2026
- 2026Identifying Adversary Characteristics from an Observed Attack5 Mar 2026
- 2026Exposing Vulnerabilities in Explanation for Time Series Classifiers via Dual-Target Attacks2 Feb 2026
- 2025C-LEAD: Contrastive Learning for Enhanced Adversarial Defense31 Oct 2025
- 2025Unveiling the Vulnerability of Graph-LLMs: An Interpretable Multi-Dimensional Adversarial Attack on TAGs14 Oct 2025
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025Stabilizing Data-Free Model Extraction14 Sep 2025
- 2025BOOD: Boundary-based Out-Of-Distribution Data Generation1 Aug 2025
38 more
- 2025Position: Certified Robustness Does Not (Yet) Imply Model Security16 Jun 2025
- 2025Assessing the Resilience of Automotive Intrusion Detection Systems to Adversarial Manipulation12 Jun 2025
- 2025Exploring Visual Prompting: Robustness Inheritance and Beyond7 Jun 2025
- 2025Joint-GCG: Unified Gradient-Based Poisoning Attacks on Retrieval-Augmented Generation Systems6 Jun 2025
- 2025Diffusion-based Cumulative Adversarial Purification for Vision Language Models4 Jun 2025
- 2025Agnostic Learning under Targeted Poisoning: Optimal Rates and the Role of Randomness3 Jun 2025
- 2025Spiking Neural Network: a low power solution for physical layer authentication19 May 2025
- 2025Two out of Three (ToT): using self-consistency to make robust predictions19 May 2025
- 2025FABLE: A Localized, Targeted Adversarial Attack on Weather Forecasting Models17 May 2025
- 2025XBreaking: Understanding how LLMs security alignment can be broken30 Apr 2025
- 2025Hydra: An Agentic Reasoning Approach for Enhancing Adversarial Robustness and Mitigating Hallucinations in Vision-Language Models19 Apr 2025
- 2025Deep Learning-based Intrusion Detection Systems: A Survey10 Apr 2025
- 2025Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustness3 Apr 2025
- 2025Robust Deep Reinforcement Learning in Robotics via Adaptive Gradient-Masked Adversarial Attacks26 Mar 2025
- 2025State-Aware Perturbation Optimization for Robust Deep Reinforcement Learning26 Mar 2025
- 2025Rethinking the Role of Spatial Mixing21 Mar 2025
- 2025Ranking Counterfactual Explanations20 Mar 2025
- 2025Securing Virtual Reality Experiences: Unveiling and Tackling Cybersickness Attacks with Explainable AI17 Mar 2025
- 2025MIP against Agent: Malicious Image Patches Hijacking Multimodal OS Agents13 Mar 2025
- 2025Robust Intrusion Detection System with Explainable Artificial Intelligence7 Mar 2025
- 2025A Survey of Adversarial Defenses in Vision-based Systems: Categorization, Methods and Challenges1 Mar 2025
- 2025Enabling AutoML for Zero-Touch Network Security: Use-Case Driven Analysis28 Feb 2025
- 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluations14 Feb 2025
- 2025Reinforcement Learning Platform for Adversarial Black-box Attacks with Custom Distortion Filters23 Jan 2025
- 2025Protego: Detecting Adversarial Examples for Vision Transformers via Intrinsic Capabilities13 Jan 2025
- 2024Emerging Security Challenges of Large Language Models23 Dec 2024
- 2024Safety Monitoring of Machine Learning Perception Functions: a Survey9 Dec 2024
- 2024Effective and Efficient Adversarial Detection for Vision-Language Models via A Single Vector30 Oct 2024
- 2024Conflict-Aware Adversarial Training21 Oct 2024
- 2024Hiding-in-Plain-Sight (HiPS) Attack on CLIP for Targetted Object Removal from Images16 Oct 2024
- 2024TPFL: A Trustworthy Personalized Federated Learning Framework via Subjective Logic16 Oct 2024
- 2024Poison-splat: Computation Cost Attack on 3D Gaussian Splatting10 Oct 2024
- 2024On the Adversarial Risk of Test Time Adaptation: An Investigation into Realistic Test-Time Data Poisoning7 Oct 2024
- 2024TA3: Testing Against Adversarial Attacks on Machine Learning Models6 Oct 2024
- 2024A Survey on Offensive AI Within Cybersecurity26 Sep 2024
- 2024Natural Adversaries: Fuzzing Autonomous Vehicles with Realistic Roadside Object Placements13 Sep 2024
- 2024High-Frequency Anti-DreamBooth: Robust Defense against Personalized Image Synthesis12 Sep 2024
- 2024Survival of the Cheapest: Cost-Aware Hardware Adaptation for Adversarial Robustness11 Sep 2024
50 newest of 259 All 259 (JSON)
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 94
- 2024Threats, Attacks, and Defenses in Machine Unlearning: A Surveycited by 39
- 2024Leveraging the Context through Multi-Round Interactions for Jailbreaking Attackscited by 36
- 2024GPT-4 Jailbreaks Itself with Near-Perfect Success Using Self-Explanationcited by 25
- 2022On Optimal Learning Under Targeted Data Poisoningcited by 14
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systemscited by 6
- 2024On the Adversarial Risk of Test Time Adaptation: An Investigation into Realistic Test-Time Data Poisoningcited by 4
- 2023Adversary Aware Continual Learningcited by 3
- 2024On the Adversarial Risk of Test Time Adaptation: An Investigation into Realistic Test-Time Data Poisoning7 Oct 2024
- 2024GPT-4 Jailbreaks Itself with Near-Perfect Success Using Self-Explanation21 May 2024
- 2024Threats, Attacks, and Defenses in Machine Unlearning: A Survey20 Mar 2024
- 2024Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks14 Feb 2024
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems20 Nov 2023
- 2023Jailbroken: How Does LLM Safety Training Fail?5 Jul 2023
- 2023Adversary Aware Continual Learning27 Apr 2023
- 2022On Optimal Learning Under Targeted Data Poisoning6 Oct 2022
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoning4 May 2022
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trendscited by 84
- 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 67
- 2024Effective and Efficient Adversarial Detection for Vision-Language Models via A Single Vectorcited by 8
- 2024Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuningcited by 7
- 2024Explaining Multi-modal Large Language Models by Analyzing their Vision Perceptioncited by 3
- 2025Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustnesscited by 3
- 2025Diffusion-based Cumulative Adversarial Purification for Vision Language Modelscited by 2
- 2025Diffusion-based Cumulative Adversarial Purification for Vision Language Models4 Jun 2025
- 2025Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustness3 Apr 2025
- 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluations14 Feb 2025
- 2024Effective and Efficient Adversarial Detection for Vision-Language Models via A Single Vector30 Oct 2024
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends10 Jul 2024
- 2024Explaining Multi-modal Large Language Models by Analyzing their Vision Perception23 May 2024
- 2024Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuning15 Mar 2024
- 2025State-Aware Perturbation Optimization for Robust Deep Reinforcement Learningcited by 8
- 2025Robust Deep Reinforcement Learning in Robotics via Adaptive Gradient-Masked Adversarial Attackscited by 7
- 2024On Robust Reinforcement Learning with Lipschitz-Bounded Policy Networkscited by 4
- 2025Reinforcement Learning Platform for Adversarial Black-box Attacks with Custom Distortion Filterscited by 3
- 2026Self-Review Reinforcement Learning (SRRL) with Cross-Episode Memory and Policy Distillationcited by 0
- 2026Self-Review Reinforcement Learning (SRRL) with Cross-Episode Memory and Policy Distillation6 Jul 2026
- 2025Robust Deep Reinforcement Learning in Robotics via Adaptive Gradient-Masked Adversarial Attacks26 Mar 2025
- 2025State-Aware Perturbation Optimization for Robust Deep Reinforcement Learning26 Mar 2025
- 2025Reinforcement Learning Platform for Adversarial Black-box Attacks with Custom Distortion Filters23 Jan 2025
- 2024On Robust Reinforcement Learning with Lipschitz-Bounded Policy Networks19 May 2024
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
- 2024Dynamic Normativity: Necessary and Sufficient Conditions for Value Alignmentcited by 3
- 2021Trustworthy AI: From Principles to Practicescited by 207
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 118
- 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
- 2021Towards Robust and Reliable Algorithmic Recoursecited by 102
- 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 97
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 82
- 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methodscited by 79
- 2021Black-box Detection of Backdoor Attacks with Limited Information and Datacited by 73
- 2021Probabilistic Margins for Instance Reweighting in Adversarial Trainingcited by 57
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 52
12 most cited of 227 All 227 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026Fortifying Time Series: DTW-Certified Robust Anomaly Detection8 May 2026
- 2026Downsides of Smartness Across Edge-Cloud Continuum in Modern Industry31 Mar 2026
- 2026Attack Assessment and Augmented Identity Recognition for Human Skeleton Data25 Mar 2026
- 2026Identifying Adversary Characteristics from an Observed Attack5 Mar 2026
- 2026Exposing Vulnerabilities in Explanation for Time Series Classifiers via Dual-Target Attacks2 Feb 2026
- 2025C-LEAD: Contrastive Learning for Enhanced Adversarial Defense31 Oct 2025
- 2025Unveiling the Vulnerability of Graph-LLMs: An Interpretable Multi-Dimensional Adversarial Attack on TAGs14 Oct 2025
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025Stabilizing Data-Free Model Extraction14 Sep 2025
- 2025Position: Certified Robustness Does Not (Yet) Imply Model Security16 Jun 2025
- 2025Assessing the Resilience of Automotive Intrusion Detection Systems to Adversarial Manipulation12 Jun 2025
12 newest of 227 All 227 (JSON)