Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods
Not on the map. Why?
Cited by 33 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Neural networks are known to be vulnerable to adversarial examples: inputs that are close to natural inputs but classified incorrectly. In order to better understand the space of adversarial examples, we survey ten recent proposals that are designed for detection and compare their efficacy. We show that all can be defeated by constructing new loss functions. We conclude that adversarial examples are significantly harder to detect than previously appreciated, and the properties believed to be intrinsic to adversarial examples are in fact not. Finally, we propose several simple guidelines for evaluating future proposed defenses.
Key facts. Cited by 542 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 171; 2022: 116; 2023: 87; 2024: 89; 2025: 56; 2026: 23.
542 papers.
Sort:
By area:
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
- 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrationscited by 401
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 307
- 2023Certifying LLM Safety against Adversarial Promptingcited by 248
- 2021Improving Robustness using Generated Datacited by 233
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Fixing Data Augmentation to Improve Adversarial Robustnesscited by 201
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2021Data Augmentation Can Improve Robustnesscited by 193
- 2024Certifiably Robust RAG against Retrieval Corruptioncited by 144
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
38 more
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
- 2024An Adversarial Perspective on Machine Unlearning for AI Safetycited by 113
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agentscited by 112
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
- 2021Globally-Robust Neural Networkscited by 106
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 100
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Types of Out-of-Distribution Texts and How to Detect Themcited by 80
- 2021Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classificationcited by 79
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2021Adversarial Laser Beam: Effective Physical-World Attack to DNNs in a Blinkcited by 75
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 68
- 2021MT3: Meta Test-Time Training for Self-Supervised Test-Time Adaptioncited by 65
- 2022Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examplescited by 65
- 2022Evaluating the Adversarial Robustness of Adaptive Test-time Defensescited by 64
- 2021PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifiercited by 63
- 2021A Dynamical System Perspective for Lipschitz Neural Networkscited by 59
- 2023X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detectioncited by 58
- 2021Relating Adversarially Robust Generalization to Flat Minimacited by 57
- 2021Robot Learning from Randomized Simulations: A Reviewcited by 56
- 2021AdvDrop: Adversarial Attack to DNNs by Dropping Informationcited by 55
- 2022A Large-scale Multiple-objective Method for Black-box Attack against Object Detectioncited by 55
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 51
- 2024On Evaluating the Durability of Safeguards for Open-Weight LLMscited by 51
- 2022Predicting Out-of-Distribution Error with the Projection Normcited by 50
- 2023Leveraging Optimization for Adaptive Attacks on Image Watermarkscited by 50
- 2021SmoothMix: Training Confidence-calibrated Smoothed Classifiers for Certified Robustnesscited by 49
- 2025WebInject: Prompt Injection Attack to Web Agentscited by 48
- 2021Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Themcited by 46
- 2021Fast Certified Robust Training with Short Warmupcited by 45
- 2021Data Poisoning Won't Save You From Facial Recognitioncited by 45
- 2022Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioningcited by 45
- 2021Reveal of Vision Transformers Robustness against Adversarial Attackscited by 43
- 2022SSLGuard: A Watermarking Scheme for Self-supervised Learning Pre-trained Encoderscited by 43
- 2021Neural Mean Discrepancy for Efficient Out-of-Distribution Detectioncited by 42
- 2021WaveGuard: Understanding and Mitigating Audio Adversarial Examplescited by 39
- 2024Arondight: Red Teaming Large Vision Language Models with Auto-generated Multi-modal Jailbreak Promptscited by 39
- 2023Are Defenses for Graph Neural Networks Robust?cited by 38
50 most cited of 542 All 542 (JSON)
- 2026TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor18 Sep 2026
- 2026The Safeguard Worked. Is the LLM System Safer?1 Sep 2026
- 2026ARMOR: Manifold-Oriented Training for Adversarially Robust Aerial Object Detection under Data Scarcity30 Aug 2026
- 2026Adversarial Training of Linear Models under Stealthy Attacks26 Aug 2026
- 2026Vision-Language Model Confidence Is Not a Property of the Answer6 Aug 2026
- 2026VLAGuard: A Framework for Evaluating and Mitigating Physical Attention Hijacking in Vision-Language-Action Robots within Wireless Sensor Networks2 Aug 2026
- 2026Revisiting the Adversarial Robustness of Graph-Based Traffic Forecasting30 Jul 2026
- 2026TriShieldRAG: 3 Rings, One Blind Spot in Layered Defenses for Retrieval-Augmented Generation26 Jul 2026
- 2026Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs8 Jul 2026
- 2026USAD: Uncertainty-aware Statistical Adversarial Detection26 Jun 2026
- 2026Giving AI a Headache: Acoustic Adversarial Attacks to Computer Vision Applications12 Jun 2026
- 2026RRISE: Robust Radius Inference via a Surrogate Estimator1 Jun 2026
38 more
- 2026A Few Steps Further: Why Defenses Against Malicious Finetuning Erode Under Continued Training14 May 2026
- 2026Laundering AI Authority with Adversarial Examples5 May 2026
- 2026The Forensic Cost of Watermark Removal: From Dedicated Attacks to Image Editing28 Apr 2026
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Models3 Apr 2026
- 2026Detection of Adversarial Attacks in Robotic Perception30 Mar 2026
- 2026Kernel Tests of Equivalence11 Mar 2026
- 2026Triggering hallucinations in model-based MRI reconstruction via adversarial perturbations20 Feb 2026
- 2026AD2: Analysis and Detection of Adversarial Threats in Visual Perception for End-to-End Autonomous Driving Systems10 Feb 2026
- 2026Evasion of IoT Malware Detection via Dummy Code Injection9 Feb 2026
- 2026Most Convolutional Networks Suffer from Small Adversarial Perturbations3 Feb 2026
- 2026NeuroShield: A Neuro-Symbolic Framework for Adversarial Robustness19 Jan 2026
- 2025TrajSyn: Privacy-Preserving Dataset Distillation from Federated Model Trajectories for Server-Side Adversarial Training17 Dec 2025
- 2025Studying Various Activation Functions and Non-IID Data for Machine Learning Model Robustness3 Dec 2025
- 2025FeatureLens: A Highly Generalizable and Interpretable Framework for Detecting Adversarial Examples Based on Image Features3 Dec 2025
- 2025Robust Physical Adversarial Patches Using Dynamically Optimized Clusters23 Nov 2025
- 2025Probably Approximately Global Robustness Certification9 Nov 2025
- 2025Protecting the Neural Networks against FGSM Attack Using Machine Unlearning3 Nov 2025
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct 2025
- 2025SynthID-Image: Image watermarking at internet scale10 Oct 2025
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injections10 Oct 2025
- 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents1 Oct 2025
- 2025Microsaccade-Inspired Probing: Positional Encoding Perturbations Reveal LLM Misbehaviours1 Oct 2025
- 2025Preventing Prompt Injection with Type-Directed Privilege Separation30 Sep 2025
- 2025Learning-Based Testing for Deep Learning: Enhancing Model Robustness with Adversarial Input Prioritization28 Sep 2025
- 2025Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generation17 Sep 2025
- 2025Get Global Guarantees: On the Probabilistic Nature of Perturbation Robustness26 Aug 2025
- 2025Keep It Real: Challenges in Attacking Compression-Based Adversarial Purification7 Aug 2025
- 2025On the Efficiency of Training Robust Decision Trees14 Jul 2025
- 2025On the Feasibility of Poisoning Text-to-Image AI Models via Adversarial Mislabeling27 Jun 2025
- 2025SpaNN: Detecting Multiple Adversarial Patches on CNNs by Spanning Saliency Thresholds23 Jun 2025
- 2025Off-Policy Actor-Critic for Adversarial Observation Robustness: Virtual Alternative Training via Symmetric Policy Evaluation20 Jun 2025
- 2025SyncMapV2: Robust and Adaptive Unsupervised Segmentation19 Jun 2025
- 2025Busting the Paper Ballot: Voting Meets Adversarial Machine Learning17 Jun 2025
- 2025RL-Obfuscation: Can Language Models Learn to Evade Latent-Space Monitors?17 Jun 2025
- 2025Existence of Adversarial Examples for Random Convolutional Networks via Isoperimetric Inequalities on mathbbso(d)14 Jun 2025
- 2025Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction5 Jun 2025
- 2025PatchDEMUX: A Certifiably Robust Framework for Multi-label Classifiers Against Adversarial Patches30 May 2025
- 2025Adversarially Robust AI-Generated Image Detection for Free: An Information Theoretic Perspective28 May 2025
50 newest of 542 All 542 (JSON)
- 2023Certifying LLM Safety against Adversarial Promptingcited by 248
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
- 2024An Adversarial Perspective on Machine Unlearning for AI Safetycited by 113
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
- 2021Data Poisoning Won't Save You From Facial Recognitioncited by 45
- 2024Boosting Jailbreak Attack with Momentumcited by 38
- 2021Poison Forensics: Traceback of Data Poisoning Attacks in Neural Networkscited by 37
- 2025A Critical Evaluation of Defenses against Prompt Injection Attackscited by 31
- 2021ML Attack Models: Adversarial Attacks and Data Poisoning Attackscited by 23
- 2022Poisoning Attacks and Defenses on Artificial Intelligence: A Surveycited by 15
- 2024Gradient-based Jailbreak Images for Multimodal Fusion Modelscited by 13
- 2024Testing the Limits of Jailbreaking Defenses with the Purple Problemcited by 8
12 most cited of 21 All 21 (JSON)
- 2026Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs8 Jul 2026
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Models3 Apr 2026
- 2025Protecting the Neural Networks against FGSM Attack Using Machine Unlearning3 Nov 2025
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injections10 Oct 2025
- 2025A Critical Evaluation of Defenses against Prompt Injection Attacks23 May 2025
- 2025What's Pulling the Strings? Evaluating Integrity and Attribution in AI Training and Inference through Concept Shift28 Apr 2025
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attacks15 Apr 2025
- 2024Developing Assurance Cases for Adversarial Robustness and Regulatory Compliance in LLMs4 Oct 2024
- 2024Gradient-based Jailbreak Images for Multimodal Fusion Models4 Oct 2024
- 2024An Adversarial Perspective on Machine Unlearning for AI Safety26 Sep 2024
- 2024Boosting Jailbreak Attack with Momentum2 May 2024
- 2024Testing the Limits of Jailbreaking Defenses with the Purple Problem20 Mar 2024
12 newest of 21 All 21 (JSON)
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2023DiffAttack: Evasion Attacks Against Diffusion-Based Adversarial Purificationcited by 36
- 2022Enhancing Diffusion-Based Image Synthesis with Robust Classifier Guidancecited by 33
- 2023DiffSmooth: Certifiably Robust Learning via Diffusion Models and Local Smoothingcited by 20
- 2023Investigating the Adversarial Robustness of Density Estimation Using the Probability Flow ODEcited by 4
- 2024Adversarial Examples are Misaligned in Diffusion Model Manifoldscited by 1
- 2024Diffusion-based Adversarial Purification for Intrusion Detectioncited by 1
- 2025Defending Against Frequency-Based Attacks with Diffusion Modelscited by 1
- 2025Defending Against Frequency-Based Attacks with Diffusion Models15 Apr 2025
- 2024Diffusion-based Adversarial Purification for Intrusion Detection25 Jun 2024
- 2024Adversarial Examples are Misaligned in Diffusion Model Manifolds12 Jan 2024
- 2023DiffAttack: Evasion Attacks Against Diffusion-Based Adversarial Purification27 Oct 2023
- 2023Investigating the Adversarial Robustness of Density Estimation Using the Probability Flow ODE10 Oct 2023
- 2023DiffSmooth: Certifiably Robust Learning via Diffusion Models and Local Smoothing28 Aug 2023
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models8 Feb 2023
- 2022Enhancing Diffusion-Based Image Synthesis with Robust Classifier Guidance18 Aug 2022
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agentscited by 112
- 2025WebInject: Prompt Injection Attack to Web Agentscited by 48
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challengescited by 26
- 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agentscited by 21
- 2025MIP against Agent: Malicious Image Patches Hijacking Multimodal OS Agentscited by 12
- 2025Preventing Prompt Injection with Type-Directed Privilege Separationcited by 8
- 2025Guardians of the Agentic System: Preventing Many Shots Jailbreak with Agentic Systemcited by 4
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct 2025
- 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents1 Oct 2025
- 2025Preventing Prompt Injection with Type-Directed Privilege Separation30 Sep 2025
- 2025WebInject: Prompt Injection Attack to Web Agents16 May 2025
- 2025MIP against Agent: Malicious Image Patches Hijacking Multimodal OS Agents13 Mar 2025
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb 2025
- 2025Guardians of the Agentic System: Preventing Many Shots Jailbreak with Agentic System23 Feb 2025
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 307
- 2024Arondight: Red Teaming Large Vision Language Models with Auto-generated Multi-modal Jailbreak Promptscited by 39
- 2023RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Modelscited by 7
- 2024Robust image classification with multi-modal large language modelscited by 2
- 2025On the Feasibility of Poisoning Text-to-Image AI Models via Adversarial Mislabelingcited by 1
- 2026Laundering AI Authority with Adversarial Examplescited by 0
- 2026Laundering AI Authority with Adversarial Examples5 May 2026
- 2025On the Feasibility of Poisoning Text-to-Image AI Models via Adversarial Mislabeling27 Jun 2025
- 2024Robust image classification with multi-modal large language models13 Dec 2024
- 2024Arondight: Red Teaming Large Vision Language Models with Auto-generated Multi-modal Jailbreak Prompts21 Jul 2024
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Models22 Jun 2023
- 2023RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models21 Apr 2023
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
- 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrationscited by 401
- 2025Single-pass Detection of Jailbreaking Input in Large Language Modelscited by 10
- 2023Alignment is not sufficient to prevent large language models from generating harmful information: A psychoanalytic perspectivecited by 3
- 2025Single-pass Detection of Jailbreaking Input in Large Language Models21 Feb 2025
- 2023Alignment is not sufficient to prevent large language models from generating harmful information: A psychoanalytic perspective14 Nov 2023
- 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations10 Oct 2023
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Models1 Sep 2023
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul 2023
- 2024Certifiably Robust RAG against Retrieval Corruptioncited by 144
- 2024RevPRAG: Revealing Poisoning Attacks in Retrieval-Augmented Generation through LLM Activation Analysiscited by 33
- 2025Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generationcited by 12
- 2026TriShieldRAG: 3 Rings, One Blind Spot in Layered Defenses for Retrieval-Augmented Generationcited by 0
- 2026TriShieldRAG: 3 Rings, One Blind Spot in Layered Defenses for Retrieval-Augmented Generation26 Jul 2026
- 2025Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generation17 Sep 2025
- 2024RevPRAG: Revealing Poisoning Attacks in Retrieval-Augmented Generation through LLM Activation Analysis28 Nov 2024
- 2024Certifiably Robust RAG against Retrieval Corruption24 May 2024
- 2021Improving Robustness using Generated Datacited by 233
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Fixing Data Augmentation to Improve Adversarial Robustnesscited by 201
- 2021Data Augmentation Can Improve Robustnesscited by 193
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Globally-Robust Neural Networkscited by 106
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 100
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Types of Out-of-Distribution Texts and How to Detect Themcited by 80
- 2021Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classificationcited by 79
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2021Adversarial Laser Beam: Effective Physical-World Attack to DNNs in a Blinkcited by 75
12 most cited of 489 All 489 (JSON)
- 2026TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor18 Sep 2026
- 2026The Safeguard Worked. Is the LLM System Safer?1 Sep 2026
- 2026ARMOR: Manifold-Oriented Training for Adversarially Robust Aerial Object Detection under Data Scarcity30 Aug 2026
- 2026Adversarial Training of Linear Models under Stealthy Attacks26 Aug 2026
- 2026Vision-Language Model Confidence Is Not a Property of the Answer6 Aug 2026
- 2026VLAGuard: A Framework for Evaluating and Mitigating Physical Attention Hijacking in Vision-Language-Action Robots within Wireless Sensor Networks2 Aug 2026
- 2026Revisiting the Adversarial Robustness of Graph-Based Traffic Forecasting30 Jul 2026
- 2026USAD: Uncertainty-aware Statistical Adversarial Detection26 Jun 2026
- 2026Giving AI a Headache: Acoustic Adversarial Attacks to Computer Vision Applications12 Jun 2026
- 2026RRISE: Robust Radius Inference via a Surrogate Estimator1 Jun 2026
- 2026A Few Steps Further: Why Defenses Against Malicious Finetuning Erode Under Continued Training14 May 2026
- 2026The Forensic Cost of Watermark Removal: From Dedicated Attacks to Image Editing28 Apr 2026
12 newest of 489 All 489 (JSON)