Evading Adversarial Example Detection Defenses with Orthogonal Projected Gradient Descent
Not on the map. Why?
Abstract (arXiv)
Evading adversarial example detection defenses requires finding adversarial examples that must simultaneously (a) be misclassified by the model and (b) be detected as non-adversarial. We find that existing attacks that attempt to satisfy multiple simultaneous constraints often over-optimize against one constraint at the cost of satisfying another. We introduce Orthogonal Projected Gradient Descent, an improved attack technique to generate adversarial examples that avoids this problem by orthogonalizing the gradients when running standard gradient-based attacks. We use our technique to evade four state-of-the-art detection defenses, reducing their accuracy to 0% while maintaining a 0% detection rate.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 24 of its 29 references that are in the map. First posted on arXiv 28 Jun 2021.
Builds on
24 of 29 references.
References · 24
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2017Evasion Attacks against Machine Learning at Test Timecited by 686
- 2020On Adaptive Attacks to Adversarial Example Defensescited by 547
- 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 542
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 462
- 2018Generating Natural Language Adversarial Examplescited by 422
12 more
- 2017Adversarial Attacks on Neural Network Policiescited by 314
- 2018Certified Defenses against Adversarial Examplescited by 305
- 2018Characterizing Adversarial Subspaces Using Local Intrinsic Dimensionalitycited by 280
- 2017MagNet: a Two-Pronged Defense against Adversarial Examplescited by 268
- 2018Audio Adversarial Examples: Targeted Attacks on Speech-to-Textcited by 268
- 2017Detecting Adversarial Samples from Artifactscited by 244
- 2017On Detecting Adversarial Perturbationscited by 232
- 2019The Odds are Odd: A Statistical Test for Detecting Adversarial Examplescited by 75
- 2019Gotta Catch 'Em All: Using Honeypots to Catch Adversarial Attacks on Neural Networkscited by 40
- 2018Detection based Defense against Adversarial Examples from the Steganalysis Point of Viewcited by 32
- 2021Detecting Adversarial Examples from Sensitivity Inconsistency of Spatial-Transform Domaincited by 29
- 2019DLA: Dense-Layer-Analysis for Adversarial Example Detectioncited by 20
Built on by
Citing papers per year: 2022: 7; 2023: 10; 2024: 11; 2025: 4; 2026: 2.
34 papers.
Sort:
By area:
- 2024Certifiably Robust RAG against Retrieval Corruptioncited by 144
- 2024RevPRAG: Revealing Poisoning Attacks in Retrieval-Augmented Generation through LLM Activation Analysiscited by 33
- 2025SynthID-Image: Image watermarking at internet scalecited by 26
- 2022Detecting Adversarial Perturbations in Multi-Task Perceptioncited by 15
- 2023A LLM Assisted Exploitation of AI-Guardiancited by 14
- 2022Increasing Confidence in Adversarial Robustness Evaluationscited by 12
- 2022What You See is Not What the Network Infers: Detecting Adversarial Examples Based on Semantic Contradictioncited by 10
- 2023Uncertainty-weighted Loss Functions for Improved Adversarial Attacks on Semantic Segmentationcited by 9
- 2022Be Your Own Neighborhood: Detecting Adversarial Example by the Neighborhood Relations Built on Self-Supervised Learningcited by 5
- 2023PAD: Towards Principled Adversarial Malware Detection Against Evasion Attackscited by 5
- 2023Uncertainty-based Detection of Adversarial Attacks in Semantic Segmentationcited by 5
- 2023Adversarial Machine Learning for Social Good: Reframing the Adversary as an Allycited by 5
22 more
- 2024Systematic Categorization, Construction and Evaluation of New Attacks against Multi-modal Mobile GUI Agentscited by 5
- 2024Inherent Diverse Redundant Safety Mechanisms for AI-based Software Elements in Automotive Applicationscited by 4
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectorscited by 4
- 2024Input Space Mode Connectivity in Deep Neural Networkscited by 4
- 2023MalPurifier: Enhancing Android Malware Detection with Adversarial Purification against Evasion Attackscited by 3
- 2023Physics-constrained Attack against Convolution-based Human Motion Predictioncited by 2
- 2022White-Box Attacks on Hate-speech BERT Classifiers in German with Explicit and Implicit Character Level Defensecited by 1
- 2023Breaking Boundaries: Balancing Performance and Robustness in Deep Wireless Traffic Forecastingcited by 1
- 2024Detecting Adversarial Data using Perturbation Forgerycited by 1
- 2024Feature compression is the root cause of adversarial fragility in neural network classifierscited by 1
- 2024Detecting Adversarial Attacks in Semantic Segmentation via Uncertainty Estimation: A Deep Analysiscited by 1
- 2025A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detectioncited by 1
- 2025Adversarial Machine Learning Attacks on Financial Reporting via Maximum Violated Multi-Objective Attackcited by 1
- 2022Hindi/Bengali Sentiment Analysis Using Transfer Learning and Joint Dual Input Learning with Self Attentioncited by 0
- 2022Neighboring State-based Exploration for Reinforcement Learningcited by 0
- 2023A Minimax Approach Against Multi-Armed Adversarial Attacks Detectioncited by 0
- 2023Online Black-Box Confidence Estimation of Deep Neural Networkscited by 0
- 2024Optimal Zero-Shot Detector for Multi-Armed Attackscited by 0
- 2024Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Servicescited by 0
- 2025Evaluating the robustness of adversarial defenses in malware detection systemscited by 0
- 2026USAD: Uncertainty-aware Statistical Adversarial Detectioncited by 0
- 2026GeoDetect: Geometric Adversarial Detection for VLPscited by 0
- 2026GeoDetect: Geometric Adversarial Detection for VLPs16 Jul 2026
- 2026USAD: Uncertainty-aware Statistical Adversarial Detection26 Jun 2026
- 2025SynthID-Image: Image watermarking at internet scale10 Oct 2025
- 2025Adversarial Machine Learning Attacks on Financial Reporting via Maximum Violated Multi-Objective Attack7 Jul 2025
- 2025A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detection19 May 2025
- 2025Evaluating the robustness of adversarial defenses in malware detection systems14 May 2025
- 2024RevPRAG: Revealing Poisoning Attacks in Retrieval-Augmented Generation through LLM Activation Analysis28 Nov 2024
- 2024Input Space Mode Connectivity in Deep Neural Networks9 Sep 2024
- 2024Detecting Adversarial Attacks in Semantic Segmentation via Uncertainty Estimation: A Deep Analysis19 Aug 2024
- 2024Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Services5 Aug 2024
- 2024Systematic Categorization, Construction and Evaluation of New Attacks against Multi-modal Mobile GUI Agents12 Jul 2024
- 2024Feature compression is the root cause of adversarial fragility in neural network classifiers23 Jun 2024
22 more
- 2024Detecting Adversarial Data using Perturbation Forgery25 May 2024
- 2024Certifiably Robust RAG against Retrieval Corruption24 May 2024
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectors18 Apr 2024
- 2024Optimal Zero-Shot Detector for Multi-Armed Attacks24 Feb 2024
- 2024Inherent Diverse Redundant Safety Mechanisms for AI-based Software Elements in Automotive Applications13 Feb 2024
- 2023MalPurifier: Enhancing Android Malware Detection with Adversarial Purification against Evasion Attacks11 Dec 2023
- 2023Breaking Boundaries: Balancing Performance and Robustness in Deep Wireless Traffic Forecasting16 Nov 2023
- 2023Uncertainty-weighted Loss Functions for Improved Adversarial Attacks on Semantic Segmentation26 Oct 2023
- 2023Adversarial Machine Learning for Social Good: Reframing the Adversary as an Ally5 Oct 2023
- 2023A LLM Assisted Exploitation of AI-Guardian20 Jul 2023
- 2023Physics-constrained Attack against Convolution-based Human Motion Prediction21 Jun 2023
- 2023Uncertainty-based Detection of Adversarial Attacks in Semantic Segmentation22 May 2023
- 2023Online Black-Box Confidence Estimation of Deep Neural Networks27 Feb 2023
- 2023PAD: Towards Principled Adversarial Malware Detection Against Evasion Attacks22 Feb 2023
- 2023A Minimax Approach Against Multi-Armed Adversarial Attacks Detection4 Feb 2023
- 2022Neighboring State-based Exploration for Reinforcement Learning21 Dec 2022
- 2022Be Your Own Neighborhood: Detecting Adversarial Example by the Neighborhood Relations Built on Self-Supervised Learning31 Aug 2022
- 2022Increasing Confidence in Adversarial Robustness Evaluations28 Jun 2022
- 2022Detecting Adversarial Perturbations in Multi-Task Perception2 Mar 2022
- 2022White-Box Attacks on Hate-speech BERT Classifiers in German with Explicit and Implicit Character Level Defense11 Feb 2022
- 2022Hindi/Bengali Sentiment Analysis Using Transfer Learning and Joint Dual Input Learning with Self Attention11 Feb 2022
- 2022What You See is Not What the Network Infers: Detecting Adversarial Examples Based on Semantic Contradiction24 Jan 2022
- 2026GeoDetect: Geometric Adversarial Detection for VLPscited by 0
- 2026GeoDetect: Geometric Adversarial Detection for VLPs16 Jul 2026
- 2025SynthID-Image: Image watermarking at internet scalecited by 26
- 2022Detecting Adversarial Perturbations in Multi-Task Perceptioncited by 15
- 2023A LLM Assisted Exploitation of AI-Guardiancited by 14
- 2022Increasing Confidence in Adversarial Robustness Evaluationscited by 12
- 2022What You See is Not What the Network Infers: Detecting Adversarial Examples Based on Semantic Contradictioncited by 10
- 2023Uncertainty-weighted Loss Functions for Improved Adversarial Attacks on Semantic Segmentationcited by 9
- 2022Be Your Own Neighborhood: Detecting Adversarial Example by the Neighborhood Relations Built on Self-Supervised Learningcited by 5
- 2023PAD: Towards Principled Adversarial Malware Detection Against Evasion Attackscited by 5
- 2023Uncertainty-based Detection of Adversarial Attacks in Semantic Segmentationcited by 5
- 2023Adversarial Machine Learning for Social Good: Reframing the Adversary as an Allycited by 5
- 2024Inherent Diverse Redundant Safety Mechanisms for AI-based Software Elements in Automotive Applicationscited by 4
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectorscited by 4
12 most cited of 30 All 30 (JSON)
- 2026USAD: Uncertainty-aware Statistical Adversarial Detection26 Jun 2026
- 2025SynthID-Image: Image watermarking at internet scale10 Oct 2025
- 2025Adversarial Machine Learning Attacks on Financial Reporting via Maximum Violated Multi-Objective Attack7 Jul 2025
- 2025A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detection19 May 2025
- 2025Evaluating the robustness of adversarial defenses in malware detection systems14 May 2025
- 2024Input Space Mode Connectivity in Deep Neural Networks9 Sep 2024
- 2024Detecting Adversarial Attacks in Semantic Segmentation via Uncertainty Estimation: A Deep Analysis19 Aug 2024
- 2024Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Services5 Aug 2024
- 2024Feature compression is the root cause of adversarial fragility in neural network classifiers23 Jun 2024
- 2024Detecting Adversarial Data using Perturbation Forgery25 May 2024
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectors18 Apr 2024
- 2024Optimal Zero-Shot Detector for Multi-Armed Attacks24 Feb 2024
12 newest of 30 All 30 (JSON)