Adversarial and Clean Data Are Not Twins
Not on the map. Why?
Abstract (arXiv)
Adversarial attack has cast a shadow on the massive success of deep neural networks. Despite being almost visually identical to the clean data, the adversarial images can fool deep neural networks into wrong predictions with very high confidence. In this paper, however, we show that we can build a simple binary classifier separating the adversarial apart from the clean data with accuracy over 99%. We also empirically show that the binary classifier is robust to a second-round adversarial attack. In other words, it is difficult to disguise adversarial samples to bypass the binary classifier. Further more, we empirically investigate the generalization limitation which lingers on all current defensive methods, including the binary classifier approach. And we hypothesize that this is the result of intrinsic property of adversarial crafting algorithms.
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 12; 2023: 10; 2024: 4.
52 papers.
Sort:
By area:
- 2023Certifying LLM Safety against Adversarial Promptingcited by 266
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 52
- 2022Practical Evaluation of Adversarial Robustness via Adaptive Auto Attackcited by 44
- 2021LiBRe: A Practical Bayesian Approach to Adversarial Detectioncited by 40
- 2021Policy Smoothing for Provably Robust Reinforcement Learningcited by 40
- 2021Biometrics: Trust, but Verifycited by 39
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2021Unified Detection of Digital and Physical Face Attackscited by 31
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 25
- 2022Defensive Patches for Robust Recognition in the Physical Worldcited by 20
38 more
- 2021Universal Adversarial Perturbations Through the Lens of Deep Steganography: Towards A Fourier Perspectivecited by 18
- 2021Center Smoothing: Certified Robustness for Networks with Structured Outputscited by 18
- 2021Two Coupled Rejection Metrics Can Tell Adversarial Examples Apartcited by 14
- 2021PatchCensor: Patch Robustness Certification for Transformers via Exhaustive Testingcited by 12
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Surveycited by 11
- 2021AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defensecited by 10
- 2021Improving Model Robustness with Latent Distribution Locally and Globallycited by 9
- 2022Self-recoverable Adversarial Examples: A New Effective Protection Mechanism in Social Networkscited by 6
- 2023Investigating Catastrophic Overfitting in Fast Adversarial Training: A Self-fitting Perspectivecited by 5
- 2021Explaining Adversarial Vulnerability with a Data Sparsity Hypothesiscited by 4
- 2021Attribution of Gradient Based Adversarial Attacks for Reverse Engineering of Deceptionscited by 4
- 2021Long-term Cross Adversarial Training: A Robust Meta-learning Method for Few-shot Classification Taskscited by 4
- 2022Resisting Adversarial Attacks in Deep Neural Networks using Diverse Decision Boundariescited by 4
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectorscited by 4
- 2021ExAD: An Ensemble Approach for Explanation-based Adversarial Detectioncited by 3
- 2023AdvFAS: A robust face anti-spoofing framework against adversarial examplescited by 3
- 2021Noise Sensitivity-Based Energy Efficient and Robust Adversary Detection in Neural Networkscited by 2
- 2021Adversarial Examples Detection with Bayesian Neural Networkcited by 2
- 2021Two Souls in an Adversarial Image: Towards Universal Adversarial Example Detection using Multi-view Inconsistencycited by 2
- 2022Adversarial Detection without Model Informationcited by 2
- 2024Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systemscited by 2
- 2022White-Box Attacks on Hate-speech BERT Classifiers in German with Explicit and Implicit Character Level Defensecited by 1
- 2023Provable Robustness for Streaming Models with a Sliding Windowcited by 1
- 2024HOLMES: to Detect Adversarial Examples with Multiple Detectorscited by 1
- 2021PredCoin: Defense against Query-based Hard-label Attackcited by 0
- 2021Using Anomaly Feature Vectors for Detecting, Classifying and Warning of Outlier Adversarial Examplescited by 0
- 2021Unsupervised Detection of Adversarial Examples with Model Explanationscited by 0
- 2021Models of Computational Profiles to Study the Likelihood of DNN Metamorphic Test Casescited by 0
- 2021Detecting Adversaries, yet Faltering to Noise? Leveraging Conditional Variational AutoEncoders for Adversary Detection in the Presence of Noisy Imagescited by 0
- 2022Hindi/Bengali Sentiment Analysis Using Transfer Learning and Joint Dual Input Learning with Self Attentioncited by 0
- 2022HoneyModels: Machine Learning Honeypotscited by 0
- 2022Btech thesis report on adversarial attack detection and purification of adverserially attacked imagescited by 0
- 2022Adversarial Example Detection in Deployed Tree Ensemblescited by 0
- 2023Mobile Edge Adversarial Detection for Digital Twinning to the Metaverse with Deep Reinforcement Learningcited by 0
- 2023Unsupervised Multi-Criteria Adversarial Detection in Deep Image Retrievalcited by 0
- 2023Adaptive Attractors: A Defense Strategy against ML Adversarial Collusion Attackscited by 0
- 2023Adversarial Attacks Neutralization via Data Set Randomizationcited by 0
- 2023SysNoise: Exploring and Benchmarking Training-Deployment System Inconsistencycited by 0
50 most cited of 52 All 52 (JSON)
- 2024Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systems11 Jul 2024
- 2024HOLMES: to Detect Adversarial Examples with Multiple Detectors30 May 2024
- 2024Is ReLU Adversarially Robust?6 May 2024
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectors18 Apr 2024
- 2023Certifying LLM Safety against Adversarial Prompting6 Sep 2023
- 2023RobustEdge: Low Power Adversarial Detection for Cloud-Edge Systems5 Sep 2023
- 2023AdvFAS: A robust face anti-spoofing framework against adversarial examples4 Aug 2023
- 2023SysNoise: Exploring and Benchmarking Training-Deployment System Inconsistency1 Jul 2023
- 2023Adversarial Attacks Neutralization via Data Set Randomization21 Jun 2023
- 2023Adaptive Attractors: A Defense Strategy against ML Adversarial Collusion Attacks2 Jun 2023
- 2023Unsupervised Multi-Criteria Adversarial Detection in Deep Image Retrieval9 Apr 2023
- 2023Provable Robustness for Streaming Models with a Sliding Window28 Mar 2023
38 more
- 2023Mobile Edge Adversarial Detection for Digital Twinning to the Metaverse with Deep Reinforcement Learning18 Mar 2023
- 2023Investigating Catastrophic Overfitting in Fast Adversarial Training: A Self-fitting Perspective23 Feb 2023
- 2022Visual Adversarial Attacks and Defenses in the Physical World: A Survey3 Nov 2022
- 2022Resisting Adversarial Attacks in Deep Neural Networks using Diverse Decision Boundaries18 Aug 2022
- 2022Adversarial Example Detection in Deployed Tree Ensembles27 Jun 2022
- 2022Btech thesis report on adversarial attack detection and purification of adverserially attacked images9 May 2022
- 2022Self-recoverable Adversarial Examples: A New Effective Protection Mechanism in Social Networks26 Apr 2022
- 2022Defensive Patches for Robust Recognition in the Physical World13 Apr 2022
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspective27 Mar 2022
- 2022Practical Evaluation of Adversarial Robustness via Adaptive Auto Attack10 Mar 2022
- 2022HoneyModels: Machine Learning Honeypots21 Feb 2022
- 2022White-Box Attacks on Hate-speech BERT Classifiers in German with Explicit and Implicit Character Level Defense11 Feb 2022
- 2022Hindi/Bengali Sentiment Analysis Using Transfer Learning and Joint Dual Input Learning with Self Attention11 Feb 2022
- 2022Adversarial Detection without Model Information9 Feb 2022
- 2021Detecting Adversaries, yet Faltering to Noise? Leveraging Conditional Variational AutoEncoders for Adversary Detection in the Presence of Noisy Images28 Nov 2021
- 2021PatchCensor: Patch Robustness Certification for Transformers via Exhaustive Testing19 Nov 2021
- 2021A Review of Adversarial Attack and Defense for Classification Methods18 Nov 2021
- 2021Two Souls in an Adversarial Image: Towards Universal Adversarial Example Detection using Multi-view Inconsistency25 Sep 2021
- 2021Models of Computational Profiles to Study the Likelihood of DNN Metamorphic Test Cases28 Jul 2021
- 2021Unsupervised Detection of Adversarial Examples with Model Explanations22 Jul 2021
- 2021AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense14 Jul 2021
- 2021Trustworthy AI: A Computational Perspective12 Jul 2021
- 2021Improving Model Robustness with Latent Distribution Locally and Globally8 Jul 2021
- 2021Using Anomaly Feature Vectors for Detecting, Classifying and Warning of Outlier Adversarial Examples1 Jul 2021
- 2021Long-term Cross Adversarial Training: A Robust Meta-learning Method for Few-shot Classification Tasks22 Jun 2021
- 2021Policy Smoothing for Provably Robust Reinforcement Learning21 Jun 2021
- 2021Taxonomy of Machine Learning Safety: A Survey and Primer9 Jun 2021
- 2021Two Coupled Rejection Metrics Can Tell Adversarial Examples Apart31 May 2021
- 2021Adversarial Examples Detection with Bayesian Neural Network18 May 2021
- 2021Biometrics: Trust, but Verify14 May 2021
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparison1 May 2021
- 2021Unified Detection of Digital and Physical Face Attacks5 Apr 2021
- 2021LiBRe: A Practical Bayesian Approach to Adversarial Detection27 Mar 2021
- 2021ExAD: An Ensemble Approach for Explanation-based Adversarial Detection22 Mar 2021
- 2021Attribution of Gradient Based Adversarial Attacks for Reverse Engineering of Deceptions19 Mar 2021
- 2021Explaining Adversarial Vulnerability with a Data Sparsity Hypothesis1 Mar 2021
- 2021Center Smoothing: Certified Robustness for Networks with Structured Outputs19 Feb 2021
- 2021Universal Adversarial Perturbations Through the Lens of Deep Steganography: Towards A Fourier Perspective12 Feb 2021
50 newest of 52 All 52 (JSON)
- 2023Certifying LLM Safety against Adversarial Promptingcited by 266
- 2022HoneyModels: Machine Learning Honeypotscited by 0
- 2023Certifying LLM Safety against Adversarial Prompting6 Sep 2023
- 2022HoneyModels: Machine Learning Honeypots21 Feb 2022
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 52
- 2022Practical Evaluation of Adversarial Robustness via Adaptive Auto Attackcited by 44
- 2021LiBRe: A Practical Bayesian Approach to Adversarial Detectioncited by 40
- 2021Policy Smoothing for Provably Robust Reinforcement Learningcited by 40
- 2021Biometrics: Trust, but Verifycited by 39
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2021Unified Detection of Digital and Physical Face Attackscited by 31
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 25
- 2022Defensive Patches for Robust Recognition in the Physical Worldcited by 20
- 2021Universal Adversarial Perturbations Through the Lens of Deep Steganography: Towards A Fourier Perspectivecited by 18
12 most cited of 50 All 50 (JSON)
- 2024Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systems11 Jul 2024
- 2024HOLMES: to Detect Adversarial Examples with Multiple Detectors30 May 2024
- 2024Is ReLU Adversarially Robust?6 May 2024
- 2024Fortify the Guardian, Not the Treasure: Resilient Adversarial Detectors18 Apr 2024
- 2023RobustEdge: Low Power Adversarial Detection for Cloud-Edge Systems5 Sep 2023
- 2023AdvFAS: A robust face anti-spoofing framework against adversarial examples4 Aug 2023
- 2023SysNoise: Exploring and Benchmarking Training-Deployment System Inconsistency1 Jul 2023
- 2023Adversarial Attacks Neutralization via Data Set Randomization21 Jun 2023
- 2023Adaptive Attractors: A Defense Strategy against ML Adversarial Collusion Attacks2 Jun 2023
- 2023Unsupervised Multi-Criteria Adversarial Detection in Deep Image Retrieval9 Apr 2023
- 2023Provable Robustness for Streaming Models with a Sliding Window28 Mar 2023
- 2023Mobile Edge Adversarial Detection for Digital Twinning to the Metaverse with Deep Reinforcement Learning18 Mar 2023
12 newest of 50 All 50 (JSON)