Adversarial Example Defenses: Ensembles of Weak Defenses are not Strong
Not on the map. Why?
Abstract (arXiv)
Ongoing research has proposed several methods to defend neural networks against adversarial examples, many of which researchers have shown to be ineffective. We ask whether a strong defense can be created by combining multiple (possibly weak) defenses. To answer this question, we study three defenses that follow this approach. Two of these are recently proposed defenses that intentionally combine components designed to work well together. A third defense combines three independent defenses. For all the components of these defenses and the combined defenses themselves, we show that an adaptive adversary can create adversarial examples successfully with low distortion. Thus, our work implies that ensemble of weak defenses is not sufficient to provide strong defense against adversarial examples.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 14; 2023: 5; 2024: 1; 2025: 2; 2026: 1.
32 papers.
Sort:
By area:
- 2021Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Themcited by 46
- 2022On the benefits of knowledge distillation for adversarial robustnesscited by 17
- 2021Security and Privacy for Artificial Intelligence: Opportunities and Challengescited by 16
- 2022What You See is Not What the Network Infers: Detecting Adversarial Examples Based on Semantic Contradictioncited by 10
- 2022Enhancing Adversarial Robustness for Deep Metric Learningcited by 10
- 2021On the robustness of randomized classifiers to adversarial examplescited by 9
- 2022How many perturbations break this model? Evaluating robustness beyond adversarial accuracycited by 9
- 2023Differential Analysis of Triggers and Benign Features for Black-Box DNN Backdoor Detectioncited by 6
- 2021Dynamic Defense Approach for Adversarial Robustness in Deep Neural Networks via Stochastic Ensemble Smoothed Modelcited by 4
- 2022The Security of Deep Learning Defences for Medical Imagingcited by 4
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
- 2021Tensor Normalization and Full Distribution Trainingcited by 3
20 more
- 2021Frequency Centric Defense Mechanisms against Adversarial Examplescited by 3
- 2022Hindering Adversarial Attacks with Implicit Neural Representationscited by 3
- 2021BAARD: Blocking Adversarial Examples by Testing for Applicability, Reliability and Decidabilitycited by 2
- 2021DeepMoM: Robust Deep Learning With Median-of-Meanscited by 2
- 2022Rethinking Machine Learning Robustness via its Link with the Out-of-Distribution Problemcited by 2
- 2022Sardino: Ultra-Fast Dynamic Ensemble for Secure Visual Sensing at Mobile Edgecited by 2
- 2022Morphence-2.0: Evasion-Resilient Moving Target Defense Powered by Out-of-Distribution Detectioncited by 2
- 2022Data-free Defense of Black Box Models Against Adversarial Attackscited by 2
- 2023Computational Asymmetries in Robust Classificationcited by 2
- 2025What Really is a Member? Discrediting Membership Inference via Poisoningcited by 2
- 2025Multi-Layer Confidence Scoring for Detection of Out-of-Distribution Samples, Adversarial Attacks, and In-Distribution Misclassificationscited by 2
- 2022Ares: A System-Oriented Wargame Framework for Adversarial MLcited by 1
- 2023Improved Robustness Against Adaptive Attacks With Ensembles and Error-Correcting Output Codescited by 1
- 2023Detection of Adversarial Physical Attacks in Time-Series Image Datacited by 1
- 2024Evaluating the Robustness of Off-Road Autonomous Driving Segmentation against Adversarial Attacks: A Dataset-Centric analysiscited by 1
- 2021On the Importance of Encrypting Deep Featurescited by 0
- 2022A Perturbation Resistant Transformation and Classification System for Deep Neural Networkscited by 0
- 2022Robust Few-shot Learning Without Using any Adversarial Samplescited by 0
- 2022Adversarial Detection by Approximation of Ensemble Boundarycited by 0
- 2026A Convolutional Layer Activation Dimensionality Reduction for Out-of-Distribution and Adversarial Attack Detection Methodscited by 0
- 2026A Convolutional Layer Activation Dimensionality Reduction for Out-of-Distribution and Adversarial Attack Detection Methods10 Aug 2026
- 2025Multi-Layer Confidence Scoring for Detection of Out-of-Distribution Samples, Adversarial Attacks, and In-Distribution Misclassifications22 Dec 2025
- 2025What Really is a Member? Discrediting Membership Inference via Poisoning6 Jun 2025
- 2024Evaluating the Robustness of Off-Road Autonomous Driving Segmentation against Adversarial Attacks: A Dataset-Centric analysis3 Feb 2024
- 2023Refutation of Shapley Values for XAI -- Additional Evidence30 Sep 2023
- 2023Differential Analysis of Triggers and Benign Features for Black-Box DNN Backdoor Detection11 Jul 2023
- 2023Computational Asymmetries in Robust Classification25 Jun 2023
- 2023Detection of Adversarial Physical Attacks in Time-Series Image Data27 Apr 2023
- 2023Improved Robustness Against Adaptive Attacks With Ensembles and Error-Correcting Output Codes4 Mar 2023
- 2022Adversarial Detection by Approximation of Ensemble Boundary18 Nov 2022
- 2022Robust Few-shot Learning Without Using any Adversarial Samples3 Nov 2022
- 2022Data-free Defense of Black Box Models Against Adversarial Attacks3 Nov 2022
20 more
- 2022Ares: A System-Oriented Wargame Framework for Adversarial ML24 Oct 2022
- 2022Hindering Adversarial Attacks with Implicit Neural Representations22 Oct 2022
- 2022A Perturbation Resistant Transformation and Classification System for Deep Neural Networks25 Aug 2022
- 2022How many perturbations break this model? Evaluating robustness beyond adversarial accuracy8 Jul 2022
- 2022Morphence-2.0: Evasion-Resilient Moving Target Defense Powered by Out-of-Distribution Detection15 Jun 2022
- 2022Sardino: Ultra-Fast Dynamic Ensemble for Secure Visual Sensing at Mobile Edge18 Apr 2022
- 2022On the benefits of knowledge distillation for adversarial robustness14 Mar 2022
- 2022Enhancing Adversarial Robustness for Deep Metric Learning2 Mar 2022
- 2022Rethinking Machine Learning Robustness via its Link with the Out-of-Distribution Problem18 Feb 2022
- 2022What You See is Not What the Network Infers: Detecting Adversarial Examples Based on Semantic Contradiction24 Jan 2022
- 2022The Security of Deep Learning Defences for Medical Imaging21 Jan 2022
- 2021Frequency Centric Defense Mechanisms against Adversarial Examples26 Oct 2021
- 2021Tensor Normalization and Full Distribution Training6 Sep 2021
- 2021On the Importance of Encrypting Deep Features16 Aug 2021
- 2021Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Them24 Jul 2021
- 2021DeepMoM: Robust Deep Learning With Median-of-Means28 May 2021
- 2021Dynamic Defense Approach for Adversarial Robustness in Deep Neural Networks via Stochastic Ensemble Smoothed Model6 May 2021
- 2021BAARD: Blocking Adversarial Examples by Testing for Applicability, Reliability and Decidability2 May 2021
- 2021On the robustness of randomized classifiers to adversarial examples22 Feb 2021
- 2021Security and Privacy for Artificial Intelligence: Opportunities and Challenges9 Feb 2021
- 2021Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Themcited by 46
- 2022On the benefits of knowledge distillation for adversarial robustnesscited by 17
- 2021Security and Privacy for Artificial Intelligence: Opportunities and Challengescited by 16
- 2022What You See is Not What the Network Infers: Detecting Adversarial Examples Based on Semantic Contradictioncited by 10
- 2022Enhancing Adversarial Robustness for Deep Metric Learningcited by 10
- 2021On the robustness of randomized classifiers to adversarial examplescited by 9
- 2022How many perturbations break this model? Evaluating robustness beyond adversarial accuracycited by 9
- 2023Differential Analysis of Triggers and Benign Features for Black-Box DNN Backdoor Detectioncited by 6
- 2021Dynamic Defense Approach for Adversarial Robustness in Deep Neural Networks via Stochastic Ensemble Smoothed Modelcited by 4
- 2022The Security of Deep Learning Defences for Medical Imagingcited by 4
- 2023Refutation of Shapley Values for XAI -- Additional Evidencecited by 4
- 2021Tensor Normalization and Full Distribution Trainingcited by 3
12 most cited of 31 All 31 (JSON)
- 2026A Convolutional Layer Activation Dimensionality Reduction for Out-of-Distribution and Adversarial Attack Detection Methods10 Aug 2026
- 2025Multi-Layer Confidence Scoring for Detection of Out-of-Distribution Samples, Adversarial Attacks, and In-Distribution Misclassifications22 Dec 2025
- 2024Evaluating the Robustness of Off-Road Autonomous Driving Segmentation against Adversarial Attacks: A Dataset-Centric analysis3 Feb 2024
- 2023Refutation of Shapley Values for XAI -- Additional Evidence30 Sep 2023
- 2023Differential Analysis of Triggers and Benign Features for Black-Box DNN Backdoor Detection11 Jul 2023
- 2023Computational Asymmetries in Robust Classification25 Jun 2023
- 2023Detection of Adversarial Physical Attacks in Time-Series Image Data27 Apr 2023
- 2023Improved Robustness Against Adaptive Attacks With Ensembles and Error-Correcting Output Codes4 Mar 2023
- 2022Adversarial Detection by Approximation of Ensemble Boundary18 Nov 2022
- 2022Robust Few-shot Learning Without Using any Adversarial Samples3 Nov 2022
- 2022Data-free Defense of Black Box Models Against Adversarial Attacks3 Nov 2022
- 2022Ares: A System-Oriented Wargame Framework for Adversarial ML24 Oct 2022
12 newest of 31 All 31 (JSON)