On the Effectiveness of Adversarial Training against Backdoor Attacks
Not on the map. Why?
Abstract (arXiv)
DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in the presence of a predefined trigger pattern, which can be easily realized via poisoning a small amount of data. In general, adversarial training is believed to defend against backdoor attacks since it helps models to keep their prediction unchanged even if we perturb the input image (as long as within a feasible range). Unfortunately, few previous studies succeed in doing so. To explore whether adversarial training could defend against backdoor attacks or not, we conduct extensive experiments across different threat models and perturbation budgets, and find the threat model in adversarial training matters. For instance, adversarial training with spatial adversarial examples provides notable robustness against commonly-used patch-based backdoor attacks. We further propose a hybrid strategy which provides satisfactory robustness across different backdoor attacks.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 43 of its 56 references that are in the map. First posted on arXiv 22 Feb 2022.
Builds on
43 of 56 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2013Intriguing properties of neural networkscited by 5,114
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
31 more
- 2020Dataset Condensation with Gradient Matchingcited by 510
- 2020Backdoor Learning: A Surveycited by 412
- 2020Do Adversarially Robust ImageNet Models Transfer Better?cited by 315
- 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
- 2019Label-Consistent Backdoor Attackscited by 285
- 2019Adversarial Examples Improve Image Recognitioncited by 283
- 2021Anti-Backdoor Learning: Training Clean Models on Poisoned Datacited by 258
- 2020Attacks Which Do Not Kill Training Make Adversarial Learning Strongercited by 242
- 2019A new Backdoor Attack in CNNs by training set corruption without label poisoningcited by 237
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 230
- 2020Bag of Tricks for Adversarial Trainingcited by 199
- 2020Geometry-aware Instance-reweighted Adversarial Trainingcited by 198
- 2018Spatially Transformed Adversarial Examplescited by 195
- 2019Adversarial Training and Robustness for Multiple Perturbationscited by 182
- 2020Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defensescited by 171
- 2021Adversarial Unlearning of Backdoors via Implicit Hypergradientcited by 160
- 2020Witches' Brew: Industrial Scale Data Poisoning via Gradient Matchingcited by 156
- 2021Poisoning and Backdooring Contrastive Learningcited by 149
- 2020Perceptual Adversarial Robustness: Defense Against Unseen Threat Modelscited by 137
- 2020Bridging Mode Connectivity in Loss Landscapes and Adversarial Robustnesscited by 130
- 2020RAB: Provable Robustness Against Backdoor Attackscited by 115
- 2021Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from Scratchcited by 98
- 2019Adversarial Robustness Against the Union of Multiple Perturbation Modelscited by 88
- 2020Strong Data Augmentation Sanitizes Poisoning and Backdoor Attacks Without an Accuracy Tradeoffcited by 86
- 2020On the Effectiveness of Mitigating Data Poisoning Attacks with Gradient Shapingcited by 82
- 2021Improving Adversarial Robustness via Channel-wise Activation Suppressingcited by 76
- 2019advertorch v0.1: An Adversarial Robustness Toolbox based on PyTorchcited by 69
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2022Few-Shot Backdoor Attacks on Visual Object Trackingcited by 35
- 2021DP-InstaHide: Provably Defusing Poisoning and Backdoor Attacks with Differentially Private Data Augmentationscited by 33
- 2021What Doesn't Kill You Makes You Robust(er): How to Adversarially Train against Data Poisoningcited by 22
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 6; 2025: 1; 2026: 2.
15 papers.
Sort:
By area:
- 2023Shared Adversarial Unlearning: Backdoor Mitigation by Unlearning Shared Adversarial Examplescited by 40
- 2024CROW: Eliminating Backdoors from Large Language Models via Internal Consistency Regularizationcited by 29
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2022Backdoor Vulnerabilities in Normally Trained Deep Learning Modelscited by 12
- 2022RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Modelcited by 11
- 2024Adversarial Backdoor Defense in CLIPcited by 10
- 2024Towards Unified Robustness Against Both Backdoor and Adversarial Attackscited by 9
- 2024Adversarial Training: A Surveycited by 6
- 2023Universal Detection of Backdoor Attacks via Density-based Clustering and Centroids Analysiscited by 5
- 2024DeTrigger: A Gradient-Centric Approach to Backdoor Attack Mitigation in Federated Learningcited by 5
- 2023Adversarial Robustness Unhardening via Backdoor Attacks in Federated Learningcited by 1
3 more
- 2026From Parameters to Feature Space: Task Arithmetic for Backdoor Mitigation in Model Mergingcited by 1
- 2025NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learningcited by 0
- 2026Rethinking Backdoor Adversarial Unlearning through the Lens of Catastrophic Forgetting in Continual Learningcited by 0
- 2026Rethinking Backdoor Adversarial Unlearning through the Lens of Catastrophic Forgetting in Continual Learning12 Jun 2026
- 2026From Parameters to Feature Space: Task Arithmetic for Backdoor Mitigation in Model Merging10 Jun 2026
- 2025NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learning7 Aug 2025
- 2024DeTrigger: A Gradient-Centric Approach to Backdoor Attack Mitigation in Federated Learning19 Nov 2024
- 2024CROW: Eliminating Backdoors from Large Language Models via Internal Consistency Regularization18 Nov 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Adversarial Training: A Survey19 Oct 2024
- 2024Adversarial Backdoor Defense in CLIP24 Sep 2024
- 2024Towards Unified Robustness Against Both Backdoor and Adversarial Attacks28 May 2024
- 2023Defenses in Adversarial Machine Learning: A Survey13 Dec 2023
- 2023Adversarial Robustness Unhardening via Backdoor Attacks in Federated Learning17 Oct 2023
- 2023Shared Adversarial Unlearning: Backdoor Mitigation by Unlearning Shared Adversarial Examples20 Jul 2023
- 2023Shared Adversarial Unlearning: Backdoor Mitigation by Unlearning Shared Adversarial Examplescited by 40
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2022Backdoor Vulnerabilities in Normally Trained Deep Learning Modelscited by 12
- 2022RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Modelcited by 11
- 2024Towards Unified Robustness Against Both Backdoor and Adversarial Attackscited by 9
- 2024Adversarial Training: A Surveycited by 6
- 2023Universal Detection of Backdoor Attacks via Density-based Clustering and Centroids Analysiscited by 5
- 2024DeTrigger: A Gradient-Centric Approach to Backdoor Attack Mitigation in Federated Learningcited by 5
- 2023Adversarial Robustness Unhardening via Backdoor Attacks in Federated Learningcited by 1
- 2026From Parameters to Feature Space: Task Arithmetic for Backdoor Mitigation in Model Mergingcited by 1
- 2025NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learningcited by 0
- 2026From Parameters to Feature Space: Task Arithmetic for Backdoor Mitigation in Model Merging10 Jun 2026
- 2025NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learning7 Aug 2025
- 2024DeTrigger: A Gradient-Centric Approach to Backdoor Attack Mitigation in Federated Learning19 Nov 2024
- 2024Adversarial Training: A Survey19 Oct 2024
- 2024Towards Unified Robustness Against Both Backdoor and Adversarial Attacks28 May 2024
- 2023Defenses in Adversarial Machine Learning: A Survey13 Dec 2023
- 2023Adversarial Robustness Unhardening via Backdoor Attacks in Federated Learning17 Oct 2023
- 2023Shared Adversarial Unlearning: Backdoor Mitigation by Unlearning Shared Adversarial Examples20 Jul 2023
- 2023Universal Detection of Backdoor Attacks via Density-based Clustering and Centroids Analysis11 Jan 2023
- 2022Backdoor Vulnerabilities in Normally Trained Deep Learning Models29 Nov 2022
- 2022RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Model1 Jun 2022