Backdoor Attacks and Countermeasures on Deep Learning: A Comprehensive Review
Not on the map. Why?
Cited by 34 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
This work provides the community with a timely comprehensive review of backdoor attacks and countermeasures on deep learning. According to the attacker's capability and affected stage of the machine learning pipeline, the attack surfaces are recognized to be wide and then formalized into six categorizations: code poisoning, outsourcing, pretrained, data collection, collaborative learning and post-deployment. Accordingly, attacks under each categorization are combed. The countermeasures are categorized into four general classes: blind backdoor removal, offline backdoor inspection, online backdoor inspection, and post backdoor removal. Accordingly, we review countermeasures, and compare and analyze their advantages and disadvantages. We have also reviewed the flip side of backdoor attacks, which are explored for i) protecting intellectual property of deep learning models, ii) acting as a honeypot to catch adversarial example attacks, and iii) verifying data deletion requested by the data contributor.Overall, the research on defense is far behind the attack, and there is no single defense that can prevent all types of backdoor attacks. In some cases, an attacker can intelligently bypass existing defenses with an adaptive attack. Drawing the insights from the systematic review, we also present key areas for future research on the backdoor, such as empirical security evaluations from physical trigger attacks, and in particular, more efficient and practical countermeasures are solicited.
Key facts. Cited by 120 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 25; 2023: 22; 2024: 21; 2025: 25; 2026: 7.
120 papers.
Sort:
By area:
- 2023Large Language Model Alignment: A Surveycited by 241
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 124
- 2023BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learningcited by 112
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agentscited by 106
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2021Backdoor Attack in the Physical Worldcited by 82
- 2024Attention Tracker: Detecting Prompt Injection Attacks in LLMscited by 82
- 2021Backdoor Pre-trained Models Can Transfer to Allcited by 79
- 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasurescited by 69
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 66
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimizationcited by 60
38 more
- 2021Poison Ink: Robust and Invisible Backdoor Attackcited by 50
- 2021This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagationcited by 43
- 2024Test-Time Backdoor Attacks on Multimodal Large Language Modelscited by 35
- 2022ProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Modelcited by 34
- 2022CrowdGuard: Federated Backdoor Detection in Federated Learningcited by 26
- 2021Quantization Backdoors to Deep Learning Commercial Frameworkscited by 25
- 2023BackdoorBox: A Python Toolbox for Backdoor Learningcited by 25
- 2025DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agentcited by 23
- 2022Dangerous Cloaking: Natural Trigger based Backdoor Attacks on Object Detectors in the Physical Worldcited by 20
- 2025Ten Challenging Problems in Federated Foundation Modelscited by 20
- 2025REFINE: Inversion-Free Backdoor Defense via Model Reprogrammingcited by 20
- 2022Transferable Graph Backdoor Attackcited by 19
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2023Data and Model Poisoning Backdoor Attacks on Wireless Federated Learning, and the Defense Mechanisms: A Comprehensive Surveycited by 17
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learningcited by 17
- 2025Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-Tuning and Can Be Mitigated by Machine Unlearningcited by 16
- 2025Natural Reflection Backdoor Attack on Vision Language Model for Autonomous Drivingcited by 16
- 2022A Temporal-Pattern Backdoor Attack to Deep Reinforcement Learningcited by 15
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2021TOP: Backdoor Detection in Neural Networks via Transferability of Perturbationcited by 13
- 2024CleanerCLIP: Fine-grained Counterfactual Semantic Augmentation for Backdoor Defense in Contrastive Learningcited by 13
- 2022Backdoor Vulnerabilities in Normally Trained Deep Learning Modelscited by 12
- 2024Backdooring Bias (B2) into Stable Diffusion Modelscited by 12
- 2022Towards A Critical Evaluation of Robustness for Deep Learning Backdoor Countermeasurescited by 11
- 2022Selective Amnesia: On Efficient, High-Fidelity and Blind Suppression of Backdoor Effects in Trojaned Machine Learning Modelscited by 11
- 2025Robust Anti-Backdoor Instruction Tuning in LVLMscited by 10
- 2021Revisiting Model's Uncertainty and Confidences for Adversarial Example Detectioncited by 9
- 2021Check Your Other Door! Creating Backdoor Attacks in the Frequency Domaincited by 9
- 2022Threat Assessment in Machine Learning based Systemscited by 9
- 2021GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborationscited by 8
- 2022TransCAB: Transferable Clean-Annotation Backdoor to Object Detection with Natural Trigger in Real-Worldcited by 8
- 2023Vertical Federated Learning: Taxonomies, Threats, and Prospectscited by 8
- 2025FIT-Print: Towards False-claim-resistant Model Ownership Verification via Targeted Fingerprintcited by 8
- 2021Poisoning MorphNet for Clean-Label Backdoor Attack to Point Cloudscited by 7
- 2023FreeEagle: Detecting Complex Neural Trojans in Data-Free Casescited by 7
- 2023Efficient Backdoor Attacks for Deep Neural Networks in Real-world Scenarioscited by 7
- 2023Watch Out! Simple Horizontal Class Backdoor Can Trivially Evade Defensecited by 7
- 2023BELT: Old-School Backdoor Attacks can Evade the State-of-the-Art Defense with Backdoor Exclusivity Liftingcited by 7
50 most cited of 120 All 120 (JSON)
- 2026Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers2 Sep 2026
- 2026FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agents6 Jul 2026
- 2026Certification of Machine Learning Models via Directional Sharpness23 Jun 2026
- 2026TEMPLATEFUZZ: Fine-Grained Chat Template Fuzzing for Jailbreaking and Red Teaming LLMs14 Apr 2026
- 2026Graph-Aware Stealthy Poison-Text Backdoors for Text-Attributed Graphs20 Mar 2026
- 2026Detecting and Eliminating Neural Network Backdoors Through Active Paths with Application to Intrusion Detection11 Mar 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025Multi-Agent Framework for Threat Mitigation and Resilience in AI-Based Systems29 Dec 2025
- 2025Robust Defense Strategies for Multimodal Contrastive Learning: Efficient Fine-tuning Against Backdoor Attacks17 Nov 2025
- 2025BackWeak: Backdooring Knowledge Distillation Simply with Weak Triggers and Fine-tuning15 Nov 2025
- 2025Taught Well Learned Ill: Towards Distillation-conditional Backdoor Attack28 Sep 2025
- 2025Your Compiler is Backdooring Your Model: Understanding and Exploiting Compilation Inconsistency Vulnerabilities in Deep Learning Compilers14 Sep 2025
38 more
- 2025Lethe: Purifying Backdoored Large Language Models with Knowledge Dilution28 Aug 2025
- 2025Hidden in the Noise: Unveiling Backdoors in Audio LLMs Alignment through Latent Acoustic Pattern Triggers4 Aug 2025
- 2025DISTIL: Data-Free Inversion of Suspicious Trojan Inputs via Latent Diffusion30 Jul 2025
- 2025ShrinkBox: Backdoor Attack on Object Detection to Disrupt Collision Avoidance in Machine Learning-based Advanced Driver Assistance Systems22 Jul 2025
- 2025Poison Once, Control Anywhere: Clean-Text Visual Backdoors in VLM-based Mobile Agents16 Jun 2025
- 2025Robust Anti-Backdoor Instruction Tuning in LVLMs4 Jun 2025
- 2025Bridging Distribution Shift and AI Safety: Conceptual and Methodological Synergies28 May 2025
- 2025Natural Reflection Backdoor Attack on Vision Language Model for Autonomous Driving9 May 2025
- 2025Backdoor Detection through Replicated Execution of Outsourced Training31 Mar 2025
- 2025A Survey on Unlearnable Data30 Mar 2025
- 2025TeleLoRA: Teleporting Model-Specific Alignment Across LLMs26 Mar 2025
- 2025Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-Tuning and Can Be Mitigated by Machine Unlearning14 Mar 2025
- 2025DeepSeek-Inspired Exploration of RL-based LLMs and Synergy with Wireless Networks: A Survey13 Mar 2025
- 2025Energy-Latency Attacks: A New Adversarial Threat to Deep Learning6 Mar 2025
- 2025From Pixels to Trajectory: Universal Adversarial Example Detection via Temporal Imprints6 Mar 2025
- 2025Char-mander Use mBackdoor! A Study of Cross-lingual Backdoor Attacks in Multilingual LLMs24 Feb 2025
- 2025REFINE: Inversion-Free Backdoor Defense via Model Reprogramming22 Feb 2025
- 2025DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agent18 Feb 2025
- 2025Ten Challenging Problems in Federated Foundation Models14 Feb 2025
- 2025FIT-Print: Towards False-claim-resistant Model Ownership Verification via Targeted Fingerprint26 Jan 2025
- 2024Invisible Textual Backdoor Attacks based on Dual-Trigger23 Dec 2024
- 2024BadSAD: Clean-Label Backdoor Attacks against Deep Semi-Supervised Anomaly Detection17 Dec 2024
- 2024TrapFlow: Controllable Website Fingerprinting Defense via Dynamic Backdoor Learning16 Dec 2024
- 2024Behavior Backdoor for Deep Learning Models2 Dec 2024
- 2024FLARE: Toward Universal Dataset Purification against Backdoor Attacks29 Nov 2024
- 2024DeDe: Detecting Backdoor Samples for SSL Encoders via Decoders25 Nov 2024
- 2024Attention Tracker: Detecting Prompt Injection Attacks in LLMs1 Nov 2024
- 2024CleanerCLIP: Fine-grained Counterfactual Semantic Augmentation for Backdoor Defense in Contrastive Learning26 Sep 2024
- 2024Adversarial Attacks on Machine Learning-Aided Visualizations4 Sep 2024
- 2024TruVRF: Towards Triple-Granularity Verification on Machine Unlearning12 Aug 2024
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learning29 Jul 2024
- 2024Flatness-aware Sequential Learning Generates Resilient Backdoors20 Jul 2024
- 2024Backdooring Bias (B2) into Stable Diffusion Models21 Jun 2024
- 2024Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognition16 Jun 2024
- 2024Principles of Designing Robust Remote Face Anti-Spoofing Systems6 Jun 2024
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun 2024
- 2024Trojans in Large Language Models of Code: A Critical Review through a Trigger-Based Taxonomy5 May 2024
- 2024Test-Time Backdoor Attacks on Multimodal Large Language Models13 Feb 2024
50 newest of 120 All 120 (JSON)
- 2023BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learningcited by 112
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2024Attention Tracker: Detecting Prompt Injection Attacks in LLMscited by 82
- 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasurescited by 69
- 2025Ten Challenging Problems in Federated Foundation Modelscited by 20
- 2024CleanerCLIP: Fine-grained Counterfactual Semantic Augmentation for Backdoor Defense in Contrastive Learningcited by 13
- 2023FreeEagle: Detecting Complex Neural Trojans in Data-Free Casescited by 7
- 2025Hidden in the Noise: Unveiling Backdoors in Audio LLMs Alignment through Latent Acoustic Pattern Triggerscited by 7
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systemscited by 6
- 2024DeDe: Detecting Backdoor Samples for SSL Encoders via Decoderscited by 6
- 2024Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognitioncited by 5
- 2022Backdoors Stuck At The Frontdoor: Multi-Agent Backdoor Attacks That Backfirecited by 4
12 most cited of 24 All 24 (JSON)
- 2026TEMPLATEFUZZ: Fine-Grained Chat Template Fuzzing for Jailbreaking and Red Teaming LLMs14 Apr 2026
- 2026Graph-Aware Stealthy Poison-Text Backdoors for Text-Attributed Graphs20 Mar 2026
- 2025Robust Defense Strategies for Multimodal Contrastive Learning: Efficient Fine-tuning Against Backdoor Attacks17 Nov 2025
- 2025Lethe: Purifying Backdoored Large Language Models with Knowledge Dilution28 Aug 2025
- 2025Hidden in the Noise: Unveiling Backdoors in Audio LLMs Alignment through Latent Acoustic Pattern Triggers4 Aug 2025
- 2025Char-mander Use mBackdoor! A Study of Cross-lingual Backdoor Attacks in Multilingual LLMs24 Feb 2025
- 2025Ten Challenging Problems in Federated Foundation Models14 Feb 2025
- 2024Invisible Textual Backdoor Attacks based on Dual-Trigger23 Dec 2024
- 2024DeDe: Detecting Backdoor Samples for SSL Encoders via Decoders25 Nov 2024
- 2024Attention Tracker: Detecting Prompt Injection Attacks in LLMs1 Nov 2024
- 2024CleanerCLIP: Fine-grained Counterfactual Semantic Augmentation for Backdoor Defense in Contrastive Learning26 Sep 2024
- 2024TruVRF: Towards Triple-Granularity Verification on Machine Unlearning12 Aug 2024
12 newest of 24 All 24 (JSON)
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agentscited by 106
- 2025DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agentcited by 23
- 2025Multi-Agent Framework for Threat Mitigation and Resilience in AI-Based Systemscited by 1
- 2026FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agentscited by 1
- 2026FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agents6 Jul 2026
- 2025Multi-Agent Framework for Threat Mitigation and Resilience in AI-Based Systems29 Dec 2025
- 2025DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agent18 Feb 2025
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun 2024
- 2024Test-Time Backdoor Attacks on Multimodal Large Language Modelscited by 35
- 2025Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-Tuning and Can Be Mitigated by Machine Unlearningcited by 16
- 2025Robust Anti-Backdoor Instruction Tuning in LVLMscited by 10
- 2025Poison Once, Control Anywhere: Clean-Text Visual Backdoors in VLM-based Mobile Agentscited by 1
- 2025Poison Once, Control Anywhere: Clean-Text Visual Backdoors in VLM-based Mobile Agents16 Jun 2025
- 2025Robust Anti-Backdoor Instruction Tuning in LVLMs4 Jun 2025
- 2025Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-Tuning and Can Be Mitigated by Machine Unlearning14 Mar 2025
- 2024Test-Time Backdoor Attacks on Multimodal Large Language Models13 Feb 2024
- 2023Large Language Model Alignment: A Surveycited by 241
- 2023Large Language Model Alignment: A Survey26 Sep 2023
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 124
- 2021Backdoor Attack in the Physical Worldcited by 82
- 2021Backdoor Pre-trained Models Can Transfer to Allcited by 79
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 66
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimizationcited by 60
- 2021Poison Ink: Robust and Invisible Backdoor Attackcited by 50
- 2021This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagationcited by 43
- 2022ProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Modelcited by 34
- 2022CrowdGuard: Federated Backdoor Detection in Federated Learningcited by 26
- 2021Quantization Backdoors to Deep Learning Commercial Frameworkscited by 25
- 2023BackdoorBox: A Python Toolbox for Backdoor Learningcited by 25
12 most cited of 83 All 83 (JSON)
- 2026Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers2 Sep 2026
- 2026Certification of Machine Learning Models via Directional Sharpness23 Jun 2026
- 2026Detecting and Eliminating Neural Network Backdoors Through Active Paths with Application to Intrusion Detection11 Mar 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025BackWeak: Backdooring Knowledge Distillation Simply with Weak Triggers and Fine-tuning15 Nov 2025
- 2025Taught Well Learned Ill: Towards Distillation-conditional Backdoor Attack28 Sep 2025
- 2025Your Compiler is Backdooring Your Model: Understanding and Exploiting Compilation Inconsistency Vulnerabilities in Deep Learning Compilers14 Sep 2025
- 2025ShrinkBox: Backdoor Attack on Object Detection to Disrupt Collision Avoidance in Machine Learning-based Advanced Driver Assistance Systems22 Jul 2025
- 2025Bridging Distribution Shift and AI Safety: Conceptual and Methodological Synergies28 May 2025
- 2025Backdoor Detection through Replicated Execution of Outsourced Training31 Mar 2025
- 2025A Survey on Unlearnable Data30 Mar 2025
- 2025TeleLoRA: Teleporting Model-Specific Alignment Across LLMs26 Mar 2025
12 newest of 83 All 83 (JSON)