Dynamic Backdoor Attacks Against Machine Learning Models
Not on the map. Why?
Cited by 35 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Machine learning (ML) has made tremendous progress during the past decade and is being adopted in various critical real-world applications. However, recent research has shown that ML models are vulnerable to multiple security and privacy attacks. In particular, backdoor attacks against ML models have recently raised a lot of awareness. A successful backdoor attack can cause severe consequences, such as allowing an adversary to bypass critical authentication systems. Current backdooring techniques rely on adding static triggers (with fixed patterns and locations) on ML model inputs which are prone to detection by the current backdoor detection mechanisms. In this paper, we propose the first class of dynamic backdooring techniques against deep neural networks (DNN), namely Random Backdoor, Backdoor Generating Network (BaN), and conditional Backdoor Generating Network (c-BaN). Triggers generated by our techniques can have random patterns and locations, which reduce the efficacy of the current backdoor detection mechanisms. In particular, BaN and c-BaN based on a novel generative network are the first two schemes that algorithmically generate triggers. Moreover, c-BaN is the first conditional backdooring technique that given a target label, it can generate a target-specific trigger. Both BaN and c-BaN are essentially a general framework which renders the adversary the flexibility for further customizing backdoor attacks. We extensively evaluate our techniques on three benchmark datasets: MNIST, CelebA, and CIFAR-10. Our techniques achieve almost perfect attack performance on backdoored data with a negligible utility loss. We further show that our techniques can bypass current state-of-the-art defense mechanisms against backdoor attacks, including ABS, Februus, MNTD, Neural Cleanse, and STRIP.
Key facts. Cited by 147 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 31; 2023: 24; 2024: 31; 2025: 19; 2026: 17.
147 papers.
Sort:
By area:
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2021Graph Unlearningcited by 129
- 2021BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learningcited by 120
- 2021Backdoor Scanning for Deep Neural Networks through K-Arm Optimizationcited by 96
- 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targetscited by 88
- 2021Hidden Backdoors in Human-Centric Language Modelscited by 83
- 2022BppAttack: Stealthy and Efficient Trojan Attacks against Deep Neural Networks via Image Quantization and Contrastive Adversarial Learningcited by 82
- 2021Backdoor Pre-trained Models Can Transfer to Allcited by 79
- 2021Manipulating SGD with Data Ordering Attackscited by 73
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2023Detecting Backdoors in Pre-trained Encoderscited by 53
- 2023Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistencycited by 45
38 more
- 2022Constrained Optimization with Dynamic Bound-scaling for Effective NLPBackdoor Defensecited by 44
- 2023UNICORN: A Unified Backdoor Trigger Inversion Frameworkcited by 44
- 2022Training with More Confidence: Mitigating Injected and Natural Backdoors During Trainingcited by 38
- 2022Rethinking the Reverse-engineering of Trojan Triggerscited by 37
- 2022Fine-Tuning Is All You Need to Mitigate Backdoor Attackscited by 35
- 2024Test-Time Backdoor Attacks on Multimodal Large Language Modelscited by 35
- 2021Property Inference Attacks Against GANscited by 32
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2022Marksman Backdoor: Backdoor Attacks with Arbitrary Target Classcited by 32
- 2022Can't Steal? Cont-Steal! Contrastive Stealing Attacks Against Image Encoderscited by 30
- 2022Energy-Latency Attacks via Sponge Poisoningcited by 29
- 2022Amplifying Membership Exposure via Data Poisoningcited by 29
- 2023Towards Stealthy Backdoor Attacks against Speech Recognition via Elements of Soundcited by 28
- 2022Architectural Backdoors in Neural Networkscited by 24
- 2023Backdoor Attacks Against Dataset Distillationcited by 20
- 2025Data Poisoning in Deep Learning: A Surveycited by 20
- 2022Transferable Graph Backdoor Attackcited by 19
- 2022Going In Style: Audio Backdoors Through Stylistic Transformationscited by 19
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2024SeqMIA: Sequential-Metric Based Membership Inference Attackcited by 19
- 2021Backdoor Attack through Frequency Domaincited by 18
- 2023Sneaky Spikes: Uncovering Stealthy Backdoor Attacks in Spiking Neural Networks with Neuromorphic Datacited by 18
- 2021Stealthy Backdoors as Compression Artifactscited by 17
- 2022A Survey of Neural Trojan Attacks and Defenses in Deep Learningcited by 17
- 2022Backdoor Cleansing with Unlabeled Datacited by 17
- 2023Data and Model Poisoning Backdoor Attacks on Wireless Federated Learning, and the Defense Mechanisms: A Comprehensive Surveycited by 17
- 2024DisDet: Exploring Detectability of Backdoor Attack on Diffusion Modelscited by 17
- 2022Adversarial Cheap Talkcited by 16
- 2023Backdoor Federated Learning by Poisoning Backdoor-Critical Layerscited by 16
- 2021Enhancing Backdoor Attacks with Multi-Level MMD Regularizationcited by 15
- 2023BEAGLE: Forensics of Deep Learning Backdoor Attack for Better Defensecited by 15
- 2025DarkMind: Latent Chain-of-Thought Backdoor in Customized LLMscited by 15
- 2022Compression-Resistant Backdoor Attack against Deep Neural Networkscited by 14
- 2022Jigsaw Puzzle: Selective Backdoor Attack to Subvert Malware Classifierscited by 14
- 2024Preference Poisoning Attacks on Reward Model Learningcited by 14
- 2021Get a Model! Model Hijacking Attack Against Machine Learning Modelscited by 13
- 2023Last One Standing: A Comparative Analysis of Security and Privacy of Soft Prompt Tuning, LoRA, and In-Context Learningcited by 13
- 2024LOTUS: Evasive and Resilient Backdoor Attacks through Sub-Partitioningcited by 13
50 most cited of 147 All 147 (JSON)
- 2026Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers2 Sep 2026
- 2026Does Reasoning Mitigate Backdoor Attacks? A Neuro-Symbolic Perspective31 Aug 2026
- 2026MemCatalyst: Amplifying Data Auditing on Vision-Language Models via Data Poisoning18 Aug 2026
- 2026Input-Aware Dynamic Backdoor Attack Against Quantum Neural Networks13 Jul 2026
- 2026MLQENABLER: Enabling Secure Machine Learning Queries over Encrypted Database in Cloud Computing9 Jul 2026
- 2026DRL-CLBA: A Clean Label Backdoor Attack for Speech Classification via DDPG Reinforcement Learning2 Jul 2026
- 2026BadBone: Backdoor Attacks Against Backbone Models in Visual Prompt Learning29 May 2026
- 2026Detecting Trojaned DNNs via Spectral Regression Analysis20 May 2026
- 2026Toward Polymorphic Backdoor against Semantic Communication via Intensity-Based Poisoning25 Apr 2026
- 2026Safety, Security, and Cognitive Risks in State-Space Models: A Systematic Threat Analysis with Spectral, Stateful, and Capacity Attacks4 Apr 2026
- 2026Inevitable Encounters: Backdoor Attacks Involving Lossy Compression14 Mar 2026
- 2026Osmosis Distillation: Model Hijacking with the Fewest Samples5 Mar 2026
38 more
- 2026Invisible Clean-Label Backdoor Attacks for Generative Data Augmentation3 Feb 2026
- 2026Semantic Containment as a Fundamental Property of Emergent Misalignment2 Feb 2026
- 2026Dynamic Mask-Based Backdoor Attack Against Vision AI Models: A Case Study on Mushroom Detection26 Jan 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2026Detecting Semantic Backdoors in a Mystery Shopping Scenario7 Jan 2026
- 2025DarkHash: A Data-Free Backdoor Attack Against Deep Hashing9 Oct 2025
- 2025Unsupervised Backdoor Detection and Mitigation for Spiking Neural Networks8 Oct 2025
- 2025Geometry-Aware Backdoor Attacks: Leveraging Curvature in Hyperbolic Embeddings7 Oct 2025
- 2025NeuroDeX: Unlocking Diverse Support in Decompiling Deep Neural Network Executables8 Sep 2025
- 2025Sealing The Backdoor: Unlearning Adversarial Text Triggers In Diffusion Models Using Knowledge Distillation20 Aug 2025
- 2025BadBlocks: Low-Cost and Stealthy Backdoor Attacks Tailored for Text-to-Image Diffusion Models5 Aug 2025
- 2025ConSeg: Contextual Backdoor Attack Against Semantic Segmentation26 Jul 2025
- 2025CUBA: Controlled Untargeted Backdoor Attack against Deep Neural Networks20 Jun 2025
- 2025Robust In-Context Reinforcement Learning Under Reward Poisoning Attacks7 Jun 2025
- 2025Variance-Based Defense Against Blended Backdoor Attacks2 Jun 2025
- 2025Semantic-Preserving Prompt Hijacking: A Black-Box Adversarial Attack on Auto-Prompt Optimization26 May 2025
- 2025The Ripple Effect: On Unforeseen Complications of Backdoor Attacks16 May 2025
- 2025Data Poisoning in Deep Learning: A Survey27 Mar 2025
- 2025DeBackdoor: A Deductive Framework for Detecting Backdoor Attacks on Deep Models with Limited Data27 Mar 2025
- 2025Prototype Guided Backdoor Defense26 Mar 2025
- 2025Unifying Perplexing Behaviors in Modified BP Attributions through Alignment Perspective14 Mar 2025
- 2025Online Gradient Boosting Decision Tree: In-Place Updates for Efficient Adding/Deleting Data3 Feb 2025
- 2025DarkMind: Latent Chain-of-Thought Backdoor in Customized LLMs24 Jan 2025
- 2025BADTV: Unveiling Backdoor Threats in Third-Party Task Vectors4 Jan 2025
- 2024Backdoor Attack with Invisible Triggers Based on Model Architecture Modification22 Dec 2024
- 2024Data Free Backdoor Attacks9 Dec 2024
- 2024An Effective and Resilient Backdoor Attack Framework against Deep Neural Networks and Vision Transformers9 Dec 2024
- 2024LADDER: Multi-objective Backdoor Attack via Evolutionary Algorithm28 Nov 2024
- 2024Neutralizing Backdoors through Information Conflicts for Large Language Models27 Nov 2024
- 2024LoBAM: LoRA-Based Backdoor Attack on Model Merging23 Nov 2024
- 2024Prompting the Unseen: Detecting Hidden Backdoors in Black-Box Models14 Nov 2024
- 2024Defending Deep Regression Models against Backdoor Attacks7 Nov 2024
- 2024Act in Collusion: Distributed Multi-Target Backdoor Attacks in Federated Learning6 Nov 2024
- 2024Hypnopaedia-Aware Machine Unlearning via Psychometrics of Artificial Mental Imagery29 Sep 2024
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Survey26 Sep 2024
- 2024Persistent Backdoor Attacks in Continual Learning20 Sep 2024
- 2024Understanding Data Importance in Machine Learning Attacks: Does Valuable Data Pose Greater Harm?5 Sep 2024
- 2024Model Hijacking Attack in Federated Learning4 Aug 2024
50 newest of 147 All 147 (JSON)
- 2021Graph Unlearningcited by 129
- 2021BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learningcited by 120
- 2021Hidden Backdoors in Human-Centric Language Modelscited by 83
- 2021Manipulating SGD with Data Ordering Attackscited by 73
- 2023Detecting Backdoors in Pre-trained Encoderscited by 53
- 2022Constrained Optimization with Dynamic Bound-scaling for Effective NLPBackdoor Defensecited by 44
- 2022Rethinking the Reverse-engineering of Trojan Triggerscited by 37
- 2021Property Inference Attacks Against GANscited by 32
- 2022Amplifying Membership Exposure via Data Poisoningcited by 29
- 2023Towards Stealthy Backdoor Attacks against Speech Recognition via Elements of Soundcited by 28
- 2025Data Poisoning in Deep Learning: A Surveycited by 20
- 2024SeqMIA: Sequential-Metric Based Membership Inference Attackcited by 19
12 most cited of 28 All 28 (JSON)
- 2026DRL-CLBA: A Clean Label Backdoor Attack for Speech Classification via DDPG Reinforcement Learning2 Jul 2026
- 2026BadBone: Backdoor Attacks Against Backbone Models in Visual Prompt Learning29 May 2026
- 2026Invisible Clean-Label Backdoor Attacks for Generative Data Augmentation3 Feb 2026
- 2025ConSeg: Contextual Backdoor Attack Against Semantic Segmentation26 Jul 2025
- 2025Data Poisoning in Deep Learning: A Survey27 Mar 2025
- 2025Online Gradient Boosting Decision Tree: In-Place Updates for Efficient Adding/Deleting Data3 Feb 2025
- 2025BADTV: Unveiling Backdoor Threats in Third-Party Task Vectors4 Jan 2025
- 2024An Effective and Resilient Backdoor Attack Framework against Deep Neural Networks and Vision Transformers9 Dec 2024
- 2024Neutralizing Backdoors through Information Conflicts for Large Language Models27 Nov 2024
- 2024Prompting the Unseen: Detecting Hidden Backdoors in Black-Box Models14 Nov 2024
- 2024Hypnopaedia-Aware Machine Unlearning via Psychometrics of Artificial Mental Imagery29 Sep 2024
- 2024Understanding Data Importance in Machine Learning Attacks: Does Valuable Data Pose Greater Harm?5 Sep 2024
12 newest of 28 All 28 (JSON)
- 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targetscited by 88
- 2024DisDet: Exploring Detectability of Backdoor Attack on Diffusion Modelscited by 17
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Surveycited by 6
- 2025Sealing The Backdoor: Unlearning Adversarial Text Triggers In Diffusion Models Using Knowledge Distillationcited by 2
- 2023RAEDiff: Denoising Diffusion Probabilistic Models Based Reversible Adversarial Examples Self-Generation and Self-Recoverycited by 0
- 2025BadBlocks: Low-Cost and Stealthy Backdoor Attacks Tailored for Text-to-Image Diffusion Modelscited by 0
- 2025Sealing The Backdoor: Unlearning Adversarial Text Triggers In Diffusion Models Using Knowledge Distillation20 Aug 2025
- 2025BadBlocks: Low-Cost and Stealthy Backdoor Attacks Tailored for Text-to-Image Diffusion Models5 Aug 2025
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Survey26 Sep 2024
- 2024DisDet: Exploring Detectability of Backdoor Attack on Diffusion Models5 Feb 2024
- 2023RAEDiff: Denoising Diffusion Probabilistic Models Based Reversible Adversarial Examples Self-Generation and Self-Recovery25 Oct 2023
- 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets10 Mar 2023
- 2024Test-Time Backdoor Attacks on Multimodal Large Language Modelscited by 35
- 2024Evaluating the Efficacy of Prompt-Engineered Large Multimodal Models Versus Fine-Tuned Vision Transformers in Image-Based Security Applicationscited by 3
- 2026MemCatalyst: Amplifying Data Auditing on Vision-Language Models via Data Poisoningcited by 0
- 2026MemCatalyst: Amplifying Data Auditing on Vision-Language Models via Data Poisoning18 Aug 2026
- 2024Evaluating the Efficacy of Prompt-Engineered Large Multimodal Models Versus Fine-Tuned Vision Transformers in Image-Based Security Applications26 Mar 2024
- 2024Test-Time Backdoor Attacks on Multimodal Large Language Models13 Feb 2024
- 2024Preference Poisoning Attacks on Reward Model Learningcited by 14
- 2024Preference Poisoning Attacks on Reward Model Learning2 Feb 2024
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2021Backdoor Scanning for Deep Neural Networks through K-Arm Optimizationcited by 96
- 2022BppAttack: Stealthy and Efficient Trojan Attacks against Deep Neural Networks via Image Quantization and Contrastive Adversarial Learningcited by 82
- 2021Backdoor Pre-trained Models Can Transfer to Allcited by 79
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2023Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistencycited by 45
- 2023UNICORN: A Unified Backdoor Trigger Inversion Frameworkcited by 44
- 2022Training with More Confidence: Mitigating Injected and Natural Backdoors During Trainingcited by 38
- 2022Fine-Tuning Is All You Need to Mitigate Backdoor Attackscited by 35
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2022Marksman Backdoor: Backdoor Attacks with Arbitrary Target Classcited by 32
- 2022Can't Steal? Cont-Steal! Contrastive Stealing Attacks Against Image Encoderscited by 30
12 most cited of 106 All 106 (JSON)
- 2026Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers2 Sep 2026
- 2026Input-Aware Dynamic Backdoor Attack Against Quantum Neural Networks13 Jul 2026
- 2026MLQENABLER: Enabling Secure Machine Learning Queries over Encrypted Database in Cloud Computing9 Jul 2026
- 2026Detecting Trojaned DNNs via Spectral Regression Analysis20 May 2026
- 2026Toward Polymorphic Backdoor against Semantic Communication via Intensity-Based Poisoning25 Apr 2026
- 2026Inevitable Encounters: Backdoor Attacks Involving Lossy Compression14 Mar 2026
- 2026Osmosis Distillation: Model Hijacking with the Fewest Samples5 Mar 2026
- 2026Semantic Containment as a Fundamental Property of Emergent Misalignment2 Feb 2026
- 2026Dynamic Mask-Based Backdoor Attack Against Vision AI Models: A Case Study on Mushroom Detection26 Jan 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2026Detecting Semantic Backdoors in a Mystery Shopping Scenario7 Jan 2026
- 2025DarkHash: A Data-Free Backdoor Attack Against Deep Hashing9 Oct 2025
12 newest of 106 All 106 (JSON)