DisDet: Exploring Detectability of Backdoor Attack on Diffusion Models
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
In the exciting generative AI era, the diffusion model has emerged as a very powerful and widely adopted content generation and editing tool for various data modalities, making the study of their potential security risks very necessary and critical. Very recently, some pioneering works have shown the vulnerability of the diffusion model against backdoor attacks, calling for in-depth analysis and investigation of the security challenges of this popular and fundamental AI technique. In this paper, for the first time, we systematically explore the detectability of the poisoned noise input for the backdoored diffusion models, an important performance metric yet little explored in the existing works. Starting from the perspective of a defender, we first analyze the properties of the trigger pattern in the existing diffusion backdoor attacks, discovering the important role of distribution discrepancy in Trojan detection. Based on this finding, we propose a low-cost trigger detection mechanism that can effectively identify the poisoned input noise. We then take a further step to study the same problem from the attack side, proposing a backdoor attack strategy that can learn the unnoticeable trigger to evade our proposed detection scheme. Empirical evaluations across various diffusion models and datasets demonstrate the effectiveness of the proposed trigger detection and detection-evading attack strategy. For trigger detection, our distribution discrepancy-based solution can achieve a 100% detection rate for the Trojan triggers used in the existing works. For evading trigger detection, our proposed stealthy trigger design approach performs end-to-end learning to make the distribution of poisoned noise input approach that of benign noise, enabling nearly 100% detection pass rate with very high attack and benign performance for the backdoored diffusion models.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 46 of its 60 references that are in the map. First posted on arXiv 5 Feb 2024.
Builds on
46 of 60 references.
Closest ancestors · 2
Same direction, newest first
- 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets10 Mar
- 2022How to Backdoor Diffusion Models?11 Dec
Other references · 44
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
32 more
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2018Spectral Signatures in Backdoor Attackscited by 457
- 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 437
- 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 429
- 2019Hidden Trigger Backdoor Attackscited by 359
- 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
- 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 338
- 2020Input-Aware Dynamic Backdoor Attackcited by 304
- 2022Flexible Diffusion Modeling of Long Videoscited by 294
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
- 2020Dynamic Backdoor Attacks Against Machine Learning Modelscited by 147
- 2020Rethinking the Trigger of Backdoor Attackcited by 76
- 2021High Fidelity Visualization of What Your Self-Supervised Representation Knows Aboutcited by 64
- 2022Denoising Likelihood Score Matching for Conditional Score-based Data Generationcited by 45
- 2022High-Fidelity Guided Image Synthesis with Latent Diffusion Modelscited by 36
- 2022TrojViT: Trojan Insertion in Vision Transformerscited by 30
- 2022Defending Backdoor Attacks on Vision Transformer via Patch Processingcited by 19
- 2023Demystifying Poisoning Backdoor Attacks from a Statistical Perspectivecited by 10
Built on by
Citing papers per year: 2024: 8; 2025: 7; 2026: 2.
17 papers.
Sort:
By area:
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
- 2024TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Modelcited by 33
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Surveycited by 32
- 2024T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Modelscited by 29
- 2024UFID: A Unified Framework for Input-level Backdoor Detection on Diffusion Modelscited by 14
- 2024ID-Patch: Robust ID Association for Group Photo Personalizationcited by 11
- 2024SIDE: Surrogate Conditional Data Extraction from Diffusion Modelscited by 7
- 2025BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Modelcited by 7
- 2024PureDiffusion: Using Backdoor to Counter Backdoor in Generative Diffusion Modelscited by 6
- 2025A Dual-Purpose Framework for Backdoor Defense and Backdoor Amplification in Diffusion Modelscited by 3
- 2025Dynamic Attention Analysis for Backdoor Detection in Text-to-Image Diffusion Modelscited by 3
- 2025Parasite: A Steganography-based Backdoor Attack Framework for Diffusion Modelscited by 2
5 more
- 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scalecited by 2
- 2024How to Backdoor Consistency Models?cited by 1
- 2025Practical, Generalizable and Robust Backdoor Attacks on Text-to-Image Diffusion Modelscited by 1
- 2026BadRSSD: Backdoor Attacks on Regularized Self-Supervised Diffusion Modelscited by 1
- 2026Backdoor Sentinel: Detecting and Detoxifying Backdoors in Diffusion Models via Temporal Noise Consistencycited by 0
- 2026BadRSSD: Backdoor Attacks on Regularized Self-Supervised Diffusion Models1 Mar 2026
- 2026Backdoor Sentinel: Detecting and Detoxifying Backdoors in Diffusion Models via Temporal Noise Consistency2 Feb 2026
- 2025Practical, Generalizable and Robust Backdoor Attacks on Text-to-Image Diffusion Models3 Aug 2025
- 2025Dynamic Attention Analysis for Backdoor Detection in Text-to-Image Diffusion Models29 Apr 2025
- 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scale21 Apr 2025
- 2025Parasite: A Steganography-based Backdoor Attack Framework for Diffusion Models8 Apr 2025
- 2025A Dual-Purpose Framework for Backdoor Defense and Backdoor Amplification in Diffusion Models26 Feb 2025
- 2025BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Model17 Feb 2025
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb 2025
- 2024ID-Patch: Robust ID Association for Group Photo Personalization20 Nov 2024
- 2024How to Backdoor Consistency Models?14 Oct 2024
- 2024SIDE: Surrogate Conditional Data Extraction from Diffusion Models3 Oct 2024
5 more
- 2024PureDiffusion: Using Backdoor to Counter Backdoor in Generative Diffusion Models20 Sep 2024
- 2024TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Model3 Sep 2024
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Survey6 Aug 2024
- 2024T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Models5 Jul 2024
- 2024UFID: A Unified Framework for Input-level Backdoor Detection on Diffusion Models1 Apr 2024
- 2024TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Modelcited by 33
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Surveycited by 32
- 2024T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Modelscited by 29
- 2024UFID: A Unified Framework for Input-level Backdoor Detection on Diffusion Modelscited by 14
- 2024SIDE: Surrogate Conditional Data Extraction from Diffusion Modelscited by 7
- 2025BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Modelcited by 7
- 2024PureDiffusion: Using Backdoor to Counter Backdoor in Generative Diffusion Modelscited by 6
- 2025A Dual-Purpose Framework for Backdoor Defense and Backdoor Amplification in Diffusion Modelscited by 3
- 2025Dynamic Attention Analysis for Backdoor Detection in Text-to-Image Diffusion Modelscited by 3
- 2025Parasite: A Steganography-based Backdoor Attack Framework for Diffusion Modelscited by 2
- 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scalecited by 2
- 2024How to Backdoor Consistency Models?cited by 1
12 most cited of 15 All 15 (JSON)
- 2026BadRSSD: Backdoor Attacks on Regularized Self-Supervised Diffusion Models1 Mar 2026
- 2026Backdoor Sentinel: Detecting and Detoxifying Backdoors in Diffusion Models via Temporal Noise Consistency2 Feb 2026
- 2025Practical, Generalizable and Robust Backdoor Attacks on Text-to-Image Diffusion Models3 Aug 2025
- 2025Dynamic Attention Analysis for Backdoor Detection in Text-to-Image Diffusion Models29 Apr 2025
- 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scale21 Apr 2025
- 2025Parasite: A Steganography-based Backdoor Attack Framework for Diffusion Models8 Apr 2025
- 2025A Dual-Purpose Framework for Backdoor Defense and Backdoor Amplification in Diffusion Models26 Feb 2025
- 2025BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Model17 Feb 2025
- 2024How to Backdoor Consistency Models?14 Oct 2024
- 2024SIDE: Surrogate Conditional Data Extraction from Diffusion Models3 Oct 2024
- 2024PureDiffusion: Using Backdoor to Counter Backdoor in Generative Diffusion Models20 Sep 2024
- 2024TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Model3 Sep 2024
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Diff-Cleanse: Identifying and Mitigating Backdoor Attacks in Diffusion Models
- 2024Invisible Backdoor Attacks on Diffusion Models
- 2024TERD: A Unified Framework for Safeguarding Diffusion Models Against Backdoors
- 2024Watch the Watcher! Backdoor Attacks on Security-Enhancing Diffusion Models
- 2025Data-Chain Backdoor: Do You Trust Diffusion Models as Generative Data Supplier?
- 2026TEMPO-Diffusion: Temporally Exposed Malicious Poisoning of Diffusion Models
- 2023Leveraging Diffusion-Based Image Variations for Robust Training on Poisoned Data
- 2024UIBDiffusion: Universal Imperceptible Backdoor Attack for Diffusion Models