mlsanityData to 7 Oct 2026

DisDet: Exploring Detectability of Backdoor Attack on Diffusion Models

arXiv 2402.02739 ↗First posted 5 Feb 2024cs.CR cs.CV cs.LGcited by 17

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

In the exciting generative AI era, the diffusion model has emerged as a very powerful and widely adopted content generation and editing tool for various data modalities, making the study of their potential security risks very necessary and critical. Very recently, some pioneering works have shown the vulnerability of the diffusion model against backdoor attacks, calling for in-depth analysis and investigation of the security challenges of this popular and fundamental AI technique. In this paper, for the first time, we systematically explore the detectability of the poisoned noise input for the backdoored diffusion models, an important performance metric yet little explored in the existing works. Starting from the perspective of a defender, we first analyze the properties of the trigger pattern in the existing diffusion backdoor attacks, discovering the important role of distribution discrepancy in Trojan detection. Based on this finding, we propose a low-cost trigger detection mechanism that can effectively identify the poisoned input noise. We then take a further step to study the same problem from the attack side, proposing a backdoor attack strategy that can learn the unnoticeable trigger to evade our proposed detection scheme. Empirical evaluations across various diffusion models and datasets demonstrate the effectiveness of the proposed trigger detection and detection-evading attack strategy. For trigger detection, our distribution discrepancy-based solution can achieve a 100% detection rate for the Trojan triggers used in the existing works. For evading trigger detection, our proposed stealthy trigger design approach performs end-to-end learning to make the distribution of poisoned noise input approach that of benign noise, enabling nearly 100% detection pass rate with very high attack and benign performance for the backdoored diffusion models.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 46 of its 60 references that are in the map. First posted on arXiv 5 Feb 2024.

Builds on

46 of 60 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets10 Mar
  2. 2022How to Backdoor Diffusion Models?11 Dec

Other references · 44

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  12. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
32 more
  1. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  3. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  4. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  5. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  6. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  7. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  8. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  9. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  10. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  11. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  12. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  13. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  14. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  15. 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
  16. 2018Spectral Signatures in Backdoor Attackscited by 457
  17. 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 437
  18. 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 429
  19. 2019Hidden Trigger Backdoor Attackscited by 359
  20. 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
  21. 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 338
  22. 2020Input-Aware Dynamic Backdoor Attackcited by 304
  23. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  24. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
  25. 2020Dynamic Backdoor Attacks Against Machine Learning Modelscited by 147
  26. 2020Rethinking the Trigger of Backdoor Attackcited by 76
  27. 2021High Fidelity Visualization of What Your Self-Supervised Representation Knows Aboutcited by 64
  28. 2022Denoising Likelihood Score Matching for Conditional Score-based Data Generationcited by 45
  29. 2022High-Fidelity Guided Image Synthesis with Latent Diffusion Modelscited by 36
  30. 2022TrojViT: Trojan Insertion in Vision Transformerscited by 30
  31. 2022Defending Backdoor Attacks on Vision Transformer via Patch Processingcited by 19
  32. 2023Demystifying Poisoning Backdoor Attacks from a Statistical Perspectivecited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 7; 2026: 2.

17 papers.

Sort:

By area:

  1. 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
  2. 2024TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Modelcited by 33
  3. 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Surveycited by 32
  4. 2024T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Modelscited by 29
  5. 2024UFID: A Unified Framework for Input-level Backdoor Detection on Diffusion Modelscited by 14
  6. 2024ID-Patch: Robust ID Association for Group Photo Personalizationcited by 11
  7. 2024SIDE: Surrogate Conditional Data Extraction from Diffusion Modelscited by 7
  8. 2025BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Modelcited by 7
  9. 2024PureDiffusion: Using Backdoor to Counter Backdoor in Generative Diffusion Modelscited by 6
  10. 2025A Dual-Purpose Framework for Backdoor Defense and Backdoor Amplification in Diffusion Modelscited by 3
  11. 2025Dynamic Attention Analysis for Backdoor Detection in Text-to-Image Diffusion Modelscited by 3
  12. 2025Parasite: A Steganography-based Backdoor Attack Framework for Diffusion Modelscited by 2
5 more
  1. 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scalecited by 2
  2. 2024How to Backdoor Consistency Models?cited by 1
  3. 2025Practical, Generalizable and Robust Backdoor Attacks on Text-to-Image Diffusion Modelscited by 1
  4. 2026BadRSSD: Backdoor Attacks on Regularized Self-Supervised Diffusion Modelscited by 1
  5. 2026Backdoor Sentinel: Detecting and Detoxifying Backdoors in Diffusion Models via Temporal Noise Consistencycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Diff-Cleanse: Identifying and Mitigating Backdoor Attacks in Diffusion Models
  2. 2024Invisible Backdoor Attacks on Diffusion Models
  3. 2024TERD: A Unified Framework for Safeguarding Diffusion Models Against Backdoors
  4. 2024Watch the Watcher! Backdoor Attacks on Security-Enhancing Diffusion Models
  5. 2025Data-Chain Backdoor: Do You Trust Diffusion Models as Generative Data Supplier?
  6. 2026TEMPO-Diffusion: Temporally Exposed Malicious Poisoning of Diffusion Models
  7. 2023Leveraging Diffusion-Based Image Variations for Robust Training on Poisoned Data
  8. 2024UIBDiffusion: Universal Imperceptible Backdoor Attack for Diffusion Models