Backdoor Sentinel: Detecting and Detoxifying Backdoors in Diffusion Models via Temporal Noise Consistency
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Diffusion models have been widely deployed in AIGC services, but their reliance on opaque training data exposes them to backdoor attacks. In practical auditing scenarios, auditors are typically unable to access model parameters due to intellectual property protection, making white-box or query-intensive detection impractical. After detection, existing detoxification approaches are trapped in a dilemma between detoxification effectiveness and generation quality for service providers. We reveal Temporal Noise Consistency (TNC), a previously unreported phenomenon in which backdoor activation disrupts the consistency of noise predictions between adjacent diffusion timesteps within specific temporal segments, while clean inputs remain stable. Based on this finding, we propose TNC-Defense, a closed-loop framework for gray-box backdoor detection and model repair. Specifically, TNC-Detect (for auditors) uses inference-stage adjacent-noise statistics to detect backdoors and precisely localize anomalous timesteps without model-weight access. TNC-Detox (for service providers) utilizes these locations to perform trigger-agnostic, timestep-aware correction of the generation path, suppressing backdoor behavior while reducing detoxification cost. Across five representative backdoor attacks and state-of-the-art defenses, TNC-Defense improves the average detection accuracy by 11% with negligible additional overhead, and invalidates an average of 98.5% of triggered samples with only a mild degradation in generation quality. Our code is publicly available at: https://github.com/binzhwang/TNC-Defense.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 47 of its 61 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
47 of 61 references.
Closest ancestors · 15
Same direction, newest first
- 2025Sealing The Backdoor: Unlearning Adversarial Text Triggers In Diffusion Models Using Knowledge Distillation20 Aug
- 2025Backdoor Defense in Diffusion Models via Spatial Attention Unlearning21 Apr
- 2024PureDiffusion: Using Backdoor to Counter Backdoor in Generative Diffusion Models20 Sep
- 2024TERD: A Unified Framework for Safeguarding Diffusion Models Against Backdoors9 Sep
- 2024T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Models5 Jul
- 2024Backdooring Bias (B2) into Stable Diffusion Models21 Jun
- 2024UFID: A Unified Framework for Input-level Backdoor Detection on Diffusion Models1 Apr
- 2024DisDet: Exploring Detectability of Backdoor Attack on Diffusion Models5 Feb
- 2023Elijah: Eliminating Backdoors Injected in Diffusion Models via Distribution Shift27 Nov
- 2023Unified Concept Editing in Diffusion Models25 Aug
- 2023VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Models12 Jun
- 2023Personalization as a Shortcut for Few-Shot Backdoor Attack against Text-to-Image Diffusion Models18 May
3 more
Other references · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
20 more
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 437
- 2020CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotationscited by 109
- 2021RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Modelscited by 97
- 2023SCALE-UP: An Efficient Black-box Input-level Backdoor Detection via Analyzing Scaled Prediction Consistencycited by 93
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 72
- 2019Design and Evaluation of a Multi-Domain Trojan Detection Method on Deep Neural Networkscited by 66
- 2022Rickrolling the Artist: Injecting Backdoors into Text Encoders for Text-to-Image Synthesiscited by 59
- 2023Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistencycited by 45
- 2024IBD-PSC: Input-level Backdoor Detection via Parameter-oriented Scaling Consistencycited by 38
- 2023ReFACT: Updating Text-to-Image Models by Editing the Text Encodercited by 32
- 2025Enhancing Creative Generation on Stable Diffusion-based Modelscited by 13
- 2020Can We Mitigate Backdoor Attack Using Adversarial Detection Methods?cited by 8
- 2025SafeSplit: A Novel Defense Against Client-Side Backdoor Attacks in Split Learning (Full Version)cited by 7
- 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusioncited by 5
- 2024Memory Backdoor Attacks on Neural Networkscited by 3
- 2025Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Diff-Cleanse: Identifying and Mitigating Backdoor Attacks in Diffusion Models
- 2026TEMPO-Diffusion: Temporally Exposed Malicious Poisoning of Diffusion Models
- 2026SpecGuard: Inference-Time Backdoor Detection For Free
- 2025A Dual-Purpose Framework for Backdoor Defense and Backdoor Amplification in Diffusion Models
- 2026Self-Purification Mitigates Backdoors in Multimodal Diffusion Language Models
- 2026Learning Normal Diffusion Dynamics for Backdoor Defense in Text-to-Image Models
- 2024How to Backdoor Consistency Models?
- 2025Lie Detector: Unified Backdoor Detection via Cross-Examination Framework