mlsanityData to 14 Oct 2026

Scaling Exposes the Trigger: Input-Level Backdoor Detection in Text-to-Image Diffusion Models via Cross-Attention Scaling

arXiv 2604.12446 ↗First posted 14 Apr 2026cs.CR cs.CVcited by 0

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

Text-to-image (T2I) diffusion models have achieved remarkable success in image synthesis, but their reliance on large-scale data and open ecosystems introduces serious backdoor security risks. Existing defenses, particularly input-level methods, are more practical for deployment but often rely on observable anomalies that become unreliable under stealthy, semantics-preserving trigger designs. As modern backdoor attacks increasingly embed triggers into natural inputs, these methods degrade substantially, raising a critical question: can more stable, implicit, and trigger-agnostic differences between benign and backdoor inputs be exploited for detection? In this work, we address this challenge from an active probing perspective. We introduce controlled scaling perturbations on cross-attention and uncover a novel phenomenon termed Cross-Attention Scaling Response Divergence (CSRD), where benign and backdoor inputs exhibit systematically different response evolution patterns across denoising steps. Building on this insight, we propose SET, an input-level backdoor detection framework that constructs response-offset features under multi-scale perturbations and learns a compact benign response space from a small set of clean samples. Detection is then performed by measuring deviations from this learned space, without requiring prior knowledge of the attack or access to model training. Extensive experiments demonstrate that SET consistently outperforms existing baselines across diverse attack methods, trigger types, and model settings, with particularly strong gains under stealthy implicit-trigger scenarios. Overall, SET improves AUROC by 9.1% and ACC by 6.5% over the best baseline, highlighting its effectiveness and robustness for practical deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 22 of its 37 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

22 of 37 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Trigger without Trace: Towards Stealthy Backdoor Attack on Text-to-Image Diffusion Models22 Mar
  2. 2025Efficient Input-level Backdoor Defense on Text-to-Image Synthesis via Neuron Activation Variation9 Mar
  3. 2024TERD: A Unified Framework for Safeguarding Diffusion Models Against Backdoors9 Sep
  4. 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Survey6 Aug
  5. 2024Adversarial Attacks and Defenses on Text-to-Image Diffusion Models: A Survey10 Jul
  6. 2024UFID: A Unified Framework for Input-level Backdoor Detection on Diffusion Models1 Apr
  7. 2023VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Models12 Jun
  8. 2023Text-to-Image Diffusion Models can be Easily Backdoored through Multimodal Data Poisoning7 May
  9. 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets10 Mar

Other references · 13

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  9. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
  10. 2023SCALE-UP: An Efficient Black-box Input-level Backdoor Detection via Analyzing Scaled Prediction Consistencycited by 97
  11. 2022Rickrolling the Artist: Injecting Backdoors into Text Encoders for Text-to-Image Synthesiscited by 59
  12. 2024IBD-PSC: Input-level Backdoor Detection via Parameter-oriented Scaling Consistencycited by 39
1 more
  1. 2024Prompting for products: Investigating design space exploration strategies for text-to-image generative modelscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Backdoor Defense in Diffusion Models via Spatial Attention Unlearning
  2. 2026Learning Normal Diffusion Dynamics for Backdoor Defense in Text-to-Image Models
  3. 2025Dynamic Attention Analysis for Backdoor Detection in Text-to-Image Diffusion Models
  4. 2026Awakening the Hydra: Stabilizing Multi-Concept Backdoor Injection in Text-to-Image Diffusion Models
  5. 2026Tuning Just Enough: Lightweight Backdoor Attacks on Multi-Encoder Diffusion Models
  6. 2024T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Models
  7. 2026Semantic-level Backdoor Attack against Text-to-Image Diffusion Models
  8. 2025Gungnir: Exploiting Stylistic Features in Images for Backdoor Attacks on Diffusion Models