mlsanityData to 14 Oct 2026

Unified Safe In-context Image Generation in Multimodal Diffusion Transformers via Restricting Unsafe Information Flows

arXiv 2606.06875 ↗First posted 5 Jun 2026cs.CV cs.CRcited by 0

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

Diffusion transformers (DiTs) equipped with multimodal attention (MM-Attn) have become a dominant paradigm for image generation. However, preventing the generation of harmful content remains a critical challenge, particularly in image-to-image (I2I) editing tasks. Existing safety mechanisms are primarily designed for text-to-image (T2I) synthesis or U-Net-based architectures, which limits their effectiveness for unified safety mitigation in DiT-based frameworks. To bridge this gap, we propose Unified Visual Safety Regulator (UVR), a training-free safe generation framework that regulates unsafe semantics in generated images. UVR is grounded in an analysis of attention dynamics from the perspective of information flow in MM-Attn. We identify a task-independent start-up stage, during which unsafe semantics in output patches rapidly emerge and can be accurately localized, followed by task-specific semantic amplification and interference stages, where harmful signals are further propagated and entangled with benign content. Based on these observations, UVR mitigates unsafe generation through unified, targeted attention modulation and explicit restriction of harmful information flow over the identified unsafe output patches. Experiments across various concepts show that UVR achieves state-of-the-art safety performance by achieving 91% and 77% erase rate in image synthesis and editing tasks, while preserving visual quality and fidelity with minimal degradation. Code is available at https://github.com/deng12yx/UVR.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 36 of its 43 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

36 of 43 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025TRCE: Towards Reliable Malicious Concept Erasure in Text-to-Image Diffusion Models10 Mar
  2. 2025Mitigating Sexual Content Generation via Embedding Distortion in Text-conditioned Diffusion Models31 Jan
  3. 2024EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers29 Dec
  4. 2024Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts16 Oct
  5. 2024Adversarial Attacks and Defenses on Text-to-Image Diffusion Models: A Survey10 Jul
  6. 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models24 May
  7. 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now18 Oct
  8. 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?16 Oct
  9. 2023Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Prompts12 Sep
  10. 2023Unified Concept Editing in Diffusion Models25 Aug
  11. 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models30 Mar
  12. 2023Erasing Concepts from Diffusion Models13 Mar
2 more
  1. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models9 Nov
  2. 2022Red-Teaming the Stable Diffusion Safety Filter3 Oct

Other references · 22

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  11. 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
  12. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
10 more
  1. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
  2. 2020Restricting the Flow: Information Bottlenecks for Attributioncited by 110
  3. 2023ImagenHub: Standardizing the evaluation of conditional image generation modelscited by 77
  4. 2025ConceptAttention: Diffusion Transformers Learn Highly Interpretable Featurescited by 52
  5. 2025Open Problems in Machine Unlearning for AI Safetycited by 51
  6. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  7. 2024Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesiscited by 26
  8. 2025FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image Editingcited by 22
  9. 2025Dense2MoE: Restructuring Diffusion Transformer to MoE for Efficient Text-to-Image Generationcited by 16
  10. 2024Not Just Text: Uncovering Vision Modality Typographic Threats in Image Generation Modelscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Introspective Attention Modulation for Safe Text-to-Image Generation
  2. 2026SafeCtrl: Region-Aware Safety Control for Text-to-Image Diffusion via Detect-Then-Suppress
  3. 2026Robust and Generalizable Safety Steering for Text-to-Image Diffusion Transformers
  4. 2026What Concepts Lie Within? Detecting and Suppressing Risky Content in Diffusion Transformers
  5. 2025Detect-and-Guide: Self-regulation of Diffusion Models for Safe Text-to-Image Generation via Guideline Token Optimization
  6. 2026When Understanding Becomes a Risk: Authenticity and Safety Risks in the Emerging Image Generation Paradigm
  7. 2025Beyond the Safety Tax: Mitigating Unsafe Text-to-Image Generation via External Safety Rectification
  8. 2026When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidance