GuardDoor: Safeguarding Against Malicious Diffusion Editing via Protective Backdoors
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
The growing accessibility of diffusion models has revolutionized image editing but also raised significant concerns about unauthorized modifications, such as misinformation and plagiarism. Existing countermeasures largely rely on adversarial perturbations designed to disrupt diffusion model outputs. However, these approaches are found to be easily neutralized by simple image preprocessing techniques, such as compression and noise addition. To address this limitation, we propose GuardDoor, a novel and robust protection mechanism that fosters collaboration between image owners and model providers. Specifically, the model provider participating in the mechanism fine-tunes the image encoder to embed a protective backdoor, allowing image owners to request the attachment of imperceptible triggers to their images. When unauthorized users attempt to edit these protected images with this diffusion model, the model produces meaningless outputs, reducing the risk of malicious image editing. Our method demonstrates enhanced robustness against image preprocessing operations and is scalable for large-scale deployment. This work underscores the potential of cooperative frameworks between model providers and image owners to safeguard digital content in the era of generative AI.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 35 of its 47 references that are in the map. First posted on arXiv 5 Mar 2025.
Builds on
35 of 47 references.
Closest ancestors · 13
Same direction, newest first
- 2024Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editing25 Nov
- 2024CopyrightMeter: Revisiting Copyright Protection in Text-to-image Models20 Nov
- 2024AdvI2I: Adversarial Image Attack on Image-to-Image Diffusion models28 Oct
- 2024Prompt-Agnostic Adversarial Perturbation for Customized Diffusion Models20 Aug
- 2024Disrupting Diffusion-based Inpainters with Semantic Digression14 Jul
- 2024Rethinking and Red-Teaming Protective Perturbation in Personalized Diffusion Models27 Jun
- 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AI30 Oct
- 2023Toward effective protection against diffusion based mimicry through score distillation2 Oct
- 2023My Art My Choice: Adversarial Protection Against Unruly AI6 Sep
- 2023Mist: Towards Improved Adversarial Examples for Diffusion Models22 May
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesis27 Mar
- 2023Raising the Cost of Malicious AI-Powered Image Editing13 Feb
1 more
Other references · 22
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2020Backdoor Learning: A Surveycited by 412
10 more
- 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 338
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 124
- 2024Adversarial Perturbations Cannot Reliably Protect Artists From Generative AIcited by 38
- 2023Visual Instruction Inversion: Image Editing via Visual Promptingcited by 26
- 2021A survey on Variational Autoencoders from a GreenAI perspectivecited by 22
- 2024Backdoor Contrastive Learning via Bi-level Trigger Optimizationcited by 14
- 2024DiffVax: Optimization-Free Image Immunization Against Diffusion-Based Editingcited by 10
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025SemVink: Advancing VLMs' Semantic Understanding of Optical Illusions via Visual Global Thinkingcited by 5
- 2025Immunizing Images from Text to Image Editing via Adversarial Cross-Attentioncited by 2
- 2026Representation Learning in Diffusion and Flow-based Model: An Application Aspectcited by 0
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalitiescited by 0
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026Representation Learning in Diffusion and Flow-based Model: An Application Aspect25 Aug 2026
- 2025Immunizing Images from Text to Image Editing via Adversarial Cross-Attention12 Sep 2025
- 2025SemVink: Advancing VLMs' Semantic Understanding of Optical Illusions via Visual Global Thinking3 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing
- 2024Invisible Backdoor Attacks on Diffusion Models
- 2026Purify Once, Edit Freely: Breaking Image Protections under Model Mismatch
- 2025PersGuard: Preventing Malicious Personalization in Text-to-Image Diffusion Models via Model Backdoors
- 2023EditShield: Protecting Unauthorized Image Editing by Instruction-guided Diffusion Models
- 2024Attack as Defense: Run-time Backdoor Implantation for Image Content Protection ↗
- 2025Anti-Diffusion: Preventing Abuse of Modifications of Diffusion-Based Models
- 2023Elijah: Eliminating Backdoors Injected in Diffusion Models via Distribution Shift