mlsanityData to 14 Oct 2026

Purify Once, Edit Freely: Breaking Image Protections under Model Mismatch

arXiv 2603.13028 ↗First posted 13 Mar 2026cs.CR cs.AIcited by 2

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

Diffusion models enable high-fidelity image editing but can also be misused for unauthorized style imitation and harmful content generation. To mitigate these risks, proactive image protection methods embed small, often imperceptible adversarial perturbations into images before sharing to disrupt downstream editing or fine-tuning. However, in realistic post-release scenarios, content owners cannot control downstream processing pipelines, and protections optimized for a surrogate model may fail when attackers use mismatched diffusion pipelines. Existing purification methods can weaken protections but often sacrifice image quality and rarely examine architectural mismatch. We introduce a unified post-release purification framework to evaluate protection survivability under model mismatch. We propose two practical purifiers: VAE-Trans, which corrects protected images via latent-space projection, and EditorClean, which performs instruction-guided reconstruction with a Diffusion Transformer to exploit architectural heterogeneity. Both operate without access to protected images or defense internals. Across 2,100 editing tasks and six representative protection methods, EditorClean consistently restores editability. Compared to protected inputs, it improves PSNR by 3-6 dB and reduces FID by 50-70 percent on downstream edits, while outperforming prior purification baselines by about 2 dB PSNR and 30 percent lower FID. Our results reveal a purify-once, edit-freely failure mode: once purification succeeds, the protective signal is largely removed, enabling unrestricted editing. This highlights the need to evaluate protections under model mismatch and design defenses robust to heterogeneous attackers.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 44 of its 52 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

44 of 52 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025AdvPaint: Protecting Images from Inpainting Manipulation via Adversarial Attention Disruption13 Mar
  2. 2023Can Protective Perturbation Safeguard Personal Data from Being Exploited by Stable Diffusion?30 Nov
  3. 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AI30 Oct
  4. 2023Toward effective protection against diffusion based mimicry through score distillation2 Oct
  5. 2023Mist: Towards Improved Adversarial Examples for Diffusion Models22 May
  6. 2023JPEG Compressed Images Can Bypass Protections Against AI Editing5 Apr
  7. 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesis27 Mar
  8. 2023Raising the Cost of Malicious AI-Powered Image Editing13 Feb
  9. 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples9 Feb
  10. 2022Diffusion Models for Adversarial Purification16 May

Other references · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  11. 2022Scalable Diffusion Models with Transformerscited by 6,054
  12. 2022Classifier-Free Diffusion Guidancecited by 5,847
22 more
  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  5. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  7. 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
  8. 2025Qwen-Image Technical Reportcited by 1,044
  9. 2022Diffusion Models in Vision: A Surveycited by 1,015
  10. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  11. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  12. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  13. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  14. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
  15. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  16. 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 193
  17. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  18. 2021LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognitioncited by 94
  19. 2024Adversarial Perturbations Cannot Reliably Protect Artists From Generative AIcited by 38
  20. 2022Robust Unlearnable Examples: Protecting Data Against Adversarial Learningcited by 35
  21. 2025Is Nano Banana Pro a Low-Level Vision All-Rounder? A Comprehensive Evaluation on 14 Tasks and 40 Datasetscited by 20
  22. 2025Preliminary Explorations with GPT-4o(mni) Native Image Generationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purification
  2. 2025GuardDoor: Safeguarding Against Malicious Diffusion Editing via Protective Backdoors
  3. 2024DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing
  4. 2023EditShield: Protecting Unauthorized Image Editing by Instruction-guided Diffusion Models
  5. 2025Is Perturbation-Based Image Protection Disruptive to Image Editing?
  6. 2025Anti-Diffusion: Preventing Abuse of Modifications of Diffusion-Based Models
  7. 2026On the Controllability-Fidelity Frontier in Diffusion Editing
  8. 2024A Gray-box Attack against Latent Diffusion Model-based Image Editing by Posterior Collapse