Towards Transferable Defense Against Malicious Image Edits
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Recent approaches employing imperceptible perturbations in input images have demonstrated promising potential to counter malicious manipulations in diffusion-based image editing systems. However, existing methods suffer from limited transferability in cross-model evaluations. To address this, we propose Transferable Defense Against Malicious Image Edits (TDAE), a novel bimodal framework that enhances image immunity against malicious edits through coordinated image-text optimization. Specifically, at the visual defense level, we introduce FlatGrad Defense Mechanism (FDM), which incorporates gradient regularization into the adversarial objective. By explicitly steering the perturbations toward flat minima, FDM amplifies immune robustness against unseen editing models. For textual enhancement protection, we propose an adversarial optimization paradigm named Dynamic Prompt Defense (DPD), which periodically refines text embeddings to align the editing outcomes of immunized images with those of the original images, then updates the images under optimized embeddings. Through iterative adversarial updates to diverse embeddings, DPD enforces the generation of immunized images that seek a broader set of immunity-enhancing features, thereby achieving cross-model transferability. Extensive experimental results demonstrate that our TDAE achieves state-of-the-art performance in mitigating malicious edits under both intra- and cross-model evaluations.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 43 of its 63 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
43 of 63 references.
Closest ancestors · 4
Same direction, newest first
- 2023Targeted Attack Improves Protection against Unauthorized Diffusion Customization7 Oct
- 2023Toward effective protection against diffusion based mimicry through score distillation2 Oct
- 2023Mist: Towards Improved Adversarial Examples for Diffusion Models22 May
- 2023Raising the Cost of Malicious AI-Powered Image Editing13 Feb
Other references · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
27 more
- 2016Adversarial examples in the physical worldcited by 1,762
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 591
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
- 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 352
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2017Adversarial Examples for Semantic Segmentation and Object Detectioncited by 275
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
- 2022Boosting the Transferability of Adversarial Attacks with Reverse Adversarial Perturbationcited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
- 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
- 2023MotionEditor: Editing Video Motion via Content-Aware Diffusioncited by 56
- 2023MovieFactory: Automatic Movie Creation from Text using Large Generative Models for Language and Imagescited by 42
- 2024An Image Is Worth 1000 Lies: Adversarial Transferability across Prompts on Vision-Language Modelscited by 40
- 2021TAFIM: Targeted Adversarial Attacks against Facial Image Manipulationscited by 25
- 2017Boosting Adversarial Attacks with Momentumcited by 23
- 2022Learning to Immunize Images for Tamper Localization and Self-Recoverycited by 19
- 2021Attack as the Best Defense: Nullifying Image-to-image Translation GANs via Limit-aware Adversarial Attackcited by 15
- 2022A Review of Deep Learning-based Approaches for Deepfake Content Detectioncited by 12
- 2020Fawkes: Protecting Privacy against Unauthorized Deep Learning Modelscited by 11
- 2023Transferability Bound Theory: Exploring Relationship between Adversarial Transferability and Flatnesscited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Universal Image Immunization against Diffusion-based Image Editing via Semantic Injection
- 2025DCT-Shield: A Robust Frequency Domain Defense against Malicious Image Editing
- 2025Semantic Mismatch and Perceptual Degradation: A New Perspective on Image Editing Immunity
- 2024DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing
- 2025Dual Attention Guided Defense Against Malicious Edits
- 2025AdvPaint: Protecting Images from Inpainting Manipulation via Adversarial Attention Disruption
- 2025GuardDoor: Safeguarding Against Malicious Diffusion Editing via Protective Backdoors
- 2024Pixel Is Not a Barrier: An Effective Evasion Attack for Pixel-Domain Diffusion Models