Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion Models
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Diffusion Models (DMs) have shown remarkable capabilities in various image-generation tasks. However, there are growing concerns that DMs could be used to imitate unauthorized creations and thus raise copyright issues. To address this issue, we propose a novel framework that embeds personal watermarks in the generation of adversarial examples. Such examples can force DMs to generate images with visible watermarks and prevent DMs from imitating unauthorized images. We construct a generator based on conditional adversarial networks and design three losses (adversarial loss, GAN loss, and perturbation loss) to generate adversarial examples that have subtle perturbation but can effectively attack DMs to prevent copyright violations. Training a generator for a personal watermark by our method only requires 5-10 samples within 2-3 minutes, and once the generator is trained, it can generate adversarial examples with that watermark significantly fast (0.2s per image). We conduct extensive experiments in various conditional image-generation scenarios. Compared to existing methods that generate images with chaotic textures, our method adds visible watermarks on the generated images, which is a more straightforward way to indicate copyright violations. We also observe that our adversarial examples exhibit good transferability across unknown generative models. Therefore, this work provides a simple yet powerful way to protect copyright from DM-based imitation.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 48 of its 66 references that are in the map. First posted on arXiv 15 Apr 2024.
Builds on
48 of 66 references.
Closest ancestors · 5
Same direction, newest first
- 2023DiffusionShield: A Watermark for Copyright Protection against Generative Diffusion Models25 May
- 2023Mist: Towards Improved Adversarial Examples for Diffusion Models22 May
- 2023Watermarking Diffusion Model21 May
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples9 Feb
Other references · 43
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
31 more
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
- 2017Countering Adversarial Images using Input Transformationscited by 517
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2017Adversarial Examples for Semantic Segmentation and Object Detectioncited by 275
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
- 2018Generating Adversarial Examples with Adversarial Networkscited by 256
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
- 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 90
- 2018Shield: Fast, Practical Defense and Vaccination for Deep Learning using JPEG Compressioncited by 74
- 2017Adversarial examples for generative modelscited by 58
- 2023Custom-Edit: Text-Guided Image Editing with Customized Diffusion Modelscited by 54
- 2022Supervised GAN Watermarking for Intellectual Property Protectioncited by 39
- 2017Adversarial Examples for Semantic Image Segmentationcited by 33
- 2018Invisible Steganography via Generative Adversarial Networkscited by 21
- 2016Adversarial Images for Variational Autoencoderscited by 19
- 2019Adversarial Robustness of Flow-Based Generative Modelscited by 8
Built on by
Citing papers per year: 2024: 5; 2025: 11; 2026: 6.
22 papers.
Sort:
By area:
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Surveycited by 32
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
- 2025StyleGuard: Preventing Text-to-Image-Model-based Style Mimicry Attacks by Style Perturbationscited by 7
- 2025T2VAttack: Adversarial Attack on Text-to-Video Diffusion Modelscited by 5
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challengescited by 4
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
- 2024High-Frequency Anti-DreamBooth: Robust Defense against Personalized Image Synthesiscited by 3
- 2024Watermarking Visual Concepts for Diffusion Modelscited by 3
- 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purificationcited by 3
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Modelscited by 3
- 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scalecited by 2
- 2025Evaluating Dataset Watermarking for Fine-tuning Traceability of Customized Diffusion Models: A Comprehensive Benchmark and Removal Approachcited by 2
10 more
- 2024Latent Feature and Attention Dual Erasure Attack against Multi-View Diffusion Models for 3D Assets Protectioncited by 1
- 2025Guardians of Generation: Dynamic Inference-Time Copyright Shielding with Adaptive Guidance for AI Image Generationcited by 1
- 2025KGMark: A Diffusion Watermark for Knowledge Graphscited by 1
- 2026Safeguarding Text-to-Image Generative Models Against Unauthorized Knowledge Distillationcited by 1
- 2025Evidencing Unauthorized Training Data from AI Generated Content using Information Isotopescited by 0
- 2026TokenTrace: Multi-Concept Attribution through Watermarked Token Recoverycited by 0
- 2026Q-Tag: Watermarking Quantum Circuit Generative Modelscited by 0
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Modelscited by 0
- 2026IP Protection in the Era of Visual Generative AI: A Surveycited by 0
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Modelscited by 0
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models25 Sep 2026
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Models1 Jun 2026
- 2026Safeguarding Text-to-Image Generative Models Against Unauthorized Knowledge Distillation21 May 2026
- 2026Q-Tag: Watermarking Quantum Circuit Generative Models26 Feb 2026
- 2026TokenTrace: Multi-Concept Attribution through Watermarked Token Recovery22 Feb 2026
- 2025T2VAttack: Adversarial Attack on Text-to-Video Diffusion Models30 Dec 2025
- 2025Evaluating Dataset Watermarking for Fine-tuning Traceability of Customized Diffusion Models: A Comprehensive Benchmark and Removal Approach24 Nov 2025
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models25 Sep 2025
- 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purification17 Sep 2025
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025KGMark: A Diffusion Watermark for Knowledge Graphs29 May 2025
10 more
- 2025StyleGuard: Preventing Text-to-Image-Model-based Style Mimicry Attacks by Style Perturbations24 May 2025
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challenges13 May 2025
- 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scale21 Apr 2025
- 2025Evidencing Unauthorized Training Data from AI Generated Content using Information Isotopes24 Mar 2025
- 2025Guardians of Generation: Dynamic Inference-Time Copyright Shielding with Adaptive Guidance for AI Image Generation19 Mar 2025
- 2024Watermarking Visual Concepts for Diffusion Models18 Nov 2024
- 2024High-Frequency Anti-DreamBooth: Robust Defense against Personalized Image Synthesis12 Sep 2024
- 2024Latent Feature and Attention Dual Erasure Attack against Multi-View Diffusion Models for 3D Assets Protection21 Aug 2024
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Survey6 Aug 2024
- 2024Replication in Visual Diffusion Models: A Survey and Outlook7 Jul 2024
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Surveycited by 32
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
- 2025StyleGuard: Preventing Text-to-Image-Model-based Style Mimicry Attacks by Style Perturbationscited by 7
- 2025T2VAttack: Adversarial Attack on Text-to-Video Diffusion Modelscited by 5
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challengescited by 4
- 2024Watermarking Visual Concepts for Diffusion Modelscited by 3
- 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purificationcited by 3
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Modelscited by 3
- 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scalecited by 2
- 2025Evaluating Dataset Watermarking for Fine-tuning Traceability of Customized Diffusion Models: A Comprehensive Benchmark and Removal Approachcited by 2
- 2024Latent Feature and Attention Dual Erasure Attack against Multi-View Diffusion Models for 3D Assets Protectioncited by 1
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models25 Sep 2026
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Models1 Jun 2026
- 2025T2VAttack: Adversarial Attack on Text-to-Video Diffusion Models30 Dec 2025
- 2025Evaluating Dataset Watermarking for Fine-tuning Traceability of Customized Diffusion Models: A Comprehensive Benchmark and Removal Approach24 Nov 2025
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models25 Sep 2025
- 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purification17 Sep 2025
- 2025StyleGuard: Preventing Text-to-Image-Model-based Style Mimicry Attacks by Style Perturbations24 May 2025
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challenges13 May 2025
- 2025What Lurks Within? Concept Auditing for Shared Diffusion Models at Scale21 Apr 2025
- 2024Watermarking Visual Concepts for Diffusion Models18 Nov 2024
- 2024Latent Feature and Attention Dual Erasure Attack against Multi-View Diffusion Models for 3D Assets Protection21 Aug 2024
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Survey6 Aug 2024
12 newest of 13 All 13 (JSON)
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
- 2024High-Frequency Anti-DreamBooth: Robust Defense against Personalized Image Synthesiscited by 3
- 2025Guardians of Generation: Dynamic Inference-Time Copyright Shielding with Adaptive Guidance for AI Image Generationcited by 1
- 2026Safeguarding Text-to-Image Generative Models Against Unauthorized Knowledge Distillationcited by 1
- 2025Evidencing Unauthorized Training Data from AI Generated Content using Information Isotopescited by 0
- 2026Q-Tag: Watermarking Quantum Circuit Generative Modelscited by 0
- 2026IP Protection in the Era of Visual Generative AI: A Surveycited by 0
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026Safeguarding Text-to-Image Generative Models Against Unauthorized Knowledge Distillation21 May 2026
- 2026Q-Tag: Watermarking Quantum Circuit Generative Models26 Feb 2026
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025Evidencing Unauthorized Training Data from AI Generated Content using Information Isotopes24 Mar 2025
- 2025Guardians of Generation: Dynamic Inference-Time Copyright Shielding with Adaptive Guidance for AI Image Generation19 Mar 2025
- 2024High-Frequency Anti-DreamBooth: Robust Defense against Personalized Image Synthesis12 Sep 2024
Similar, not cited
Close in wording, no citation either way
- 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization
- 2023A Somewhat Robust Image Watermark against Diffusion-based Editing Models
- 2025Image Watermarking of Generative Diffusion Models
- 2023A Recipe for Watermarking Diffusion Models
- 2025Secure and Efficient Watermarking for Latent Diffusion Models in Model Distribution Scenarios
- 2025Forging and Removing Latent-Noise Diffusion Watermarks Using a Single Image
- 2024RoboSignature: Robust Signature and Watermarking on Network Attacks
- 2025Spread them Apart: Towards Robust Watermarking of Generated Content