Intellectual Property Protection of Diffusion Models via the Watermark Diffusion Process
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Diffusion models have rapidly become a vital part of deep generative architectures, given today's increasing demands. Obtaining large, high-performance diffusion models demands significant resources, highlighting their importance as intellectual property worth protecting. However, existing watermarking techniques for ownership verification are insufficient when applied to diffusion models. Very recent research in watermarking diffusion models either exposes watermarks during task generation, which harms the imperceptibility, or is developed for conditional diffusion models that require prompts to trigger the watermark. This paper introduces WDM, a novel watermarking solution for diffusion models without imprinting the watermark during task generation. It involves training a model to concurrently learn a Watermark Diffusion Process (WDP) for embedding watermarks alongside the standard diffusion process for task generation. We provide a detailed theoretical analysis of WDP training and sampling, relating it to a shifted Gaussian diffusion process via the same reverse noise. Extensive experiments are conducted to validate the effectiveness and robustness of our approach in various trigger and watermark data configurations.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 32 of its 46 references that are in the map. First posted on arXiv 6 Jun 2023.
Builds on
32 of 46 references.
Closest ancestors · 4
Same direction, newest first
- 2023Watermarking Diffusion Model21 May
- 2023A Recipe for Watermarking Diffusion Models17 Mar
- 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets10 Mar
- 2022How to Backdoor Diffusion Models?11 Dec
Other references · 28
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Generative Adversarial Networkscited by 5,603
- 2017Neural Discrete Representation Learningcited by 4,650
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2013Auto-Encoding Variational Bayescited by 3,980
16 more
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016Improved Techniques for Training GANscited by 2,938
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2017Embedding Watermarks into Deep Neural Networkscited by 227
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2020Entangled Watermarks as a Defense against Model Extractioncited by 144
- 2017Adversarial Frontier Stitching for Remote Neural Network Watermarkingcited by 110
- 2019DAWN: Dynamic Adversarial Watermarking of Neural Networkscited by 94
- 2021A survey of deep neural network watermarking techniquescited by 69
- 2019How to Prove Your Model Belongs to You: A Blind-Watermark based Framework to Protect Intellectual Property of DNNcited by 58
- 2019Robust Watermarking of Neural Network with Exponential Weightingcited by 48
- 2021Protecting Intellectual Property of Generative Adversarial Networks from Ambiguity Attackcited by 45
- 2022Supervised GAN Watermarking for Intellectual Property Protectioncited by 39
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 7; 2026: 3.
17 papers.
Sort:
By area:
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Modelscited by 26
- 2024A Survey on Responsible Generative AI: What to Generate and What Notcited by 8
- 2025GaussianSeal: Rooting Adaptive Watermarks for 3D Gaussian Generation Modelcited by 4
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challengescited by 4
- 2023Hey That's Mine Imperceptible Watermarks are Preserved in Diffusion Generated Outputscited by 3
- 2025VideoGuard: Protecting Video Content from Unauthorized Editingcited by 3
- 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Goodcited by 2
- 2025Hiding Images in Diffusion Models by Editing Learned Score Functionscited by 2
- 2025When There Is No Decoder: Removing Watermarks from Stable Diffusion Models in a No-box Settingcited by 2
- 2026Towards Backdoor-Based Ownership Verification for Vision-Language-Action Modelscited by 2
- 2024Robustness of Watermarking on Text-to-Image Diffusion Modelscited by 1
5 more
- 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibilitycited by 1
- 2024DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editingcited by 0
- 2024Embedding Watermarks in Diffusion Process for Model Intellectual Property Protectioncited by 0
- 2026UniMark: Unified Adaptive Multi-bit Watermarking for Autoregressive Image Generatorscited by 0
- 2026Diffusion Model Attribution via Spectral Coupling of Denoiser Responsescited by 0
- 2026Diffusion Model Attribution via Spectral Coupling of Denoiser Responses26 Jun 2026
- 2026Towards Backdoor-Based Ownership Verification for Vision-Language-Action Models9 May 2026
- 2026UniMark: Unified Adaptive Multi-bit Watermarking for Autoregressive Image Generators12 Apr 2026
- 2025VideoGuard: Protecting Video Content from Unauthorized Editing5 Aug 2025
- 2025When There Is No Decoder: Removing Watermarks from Stable Diffusion Models in a No-box Setting4 Jul 2025
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challenges13 May 2025
- 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibility16 Apr 2025
- 2025Hiding Images in Diffusion Models by Editing Learned Score Functions24 Mar 2025
- 2025GaussianSeal: Rooting Adaptive Watermarks for 3D Gaussian Generation Model1 Mar 2025
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb 2025
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Models6 Dec 2024
- 2024Embedding Watermarks in Diffusion Process for Model Intellectual Property Protection29 Oct 2024
5 more
- 2024DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing8 Oct 2024
- 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Good24 Sep 2024
- 2024Robustness of Watermarking on Text-to-Image Diffusion Models4 Aug 2024
- 2024A Survey on Responsible Generative AI: What to Generate and What Not8 Apr 2024
- 2023Hey That's Mine Imperceptible Watermarks are Preserved in Diffusion Generated Outputs22 Aug 2023
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Modelscited by 26
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challengescited by 4
- 2023Hey That's Mine Imperceptible Watermarks are Preserved in Diffusion Generated Outputscited by 3
- 2025VideoGuard: Protecting Video Content from Unauthorized Editingcited by 3
- 2025Hiding Images in Diffusion Models by Editing Learned Score Functionscited by 2
- 2025When There Is No Decoder: Removing Watermarks from Stable Diffusion Models in a No-box Settingcited by 2
- 2024Robustness of Watermarking on Text-to-Image Diffusion Modelscited by 1
- 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibilitycited by 1
- 2024DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editingcited by 0
- 2024Embedding Watermarks in Diffusion Process for Model Intellectual Property Protectioncited by 0
- 2026Diffusion Model Attribution via Spectral Coupling of Denoiser Responsescited by 0
- 2026Diffusion Model Attribution via Spectral Coupling of Denoiser Responses26 Jun 2026
- 2025VideoGuard: Protecting Video Content from Unauthorized Editing5 Aug 2025
- 2025When There Is No Decoder: Removing Watermarks from Stable Diffusion Models in a No-box Setting4 Jul 2025
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challenges13 May 2025
- 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibility16 Apr 2025
- 2025Hiding Images in Diffusion Models by Editing Learned Score Functions24 Mar 2025
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Models6 Dec 2024
- 2024Embedding Watermarks in Diffusion Process for Model Intellectual Property Protection29 Oct 2024
- 2024DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing8 Oct 2024
- 2024Robustness of Watermarking on Text-to-Image Diffusion Models4 Aug 2024
- 2023Hey That's Mine Imperceptible Watermarks are Preserved in Diffusion Generated Outputs22 Aug 2023
Similar, not cited
Close in wording, no citation either way
- 2023DiffusionShield: A Watermark for Copyright Protection against Generative Diffusion Models
- 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Models
- 2025Secure and Efficient Watermarking for Latent Diffusion Models in Model Distribution Scenarios
- 2025Image Watermarking of Generative Diffusion Models
- 2024DiffuseTrace: A Transparent and Flexible Watermarking Scheme for Latent Diffusion Model
- 2024A Watermark-Conditioned Diffusion Model for IP Protection
- 2025Guidance Watermarking for Diffusion Models
- 2026WMVLM: Evaluating Diffusion Model Image Watermarking via Vision-Language Models