Shallow Diffuse: Robust and Invisible Watermarking through Low-Dimensional Subspaces in Diffusion Models
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
The widespread use of AI-generated content from diffusion models has raised significant concerns regarding misinformation and copyright infringement. Watermarking is a crucial technique for identifying these AI-generated images and preventing their misuse. In this paper, we introduce Shallow Diffuse, a new watermarking technique that embeds robust and invisible watermarks into diffusion model outputs. Unlike existing approaches that integrate watermarking throughout the entire diffusion sampling process, Shallow Diffuse decouples these steps by leveraging the presence of a low-dimensional subspace in the image generation process. This method ensures that a substantial portion of the watermark lies in the null space of this subspace, effectively separating it from the image generation process. Our theoretical and empirical analyses show that this decoupling strategy greatly enhances the consistency of data generation and the detectability of the watermark. Extensive experiments further validate that our Shallow Diffuse outperforms existing watermarking methods in terms of robustness and consistency. The codes are released at https://github.com/liwd190019/Shallow-Diffuse.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 49 of its 76 references that are in the map. First posted on arXiv 28 Oct 2024.
Builds on
49 of 76 references.
Closest ancestors · 3
Same direction, newest first
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
- 2022Diffusion Models for Adversarial Purification16 May
Other references · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
34 more
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2019Defending Against Neural Fake Newscited by 553
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 440
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2023Self-Consuming Generative Models Go MADcited by 239
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptionscited by 215
- 2023Understanding and Mitigating Copying in Diffusion Modelscited by 205
- 2022Convergence for score-based generative modeling with polynomial complexitycited by 176
- 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Datacited by 171
- 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 157
- 2019Robust Invisible Video Watermarking with Attentioncited by 144
- 2024A Tale of Tails: Model Collapse as a Change of Scaling Lawscited by 127
- 2023On Memorization in Diffusion Modelscited by 122
- 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 118
- 2024Detecting, Explaining, and Mitigating Memorization in Diffusion Modelscited by 94
- 2024Long-form music generation with latent diffusioncited by 88
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 87
- 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 58
- 2018ReDMark: Framework for Residual Diffusion Watermarking on Deep Networkscited by 55
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
- 2024A Geometric View of Data Complexity: Efficient Local Intrinsic Dimension Estimation with Diffusion Modelscited by 41
- 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantificationcited by 31
- 2024Towards Theoretical Understandings of Self-Consuming Generative Modelscited by 28
- 2023Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modelingcited by 15
- 2024Exploring Low-Dimensional Subspaces in Diffusion Models for Controllable Image Editingcited by 15
- 2024Wasserstein proximal operators describe score-based generative models and resolve memorizationcited by 14
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024DiffuseTrace: A Transparent and Flexible Watermarking Scheme for Latent Diffusion Model
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
- 2025Image Watermarking of Generative Diffusion Models
- 2023A Recipe for Watermarking Diffusion Models
- 2025Dynamic watermarks in images generated by diffusion models
- 2026ShapeMark: Robust and Diversity-Preserving Watermarking for Diffusion Models
- 2025T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion Models
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks