mlsanityData to 7 Oct 2026

Shallow Diffuse: Robust and Invisible Watermarking through Low-Dimensional Subspaces in Diffusion Models

arXiv 2410.21088 ↗First posted 28 Oct 2024cs.LG cs.CR cs.CVcited by 1

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

The widespread use of AI-generated content from diffusion models has raised significant concerns regarding misinformation and copyright infringement. Watermarking is a crucial technique for identifying these AI-generated images and preventing their misuse. In this paper, we introduce Shallow Diffuse, a new watermarking technique that embeds robust and invisible watermarks into diffusion model outputs. Unlike existing approaches that integrate watermarking throughout the entire diffusion sampling process, Shallow Diffuse decouples these steps by leveraging the presence of a low-dimensional subspace in the image generation process. This method ensures that a substantial portion of the watermark lies in the null space of this subspace, effectively separating it from the image generation process. Our theoretical and empirical analyses show that this decoupling strategy greatly enhances the consistency of data generation and the detectability of the watermark. Extensive experiments further validate that our Shallow Diffuse outperforms existing watermarking methods in terms of robustness and consistency. The codes are released at https://github.com/liwd190019/Shallow-Diffuse.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 49 of its 76 references that are in the map. First posted on arXiv 28 Oct 2024.

Builds on

49 of 76 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
  2. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
  3. 2022Diffusion Models for Adversarial Purification16 May

Other references · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2022Classifier-Free Diffusion Guidancecited by 5,717
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  12. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
34 more
  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  2. 2018Variational image compression with a scale hyperpriorcited by 910
  3. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  4. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  5. 2019Defending Against Neural Fake Newscited by 553
  6. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 440
  7. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  8. 2018HiDDeN: Hiding Data With Deep Networkscited by 384
  9. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  10. 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
  11. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
  12. 2023Self-Consuming Generative Models Go MADcited by 239
  13. 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptionscited by 215
  14. 2023Understanding and Mitigating Copying in Diffusion Modelscited by 205
  15. 2022Convergence for score-based generative modeling with polynomial complexitycited by 176
  16. 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Datacited by 171
  17. 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
  18. 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 157
  19. 2019Robust Invisible Video Watermarking with Attentioncited by 144
  20. 2024A Tale of Tails: Model Collapse as a Change of Scaling Lawscited by 127
  21. 2023On Memorization in Diffusion Modelscited by 122
  22. 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 118
  23. 2024Detecting, Explaining, and Mitigating Memorization in Diffusion Modelscited by 94
  24. 2024Long-form music generation with latent diffusioncited by 88
  25. 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 87
  26. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 58
  27. 2018ReDMark: Framework for Residual Diffusion Watermarking on Deep Networkscited by 55
  28. 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
  29. 2024A Geometric View of Data Complexity: Efficient Local Intrinsic Dimension Estimation with Diffusion Modelscited by 41
  30. 2023On the Posterior Distribution in Denoising: Application to Uncertainty Quantificationcited by 31
  31. 2024Towards Theoretical Understandings of Self-Consuming Generative Modelscited by 28
  32. 2023Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modelingcited by 15
  33. 2024Exploring Low-Dimensional Subspaces in Diffusion Models for Controllable Image Editingcited by 15
  34. 2024Wasserstein proximal operators describe score-based generative models and resolve memorizationcited by 14

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024DiffuseTrace: A Transparent and Flexible Watermarking Scheme for Latent Diffusion Model
  2. 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
  3. 2025Image Watermarking of Generative Diffusion Models
  4. 2023A Recipe for Watermarking Diffusion Models
  5. 2025Dynamic watermarks in images generated by diffusion models
  6. 2026ShapeMark: Robust and Diversity-Preserving Watermarking for Diffusion Models
  7. 2025T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion Models
  8. 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks