mlsanityData to 7 Oct 2026

Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space

arXiv 2404.00230 ↗First posted 30 Mar 2024cs.CVcited by 19

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

Watermarking is a tool for actively identifying and attributing the images generated by latent diffusion models. Existing methods face the dilemma of image quality and watermark robustness. Watermarks with superior image quality usually have inferior robustness against attacks such as blurring and JPEG compression, while watermarks with superior robustness usually significantly damage image quality. This dilemma stems from the traditional paradigm where watermarks are injected and detected in pixel space, relying on pixel perturbation for watermark detection and resilience against attacks. In this paper, we highlight that an effective solution to the problem is to both inject and detect watermarks in the latent diffusion space, and propose Latent Watermark with a progressive training strategy. It weakens the direct connection between quality and robustness and thus alleviates their contradiction. We conduct evaluations on two datasets and against 10 watermark attacks. Six metrics measure the image quality and watermark robustness. Results show that compared to the recently proposed methods such as StableSignature, StegaStamp, RoSteALS, LaWa, TreeRing, and DiffuseTrace, LW not only surpasses them in terms of robustness but also offers superior image quality. Our code will be available at https://github.com/RichardSunnyMeng/LatentWatermark.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 40 of its 64 references that are in the map. First posted on arXiv 30 Mar 2024.

Builds on

40 of 64 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
  2. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
  3. 2023A Recipe for Watermarking Diffusion Models17 Mar

Other references · 37

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
25 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  2. 2018Variational image compression with a scale hyperpriorcited by 910
  3. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  4. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  5. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
  6. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  7. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  8. 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
  9. 2023DIRE for Diffusion-Generated Image Detectioncited by 386
  10. 2022On the detection of synthetic images generated by diffusion modelscited by 282
  11. 2020What makes fake images detectable? Understanding properties that generalizecited by 272
  12. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
  13. 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
  14. 2019Robust Invisible Video Watermarking with Attentioncited by 144
  15. 2022Towards the Detection of Diffusion Model Deepfakescited by 111
  16. 2021Watermarking Images in Self-Supervised Latent Spacescited by 90
  17. 2023Identifying and Mitigating the Security Risks of Generative AIcited by 90
  18. 2023DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuningcited by 82
  19. 2023RoSteALS: Robust Steganography using Autoencoder Latent Spacecited by 54
  20. 2023Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionalitycited by 44
  21. 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
  22. 2023X-IQE: eXplainable Image Quality Evaluation for Text-to-Image Generation with Visual Large Language Modelscited by 28
  23. 2020An Automated and Robust Image Watermarking Scheme Based on Deep Neural Networkscited by 15
  24. 2022De-END: Decoder-driven Watermarking Networkcited by 12
  25. 2023Stable Messenger: Steganography for Message-Concealed Image Generationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 9; 2026: 5.

19 papers.

Sort:

By area:

  1. 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
  2. 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Modelscited by 29
  3. 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Modelscited by 26
  4. 2025Semantic Watermarking Reinvented: Enhancing Robustness and Generation Quality with Fourier Integritycited by 14
  5. 2025Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarkingcited by 9
  6. 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakescited by 7
  7. 2025Safe-VAR: Safe Visual Autoregressive Model for Text-to-Image Generative Watermarkingcited by 4
  8. 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Goodcited by 2
  9. 2024SAT-LDM: Provably Generalizable Image Watermarking for Latent Diffusion Models with Self-Augmented Trainingcited by 2
  10. 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibilitycited by 1
  11. 2025AuthenLoRA: Entangling Stylization with Imperceptible Watermarks for Copyright-Secure LoRA Adapterscited by 1
  12. 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemescited by 1
7 more
  1. 2025Learning Generalizable and Efficient Image Watermarking via Hierarchical Two-Stage Optimizationcited by 0
  2. 2025MOLM: Mixture of LoRA Markerscited by 0
  3. 2025S2LM: Towards Semantic Steganography via Large Language Modelscited by 0
  4. 2026ALIEN: Analytic Latent Watermarking for Controllable Generationcited by 0
  5. 2026Q-Tag: Watermarking Quantum Circuit Generative Modelscited by 0
  6. 2026Gaussian Shannon: High-Precision Diffusion Model Watermarking Based on Communicationcited by 0
  7. 2026Watermarks Attack Watermarks: Re-Watermarking as a Generic Removal Strategycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026On the Intrinsic Limited Robustness of Latent-Based Watermarking
  2. 2024LVMark: Robust Watermark for Latent Video Diffusion Models
  3. 2024Attack-Resilient Image Watermarking Using Stable Diffusion
  4. 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
  5. 2024LaWa: Using Latent Space for In-Generation Image Watermarking
  6. 2025WaterFlow: Learning Fast & Robust Watermarks using Stable Diffusion
  7. 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing
  8. 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks