Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Watermarking is a tool for actively identifying and attributing the images generated by latent diffusion models. Existing methods face the dilemma of image quality and watermark robustness. Watermarks with superior image quality usually have inferior robustness against attacks such as blurring and JPEG compression, while watermarks with superior robustness usually significantly damage image quality. This dilemma stems from the traditional paradigm where watermarks are injected and detected in pixel space, relying on pixel perturbation for watermark detection and resilience against attacks. In this paper, we highlight that an effective solution to the problem is to both inject and detect watermarks in the latent diffusion space, and propose Latent Watermark with a progressive training strategy. It weakens the direct connection between quality and robustness and thus alleviates their contradiction. We conduct evaluations on two datasets and against 10 watermark attacks. Six metrics measure the image quality and watermark robustness. Results show that compared to the recently proposed methods such as StableSignature, StegaStamp, RoSteALS, LaWa, TreeRing, and DiffuseTrace, LW not only surpasses them in terms of robustness but also offers superior image quality. Our code will be available at https://github.com/RichardSunnyMeng/LatentWatermark.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 40 of its 64 references that are in the map. First posted on arXiv 30 Mar 2024.
Builds on
40 of 64 references.
Closest ancestors · 3
Same direction, newest first
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
- 2023A Recipe for Watermarking Diffusion Models17 Mar
Other references · 37
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
25 more
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
- 2023DIRE for Diffusion-Generated Image Detectioncited by 386
- 2022On the detection of synthetic images generated by diffusion modelscited by 282
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2019Robust Invisible Video Watermarking with Attentioncited by 144
- 2022Towards the Detection of Diffusion Model Deepfakescited by 111
- 2021Watermarking Images in Self-Supervised Latent Spacescited by 90
- 2023Identifying and Mitigating the Security Risks of Generative AIcited by 90
- 2023DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuningcited by 82
- 2023RoSteALS: Robust Steganography using Autoencoder Latent Spacecited by 54
- 2023Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionalitycited by 44
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
- 2023X-IQE: eXplainable Image Quality Evaluation for Text-to-Image Generation with Visual Large Language Modelscited by 28
- 2020An Automated and Robust Image Watermarking Scheme Based on Deep Neural Networkscited by 15
- 2022De-END: Decoder-driven Watermarking Networkcited by 12
- 2023Stable Messenger: Steganography for Message-Concealed Image Generationcited by 2
Built on by
Citing papers per year: 2024: 5; 2025: 9; 2026: 5.
19 papers.
Sort:
By area:
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
- 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Modelscited by 29
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Modelscited by 26
- 2025Semantic Watermarking Reinvented: Enhancing Robustness and Generation Quality with Fourier Integritycited by 14
- 2025Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarkingcited by 9
- 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakescited by 7
- 2025Safe-VAR: Safe Visual Autoregressive Model for Text-to-Image Generative Watermarkingcited by 4
- 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Goodcited by 2
- 2024SAT-LDM: Provably Generalizable Image Watermarking for Latent Diffusion Models with Self-Augmented Trainingcited by 2
- 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibilitycited by 1
- 2025AuthenLoRA: Entangling Stylization with Imperceptible Watermarks for Copyright-Secure LoRA Adapterscited by 1
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemescited by 1
7 more
- 2025Learning Generalizable and Efficient Image Watermarking via Hierarchical Two-Stage Optimizationcited by 0
- 2025MOLM: Mixture of LoRA Markerscited by 0
- 2025S2LM: Towards Semantic Steganography via Large Language Modelscited by 0
- 2026ALIEN: Analytic Latent Watermarking for Controllable Generationcited by 0
- 2026Q-Tag: Watermarking Quantum Circuit Generative Modelscited by 0
- 2026Gaussian Shannon: High-Precision Diffusion Model Watermarking Based on Communicationcited by 0
- 2026Watermarks Attack Watermarks: Re-Watermarking as a Generic Removal Strategycited by 0
- 2026Watermarks Attack Watermarks: Re-Watermarking as a Generic Removal Strategy16 May 2026
- 2026Gaussian Shannon: High-Precision Diffusion Model Watermarking Based on Communication27 Mar 2026
- 2026Q-Tag: Watermarking Quantum Circuit Generative Models26 Feb 2026
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemes25 Feb 2026
- 2026ALIEN: Analytic Latent Watermarking for Controllable Generation5 Feb 2026
- 2025AuthenLoRA: Entangling Stylization with Imperceptible Watermarks for Copyright-Secure LoRA Adapters26 Nov 2025
- 2025S2LM: Towards Semantic Steganography via Large Language Models7 Nov 2025
- 2025MOLM: Mixture of LoRA Markers30 Sep 2025
- 2025Semantic Watermarking Reinvented: Enhancing Robustness and Generation Quality with Fourier Integrity9 Sep 2025
- 2025Learning Generalizable and Efficient Image Watermarking via Hierarchical Two-Stage Optimization12 Aug 2025
- 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakes2 Jul 2025
- 2025Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarking19 May 2025
7 more
- 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibility16 Apr 2025
- 2025Safe-VAR: Safe Visual Autoregressive Model for Text-to-Image Generative Watermarking14 Mar 2025
- 2024SAT-LDM: Provably Generalizable Image Watermarking for Latent Diffusion Models with Self-Augmented Training31 Dec 2024
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Models6 Dec 2024
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances24 Oct 2024
- 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Good24 Sep 2024
- 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Models12 Jun 2024
- 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Modelscited by 29
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Modelscited by 26
- 2025Semantic Watermarking Reinvented: Enhancing Robustness and Generation Quality with Fourier Integritycited by 14
- 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakescited by 7
- 2024SAT-LDM: Provably Generalizable Image Watermarking for Latent Diffusion Models with Self-Augmented Trainingcited by 2
- 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibilitycited by 1
- 2025AuthenLoRA: Entangling Stylization with Imperceptible Watermarks for Copyright-Secure LoRA Adapterscited by 1
- 2026Gaussian Shannon: High-Precision Diffusion Model Watermarking Based on Communicationcited by 0
- 2026Gaussian Shannon: High-Precision Diffusion Model Watermarking Based on Communication27 Mar 2026
- 2025AuthenLoRA: Entangling Stylization with Imperceptible Watermarks for Copyright-Secure LoRA Adapters26 Nov 2025
- 2025Semantic Watermarking Reinvented: Enhancing Robustness and Generation Quality with Fourier Integrity9 Sep 2025
- 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakes2 Jul 2025
- 2025PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibility16 Apr 2025
- 2024SAT-LDM: Provably Generalizable Image Watermarking for Latent Diffusion Models with Self-Augmented Training31 Dec 2024
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Models6 Dec 2024
- 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Models12 Jun 2024
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
- 2025Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarkingcited by 9
- 2025Safe-VAR: Safe Visual Autoregressive Model for Text-to-Image Generative Watermarkingcited by 4
- 2025MOLM: Mixture of LoRA Markerscited by 0
- 2026ALIEN: Analytic Latent Watermarking for Controllable Generationcited by 0
- 2026ALIEN: Analytic Latent Watermarking for Controllable Generation5 Feb 2026
- 2025MOLM: Mixture of LoRA Markers30 Sep 2025
- 2025Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarking19 May 2025
- 2025Safe-VAR: Safe Visual Autoregressive Model for Text-to-Image Generative Watermarking14 Mar 2025
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances24 Oct 2024
- 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Goodcited by 2
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemescited by 1
- 2025Learning Generalizable and Efficient Image Watermarking via Hierarchical Two-Stage Optimizationcited by 0
- 2025S2LM: Towards Semantic Steganography via Large Language Modelscited by 0
- 2026Q-Tag: Watermarking Quantum Circuit Generative Modelscited by 0
- 2026Watermarks Attack Watermarks: Re-Watermarking as a Generic Removal Strategycited by 0
- 2026Watermarks Attack Watermarks: Re-Watermarking as a Generic Removal Strategy16 May 2026
- 2026Q-Tag: Watermarking Quantum Circuit Generative Models26 Feb 2026
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemes25 Feb 2026
- 2025S2LM: Towards Semantic Steganography via Large Language Models7 Nov 2025
- 2025Learning Generalizable and Efficient Image Watermarking via Hierarchical Two-Stage Optimization12 Aug 2025
- 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Good24 Sep 2024
Similar, not cited
Close in wording, no citation either way
- 2026On the Intrinsic Limited Robustness of Latent-Based Watermarking
- 2024LVMark: Robust Watermark for Latent Video Diffusion Models
- 2024Attack-Resilient Image Watermarking Using Stable Diffusion
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
- 2024LaWa: Using Latent Space for In-Generation Image Watermarking
- 2025WaterFlow: Learning Fast & Robust Watermarks using Stable Diffusion
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks