mlsanityData to 14 Oct 2026

LVMark: Robust Watermark for Latent Video Diffusion Models

arXiv 2412.09122 ↗First posted 12 Dec 2024cs.CVcited by 9

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

Rapid advancements in video diffusion models have enabled the creation of realistic videos, raising concerns about unauthorized use and driving the demand for techniques to protect model ownership. Existing watermarking methods suffer from two key limitations: they overlook temporal consistency due to conventional watermark decoders and degrade the visual quality of the generated videos. To address these issues, we introduce a robust watermarking method for latent video diffusion models named Latent Video Diffusion Watermarking (LVMark). We propose a novel watermark decoder tailored for generated videos by learning the consistency between adjacent frames. It ensures accurate message decoding, even under malicious attacks, by combining the low-frequency components of the three-dimensional wavelet domain with the color features of the video. Additionally, we train a latent decoder to maintain the visual fidelity of the generated video. Watermarks are embedded into layers with minimal impact on visual appearance using an importance-based weight modulation strategy. We optimize both the watermark decoder and the latent decoder of diffusion model, effectively balancing the trade-off between visual quality and bit accuracy. Our experiments show that our method embeds invisible watermarks into video diffusion models, ensuring robust decoding accuracy with 512-bit capacity, even under distortions.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 40 of its 91 references that are in the map. First posted on arXiv 12 Dec 2024.

Builds on

40 of 91 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models7 Jun
  2. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar

Other references · 38

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  11. 2022Video Diffusion Modelscited by 2,305
  12. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
26 more
  1. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  2. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  4. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  5. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  6. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  7. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  8. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  9. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  10. 2018HiDDeN: Hiding Data With Deep Networkscited by 397
  11. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  12. 2019Limitations of the Empirical Fisher Approximation for Natural Gradient Descentcited by 217
  13. 2023A Survey on Video Diffusion Modelscited by 206
  14. 2023Putting the Object Back into Video Object Segmentationcited by 188
  15. 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampeningcited by 181
  16. 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
  17. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 131
  18. 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 111
  19. 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 91
  20. 2024Watermark Anything with Localized Messagescited by 53
  21. 2021DVMark: A Deep Multiscale Framework for Video Watermarkingcited by 46
  22. 2020A Loss Function for Generative Neural Networks Based on Watson's Perceptual Modelcited by 39
  23. 2024LaWa: Using Latent Space for In-Generation Image Watermarkingcited by 28
  24. 2024CSTA: CNN-based Spatiotemporal Attention for Video Summarizationcited by 23
  25. 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 18
  26. 2023Tsanet: Temporal and Scale Alignment for Unsupervised Video Object Segmentationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 5.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Models
  2. 2024Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space
  3. 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
  4. 2025LoT-Pass: Long-term-robust Image Watermarking for Image to Video Generation
  5. 2025Video Signature: Implicit Watermarking for Video Diffusion Models
  6. 2025VIDSTAMP: A Temporally-Aware Watermark for Ownership and Integrity in Video Diffusion Models
  7. 2025VideoMarkBench: Benchmarking Robustness of Video Watermarking
  8. 2025WaterFlow: Learning Fast & Robust Watermarks using Stable Diffusion