LVMark: Robust Watermark for Latent Video Diffusion Models
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Rapid advancements in video diffusion models have enabled the creation of realistic videos, raising concerns about unauthorized use and driving the demand for techniques to protect model ownership. Existing watermarking methods suffer from two key limitations: they overlook temporal consistency due to conventional watermark decoders and degrade the visual quality of the generated videos. To address these issues, we introduce a robust watermarking method for latent video diffusion models named Latent Video Diffusion Watermarking (LVMark). We propose a novel watermark decoder tailored for generated videos by learning the consistency between adjacent frames. It ensures accurate message decoding, even under malicious attacks, by combining the low-frequency components of the three-dimensional wavelet domain with the color features of the video. Additionally, we train a latent decoder to maintain the visual fidelity of the generated video. Watermarks are embedded into layers with minimal impact on visual appearance using an importance-based weight modulation strategy. We optimize both the watermark decoder and the latent decoder of diffusion model, effectively balancing the trade-off between visual quality and bit accuracy. Our experiments show that our method embeds invisible watermarks into video diffusion models, ensuring robust decoding accuracy with 512-bit capacity, even under distortions.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 40 of its 91 references that are in the map. First posted on arXiv 12 Dec 2024.
Builds on
40 of 91 references.
Closest ancestors · 2
Same direction, newest first
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models7 Jun
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
Other references · 38
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Video Diffusion Modelscited by 2,305
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
26 more
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2018HiDDeN: Hiding Data With Deep Networkscited by 397
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2019Limitations of the Empirical Fisher Approximation for Natural Gradient Descentcited by 217
- 2023A Survey on Video Diffusion Modelscited by 206
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampeningcited by 181
- 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 131
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 111
- 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 91
- 2024Watermark Anything with Localized Messagescited by 53
- 2021DVMark: A Deep Multiscale Framework for Video Watermarkingcited by 46
- 2020A Loss Function for Generative Neural Networks Based on Watson's Perceptual Modelcited by 39
- 2024LaWa: Using Latent Space for In-Generation Image Watermarkingcited by 28
- 2024CSTA: CNN-based Spatiotemporal Attention for Video Summarizationcited by 23
- 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 18
- 2023Tsanet: Temporal and Scale Alignment for Unsupervised Video Object Segmentationcited by 2
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2025Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarkingcited by 11
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Datacited by 6
- 2025VideoGuard: Protecting Video Content from Unauthorized Editingcited by 3
- 2025SPDMark: Selective Parameter Displacement for Robust Video Watermarkingcited by 3
- 2025WaTeRFlow: Watermark Temporal Robustness via Flow Consistencycited by 0
- 2026mAVE: A Watermark for Joint Audio-Visual Generation Modelscited by 0
- 2026Asymmetric Phase Coding Video Watermarkingcited by 0
- 2026MoSign: Challenge-Response Motion-Watermark Authentication for Anonymous Virtual-Reality Userscited by 0
- 2026Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Renderingcited by 0
- 2026Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Rendering6 Oct 2026
- 2026MoSign: Challenge-Response Motion-Watermark Authentication for Anonymous Virtual-Reality Users30 Aug 2026
- 2026Asymmetric Phase Coding Video Watermarking29 Aug 2026
- 2026mAVE: A Watermark for Joint Audio-Visual Generation Models7 Mar 2026
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Data25 Jan 2026
- 2025WaTeRFlow: Watermark Temporal Robustness via Flow Consistency22 Dec 2025
- 2025SPDMark: Selective Parameter Displacement for Robust Video Watermarking12 Dec 2025
- 2025VideoGuard: Protecting Video Content from Unauthorized Editing5 Aug 2025
- 2025Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarking19 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Models
- 2024Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
- 2025LoT-Pass: Long-term-robust Image Watermarking for Image to Video Generation
- 2025Video Signature: Implicit Watermarking for Video Diffusion Models
- 2025VIDSTAMP: A Temporally-Aware Watermark for Ownership and Integrity in Video Diffusion Models
- 2025VideoMarkBench: Benchmarking Robustness of Video Watermarking
- 2025WaterFlow: Learning Fast & Robust Watermarks using Stable Diffusion