Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarking
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
The explosive growth of generative video models has amplified the demand for reliable copyright preservation of AI-generated content. Despite its popularity in image synthesis, invisible generative watermarking remains largely underexplored in video generation. To address this gap, we propose Safe-Sora, the first framework to embed graphical watermarks directly into the video generation process. Motivated by the observation that watermarking performance is closely tied to the visual similarity between the watermark and cover content, we introduce a hierarchical coarse-to-fine adaptive matching mechanism. Specifically, the watermark image is divided into patches, each assigned to the most visually similar video frame, and further localized to the optimal spatial region for seamless embedding. To enable spatiotemporal fusion of watermark patches across video frames, we develop a 3D wavelet transform-enhanced Mamba architecture with a novel spatiotemporal local scanning strategy, effectively modeling long-range dependencies during watermark embedding and retrieval. To the best of our knowledge, this is the first attempt to apply state space models to watermarking, opening new avenues for efficient and robust watermark protection. Extensive experiments demonstrate that Safe-Sora achieves state-of-the-art performance in terms of video quality, watermark fidelity, and robustness, which is largely attributed to our proposals. Code is publicly available at https://github.com/Sugewud/Safe-Sora
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 48 of its 64 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
48 of 64 references.
Closest ancestors · 9
Same direction, newest first
- 2025VideoShield: Regulating Diffusion-based Video Generation Models via Watermarking24 Jan
- 2024LVMark: Robust Watermark for Latent Video Diffusion Models12 Dec
- 2024Safe-SD: Safe and Traceable Stable Diffusion with Text Prompt Trigger for Invisible Generative Watermarking18 Jul
- 2024DiffuseTrace: A Transparent and Flexible Watermarking Scheme for Latent Diffusion Model4 May
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
- 2024Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space30 Mar
- 2024A Watermark-Conditioned Diffusion Model for IP Protection16 Mar
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
- 2023A Recipe for Watermarking Diffusion Models17 Mar
Other references · 39
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
27 more
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2024VMamba: Visual State Space Modelcited by 969
- 2022Simplified State Space Layers for Sequence Modelingcited by 788
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
- 2024An Empirical Study of Mamba-based Language Modelscited by 186
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 131
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
- 2024MambaByte: Token-free Selective State Space Modelcited by 59
- 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Derainingcited by 57
- 2022Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuningcited by 54
- 2021DVMark: A Deep Multiscale Framework for Video Watermarkingcited by 46
- 2023Instant3D: Instant Text-to-3D Generationcited by 45
- 2024EventGPT: Event Stream Understanding with Multimodal Large Language Modelscited by 28
- 2019Logo-2K+: A Large-Scale Logo Dataset for Scalable Logo Classificationcited by 22
- 2023Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detectioncited by 15
- 2025PVChat: Personalized Video Chat with One-Shot Learningcited by 13
- 2021Semantic Compositional Learning for Low-shot Scene Graph Generationcited by 12
- 2024Purified and Unified Steganographic Networkcited by 10
- 2024Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detectioncited by 6
- 2025Cyc3D: Fine-grained Controllable 3D Generation via Cycle Consistency Regularizationcited by 3
- 2024TextureDiffusion: Target Prompt Disentangled Editing for Various Texture Transfercited by 1
Built on by
Citing papers per year: 2025: 5; 2026: 6.
11 papers.
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Modelscited by 36
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 20
- 2026ConsistentRFT: Reducing Visual Hallucinations in Flow-based Reinforcement Fine-Tuningcited by 6
- 2025ViStoryBench: Comprehensive Benchmark Suite for Story Visualizationcited by 5
- 2025Video Signature: Implicit Watermarking for Video Diffusion Modelscited by 5
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generationcited by 4
- 2025SVL: Empowering Spiking Neural Networks for Efficient 3D Open-World Understandingcited by 1
- 2025LoT-Pass: Long-term-robust Image Watermarking for Image to Video Generationcited by 1
- 2026Where and When to Force: Routed Forcing for Streaming Avatarscited by 1
- 2026Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Renderingcited by 0
- 2026Getting Space Right: Agentic Rewards for Image Generationcited by 0
- 2026Getting Space Right: Agentic Rewards for Image Generation10 Oct 2026
- 2026Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Rendering6 Oct 2026
- 2026Where and When to Force: Routed Forcing for Streaming Avatars25 Sep 2026
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation8 Feb 2026
- 2026ConsistentRFT: Reducing Visual Hallucinations in Flow-based Reinforcement Fine-Tuning3 Feb 2026
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generation29 Jan 2026
- 2025LoT-Pass: Long-term-robust Image Watermarking for Image to Video Generation22 Sep 2025
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Models18 Aug 2025
- 2025Video Signature: Implicit Watermarking for Video Diffusion Models31 May 2025
- 2025ViStoryBench: Comprehensive Benchmark Suite for Story Visualization30 May 2025
- 2025SVL: Empowering Spiking Neural Networks for Efficient 3D Open-World Understanding23 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026SKeDA: A Generative Watermarking Framework for Text-to-video Diffusion Models
- 2025SPDMark: Selective Parameter Displacement for Robust Video Watermarking
- 2025VideoMarkBench: Benchmarking Robustness of Video Watermarking
- 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Models
- 2025Dynamic watermarks in images generated by diffusion models
- 2026An Efficient and Effective Watermarking Scheme for the Protection of the Intellectual Property Rights of Video Generative Models
- 2026WaveMark: Robust Wavelet-Domain Image Watermarking for Diffusion Models
- 2026COVER: Codec-Robust Video Watermarking with Generative Video Priors