mlsanityData to 7 Oct 2026

mAVE: A Watermark for Joint Audio-Visual Generation Models

arXiv 2603.07090 ↗First posted 7 Mar 2026cs.CR cs.AI cs.CVcited by 0

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

Watermarking joint audio-visual generation supports vendor copyright protection and content provenance. However, independently valid audio and video watermarks do not establish a shared generation session. An adversary can splice watermarked modalities from different sessions, causing the pair to be mistaken for the vendor's original joint output. We introduce mAVE (Manifold Audio-Visual Entanglement), a training-free watermarking framework that strengthens vendor attribution through session binding in native joint audio-visual diffusion transformers. mAVE separates public record retrieval from secret session authentication: a fixed public index locates the server record, while a randomized payload binds audio bits to a session-keyed video grid through a cryptographic digest. One prompt-conditioned joint inversion supports provider-assisted verification of both modalities against a session record, without modifying generator weights or training auxiliary watermark networks. Our analysis establishes implementation-matched distribution preservation and a full-initialization routing/clipping budget, alongside adaptive session-pool security and stable local-perturbation bounds. Experiments on LTX-2 and MOVA show comparable generation quality. mAVE achieves 99.8% true-positive rate and 0% observed false-positive rate in the evaluated swap test, and retains 99.2% true-positive rate under FrameAvg temporal averaging. Same-prompt and similarity-selected swaps further test session authentication beyond perceptual compatibility.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 46 of its 64 references that are in the map. First posted on arXiv 7 Mar 2026.

Builds on

46 of 64 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusion3 Mar
  2. 2026SKeDA: A Generative Watermarking Framework for Text-to-video Diffusion Models27 Feb
  3. 2025Removal Attack and Defense on AI-generated Content Latent-based Watermarking15 Sep
  4. 2025MarkDiffusion: An Open-Source Toolkit for Generative Watermarking of Latent Diffusion Models11 Sep
  5. 2025Video Signature: Implicit Watermarking for Video Diffusion Models31 May
  6. 2025Gaussian Shading++: Rethinking the Realistic Deployment Challenge of Performance-Lossless Image Watermark for Diffusion Models21 Apr
  7. 2025Towards A Correct Usage of Cryptography in Semantic Watermarks for Diffusion Models14 Mar
  8. 2025VideoShield: Regulating Diffusion-based Video Generation Models via Watermarking24 Jan
  9. 2024LVMark: Robust Watermark for Latent Video Diffusion Models12 Dec
  10. 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr

Other references · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  8. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  10. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  12. 2023Consistency Modelscited by 1,778
24 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  2. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
  3. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  4. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  5. 2022High Fidelity Neural Audio Compressioncited by 673
  6. 2023ModelScope Text-to-Video Technical Reportcited by 651
  7. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
  8. 2020The Creation and Detection of Deepfakes: A Surveycited by 246
  9. 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
  10. 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
  11. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
  12. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
  13. 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 89
  14. 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 67
  15. 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
  16. 2024Video Seal: Open and Efficient Video Watermarkingcited by 45
  17. 2021DVMark: A Deep Multiscale Framework for Video Watermarkingcited by 42
  18. 2023WavMark: Watermarking for Audio Generationcited by 41
  19. 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 39
  20. 2026MOVA: Towards Scalable and Synchronized Video-Audio Generationcited by 39
  21. 2024V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protectioncited by 27
  22. 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Modelscited by 16
  23. 2022SyncNet: correlating objective for time delay estimation in audio signalscited by 9
  24. 2025Cross-Modal Watermarking for Authentic Audio Recovery and Tamper Localization in Synthesized Audiovisual Forgeriescited by 1

Built on by

Not cited yet.