mlsanityData to 14 Oct 2026

SoK: On the Role and Future of AIGC Watermarking in the Era of Gen-AI

arXiv 2411.11478 ↗First posted 18 Nov 2024cs.CRcited by 14

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

The rapid advancement of AI technology, particularly in generating AI-generated content (AIGC), has transformed numerous fields, e.g., art video generation, but also brings new risks, including the misuse of AI for misinformation and intellectual property theft. To address these concerns, AIGC watermarks offer an effective solution to mitigate malicious activities. However, existing watermarking surveys focus more on traditional watermarks, overlooking AIGC-specific challenges. In this work, we propose a systematic investigation into AIGC watermarking and provide the first formal definition of AIGC watermarking. Different from previous surveys, we provide a taxonomy based on the core properties of the watermark which are summarized through comprehensive literature from various AIGC modalities. Derived from the properties, we discuss the functionality and security threats of AIGC watermarking. In the end, we thoroughly investigate the AIGC governance of different countries and practitioners. We believe this taxonomy better aligns with the practical demands for watermarking in the era of GenAI, thus providing a clearer summary of existing work and uncovering potential future research directions for the community.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 84 of its 148 references that are in the map. First posted on arXiv 18 Nov 2024.

Builds on

84 of 148 references.

Closest ancestors · 38

Same direction, newest first

  1. 2024Towards Reliable Verification of Unauthorized Data Usage in Personalized Text-to-Image Diffusion Models14 Oct
  2. 2024GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesis15 Jul
  3. 2024Large Language Model Watermark Stealing With Mixed Integer Programming30 May
  4. 2024Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attribution8 May
  5. 2024Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion Models15 Apr
  6. 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
  7. 2024Bypassing LLM Watermarks with Color-Aware Substitutions19 Mar
  8. 2024Learning to Watermark LLM-generated Text via Reinforcement Learning13 Mar
  9. 2024Watermark Stealing in Large Language Models29 Feb
  10. 2024Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models21 Feb
  11. 2024Cross-Attention Watermarking of Large Language Models12 Jan
  12. 2023A Survey of Text Watermarking in the Era of Large Language Models13 Dec
26 more
  1. 2023On the Learnability of Watermarks for Language Models7 Dec
  2. 2023A Somewhat Robust Image Watermark against Diffusion-based Editing Models22 Nov
  3. 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models7 Nov
  4. 2023Publicly-Detectable Watermarking for Language Models27 Oct
  5. 2023A Semantic Invariant Robust Watermark for Large Language Models10 Oct
  6. 2023Catch You Everything Everywhere: Guarding Textual Inversion via Concept Watermarking12 Sep
  7. 2023T2IW: Joint Text to Image & Watermark Generation7 Sep
  8. 2023DUAW: Data-free Universal Adversarial Watermark against Stable Diffusion Customization19 Aug
  9. 2023An Unforgeable Publicly Verifiable Watermark for Large Language Models30 Jul
  10. 2023Robust Distortion-free Watermarks for Language Models28 Jul
  11. 2023Provable Robust Watermarking for AI-Generated Text30 Jun
  12. 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesis13 Jun
  13. 2023Intellectual Property Protection of Diffusion Models via the Watermark Diffusion Process6 Jun
  14. 2023Invisible Image Watermarks Are Provably Removable Using Generative AI2 Jun
  15. 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
  16. 2023DiffusionShield: A Watermark for Copyright Protection against Generative Diffusion Models25 May
  17. 2023Watermarking Text Generated by Black-Box Language Models14 May
  18. 2023Evading Watermark based Detection of AI-Generated Content5 May
  19. 2023Robust Multi-bit Natural Language Watermarking through Invariant Features3 May
  20. 2023PTW: Pivotal Tuning Watermarking for Pre-Trained Image Generators14 Apr
  21. 2023RoSteALS: Robust Steganography using Autoencoder Latent Space6 Apr
  22. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
  23. 2023A Recipe for Watermarking Diffusion Models17 Mar
  24. 2023A Watermark for Large Language Models24 Jan
  25. 2021Tracing Text Provenance via Context-Aware Lexical Substitution15 Dec
  26. 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes23 May

Other references · 46

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2024OmniGen: Unified Image Generationcited by 394
  5. 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 357
  6. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 265
  7. 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 111
  8. 2021Watermarking Images in Self-Supervised Latent Spacescited by 94
  9. 2020Distortion Agnostic Deep Watermarkingcited by 90
  10. 2022Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright Protectioncited by 86
  11. 2019SteganoGAN: High Capacity Image Steganography with GANscited by 72
  12. 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 66
34 more
  1. 2022Black-box Dataset Ownership Verification via Backdoor Watermarkingcited by 65
  2. 2017Generating Steganographic Images via Adversarial Trainingcited by 58
  3. 2018ReDMark: Framework for Residual Diffusion Watermarking on Deep Networkscited by 57
  4. 2023Domain Watermark: Effective and Harmless Dataset Copyright Protection is Closed at Handcited by 57
  5. 2020Model Watermarking for Image Processing Networkscited by 56
  6. 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 53
  7. 2023WavMark: Watermarking for Audio Generationcited by 50
  8. 2021DVMark: A Deep Multiscale Framework for Video Watermarkingcited by 46
  9. 2021Defending against Model Stealing via Verifying Embedded External Featurescited by 46
  10. 2017Generating Steganographic Text with LSTMscited by 44
  11. 2022Supervised GAN Watermarking for Intellectual Property Protectioncited by 40
  12. 2022FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Modelcited by 30
  13. 2024V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protectioncited by 28
  14. 2021Data Hiding with Deep Learning: A Survey Unifying Digital Watermarking and Steganographycited by 24
  15. 2022DeAR: A Deep-learning-based Audio Re-recording Resilient Watermarkingcited by 22
  16. 2023Large-capacity and Flexible Video Steganography via Invertible Neural Networkcited by 21
  17. 2024Is Difficulty Calibration All We Need? Towards More Practical Membership Inference Attackscited by 21
  18. 2024PointNCBW: Towards Dataset Ownership Verification for Point Clouds via Negative Clean-label Backdoor Watermarkcited by 20
  19. 2019ROMark: A Robust Watermarking System Using Adversarial Trainingcited by 18
  20. 2022Watermarking in Secure Federated Learning: A Verification Framework Based on Client-Side Backdooringcited by 17
  21. 2024Generative Text Steganography with Large Language Modelcited by 17
  22. 2024Which Model Generated This Image? A Model-Agnostic Approach for Origin Attributioncited by 16
  23. 2024Latent Watermarking of Audio Generative Modelscited by 16
  24. 2022Free Fine-tuning: A Plug-and-Play Watermarking Scheme for Deep Neural Networkscited by 15
  25. 2023Securing Deep Generative Models with Universal Adversarial Signaturecited by 14
  26. 2022LECA: A Learned Approach for Efficient Cover-agnostic Watermarkingcited by 13
  27. 2024Who Followed the Blueprint? Analyzing the Responses of U.S. Federal Agencies to the Blueprint for an AI Bill of Rightscited by 11
  28. 2017Coverless Information Hiding Based on Generative adversarial networkscited by 10
  29. 2021Watermark Faker: Towards Forgery of Digital Image Watermarkingcited by 8
  30. 2024TraceableSpeech: Towards Proactively Traceable Text-to-Speech with Watermarkingcited by 7
  31. 2024From Covert Hiding to Visual Editing: Robust Generative Video Steganographycited by 5
  32. 2023A Brief Yet In-Depth Survey of Deep Learning-Based Image Watermarkingcited by 3
  33. 2024Finding needles in a haystack: A Black-Box Approach to Invisible Watermark Detectioncited by 3
  34. 2018Review on Optical Image Hiding and Watermarking Techniquescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 4.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024SoK: Watermarking for AI-Generated Content
  2. 2025Adoption of Watermarking for Generative AI Systems in Practice and Implications under the new EU AI Act
  3. 2023A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutions
  4. 2025Watermarking for AI Content Detection: A Review on Text, Visual, and Audio Modalities
  5. 2024Watermark-based Attribution of AI-Generated Content
  6. 2026From Forensics to Ecosystems: Rethinking Watermarks for Generative AI Oversight
  7. 2024Protect-Your-IP: Scalable Source-Tracing and Attribution against Personalized Generation
  8. 2026Attack-Resistant Watermarking for AIGC Image Forensics via Diffusion-based Semantic Deflection