mlsanityData to 7 Oct 2026

Watermark-based Attribution of AI-Generated Content

arXiv 2404.04254 ↗First posted 5 Apr 2024cs.CR cs.AI cs.CLcited by 8

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

Several companies have deployed watermark-based detection to identify AI-generated content. However, attribution--the ability to trace back to the user of a generative AI (GenAI) service who created a given AI-generated content--remains largely unexplored despite its growing importance. In this work, we aim to bridge this gap by conducting the first systematic study on watermark-based, user-level attribution of AI-generated content. Our key idea is to assign a unique watermark to each user of the GenAI service and embed this watermark into the AI-generated content created by that user. Attribution is then performed by identifying the user whose watermark best matches the one extracted from the given content. This approach, however, faces a key challenge: How should watermarks be selected for users to maximize attribution performance? To address the challenge, we first theoretically derive lower bounds on detection and attribution performance through rigorous probabilistic analysis for any given set of user watermarks. Then, we select watermarks for users to maximize these lower bounds, thereby optimizing detection and attribution performance. Our theoretical and empirical results show that watermark-based attribution inherits both the accuracy and (non-)robustness properties of the underlying watermark. Specifically, attribution remains highly accurate when the watermarked AI-generated content is either not post-processed or subjected to common post-processing such as JPEG compression, as well as black-box adversarial post-processing with limited query budgets.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 22 of its 57 references that are in the map. First posted on arXiv 5 Apr 2024.

Builds on

22 of 57 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
  2. 2023Evading Watermark based Detection of AI-Generated Content5 May
  3. 2023PTW: Pivotal Tuning Watermarking for Pre-Trained Image Generators14 Apr
  4. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
  5. 2023Can AI-Generated Text be Reliably Detected?17 Mar
  6. 2023A Watermark for Large Language Models24 Jan

Other references · 16

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  6. 2016Pointer Sentinel Mixture Modelscited by 2,992
  7. 2018HiDDeN: Hiding Data With Deep Networkscited by 384
  8. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  9. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
  10. 2020Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hidingcited by 121
  11. 2021Watermarking Images in Self-Supervised Latent Spacescited by 90
  12. 2020Distortion Agnostic Deep Watermarkingcited by 88
4 more
  1. 2023Leveraging Optimization for Adaptive Attacks on Image Watermarkscited by 50
  2. 2024A Transfer Attack to Image Watermarkscited by 26
  3. 2019ROMark: A Robust Watermarking System Using Adversarial Trainingcited by 17
  4. 2020Towards Robust Data Hiding Against (JPEG) Compression: A Pseudo-Differentiable Deep Learning Approachcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 4; 2025: 4.

8 papers.