Generative Models are Self-Watermarked: Declaring Model Authentication through Re-Generation
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
As machine- and AI-generated content proliferates, protecting the intellectual property of generative models has become imperative, yet verifying data ownership poses formidable challenges, particularly in cases of unauthorized reuse of generated data. The challenge of verifying data ownership is further amplified by using Machine Learning as a Service (MLaaS), which often functions as a black-box system. Our work is dedicated to detecting data reuse from even an individual sample. Traditionally, watermarking has been leveraged to detect AI-generated content. However, unlike watermarking techniques that embed additional information as triggers into models or generated content, potentially compromising output quality, our approach identifies latent fingerprints inherently present within the outputs through re-generation. We propose an explainable verification procedure that attributes data ownership through re-generation, and further amplifies these fingerprints in the generative models through iterative data re-generation. This methodology is theoretically grounded and demonstrates viability and robustness using recent advanced text and image generative models. Our methodology is significant as it goes beyond protecting the intellectual property of APIs and addresses important issues such as the spread of misinformation and academic misconduct. It provides a useful tool to ensure the integrity of sources and authorship, expanding its application in different scenarios where authenticity and ownership verification are essential.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 50 of its 82 references that are in the map. First posted on arXiv 23 Feb 2024.
Builds on
50 of 82 references.
Closest ancestors · 12
Same direction, newest first
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
- 2023On the Reliability of Watermarks for Large Language Models7 Jun
- 2023Undetectable Watermarks for Language Models25 May
- 2023Who Wrote this Code? Watermarking for Code Generation24 May
- 2023Evading Watermark based Detection of AI-Generated Content5 May
- 2023Robust Multi-bit Natural Language Watermarking through Invariant Features3 May
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
- 2023A Recipe for Watermarking Diffusion Models17 Mar
- 2023Protecting Language Generation Models via Invisible Watermarking6 Feb
- 2023A Watermark for Large Language Models24 Jan
- 2022CATER: Intellectual Property Protection on Text Generation APIs via Conditional Watermarks19 Sep
- 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermark5 Dec
Other references · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
26 more
- 2023Mistral 7Bcited by 3,065
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
- 2020Beyond English-Centric Multilingual Machine Translationcited by 559
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
- 2022Data Contamination: From Memorization to Exploitationcited by 234
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2018Do GANs leave artificial fingerprints?cited by 188
- 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
- 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
- 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 98
- 2021Watermarking Images in Self-Supervised Latent Spacescited by 90
- 2020Imitation Attacks and Defenses for Black-box Machine Translation Systemscited by 78
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 76
- 2018ReDMark: Framework for Residual Diffusion Watermarking on Deep Networkscited by 55
- 2023ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishingcited by 51
- 2023GPT-Sentinel: Distinguishing Human and ChatGPT Generated Contentcited by 40
- 2021Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIscited by 16
- 2021Ethics and Creativity in Computer Visioncited by 15
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstructioncited by 4
- 2026Attesting Model Lineage by Consisted Knowledge Evolution with Fine-Tuning Trajectorycited by 1
- 2025On-Device Watermarking: A Socio-Technical Imperative For Authenticity In The Age of Generative AIcited by 0
- 2026Attesting Model Lineage by Consisted Knowledge Evolution with Fine-Tuning Trajectory16 Jan 2026
- 2025SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstruction6 Aug 2025
- 2025On-Device Watermarking: A Socio-Technical Imperative For Authenticity In The Age of Generative AI15 Apr 2025