mlsanityData to 7 Oct 2026

Generative Models are Self-Watermarked: Declaring Model Authentication through Re-Generation

arXiv 2402.16889 ↗First posted 23 Feb 2024cs.LG cs.AI cs.CRcited by 3

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

As machine- and AI-generated content proliferates, protecting the intellectual property of generative models has become imperative, yet verifying data ownership poses formidable challenges, particularly in cases of unauthorized reuse of generated data. The challenge of verifying data ownership is further amplified by using Machine Learning as a Service (MLaaS), which often functions as a black-box system. Our work is dedicated to detecting data reuse from even an individual sample. Traditionally, watermarking has been leveraged to detect AI-generated content. However, unlike watermarking techniques that embed additional information as triggers into models or generated content, potentially compromising output quality, our approach identifies latent fingerprints inherently present within the outputs through re-generation. We propose an explainable verification procedure that attributes data ownership through re-generation, and further amplifies these fingerprints in the generative models through iterative data re-generation. This methodology is theoretically grounded and demonstrates viability and robustness using recent advanced text and image generative models. Our methodology is significant as it goes beyond protecting the intellectual property of APIs and addresses important issues such as the spread of misinformation and academic misconduct. It provides a useful tool to ensure the integrity of sources and authorship, expanding its application in different scenarios where authenticity and ownership verification are essential.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 50 of its 82 references that are in the map. First posted on arXiv 23 Feb 2024.

Builds on

50 of 82 references.

Closest ancestors · 12

Same direction, newest first

  1. 2023Robust Distortion-free Watermarks for Language Models28 Jul
  2. 2023On the Reliability of Watermarks for Large Language Models7 Jun
  3. 2023Undetectable Watermarks for Language Models25 May
  4. 2023Who Wrote this Code? Watermarking for Code Generation24 May
  5. 2023Evading Watermark based Detection of AI-Generated Content5 May
  6. 2023Robust Multi-bit Natural Language Watermarking through Invariant Features3 May
  7. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
  8. 2023A Recipe for Watermarking Diffusion Models17 Mar
  9. 2023Protecting Language Generation Models via Invisible Watermarking6 Feb
  10. 2023A Watermark for Large Language Models24 Jan
  11. 2022CATER: Intellectual Property Protection on Text Generation APIs via Conditional Watermarks19 Sep
  12. 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermark5 Dec

Other references · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  12. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
26 more
  1. 2023Mistral 7Bcited by 3,065
  2. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  3. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
  4. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  5. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  6. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  7. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  8. 2018HiDDeN: Hiding Data With Deep Networkscited by 384
  9. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  10. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  11. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
  12. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
  13. 2022Data Contamination: From Memorization to Exploitationcited by 234
  14. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  15. 2018Do GANs leave artificial fingerprints?cited by 188
  16. 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
  17. 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
  18. 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 98
  19. 2021Watermarking Images in Self-Supervised Latent Spacescited by 90
  20. 2020Imitation Attacks and Defenses for Black-box Machine Translation Systemscited by 78
  21. 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 76
  22. 2018ReDMark: Framework for Residual Diffusion Watermarking on Deep Networkscited by 55
  23. 2023ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishingcited by 51
  24. 2023GPT-Sentinel: Distinguishing Human and ChatGPT Generated Contentcited by 40
  25. 2021Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIscited by 16
  26. 2021Ethics and Creativity in Computer Visioncited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.