mlsanityData to 7 Oct 2026

Steal My Artworks for Fine-tuning? A Watermarking Framework for Detecting Art Theft Mimicry in Text-to-Image Models

arXiv 2311.13619 ↗First posted 22 Nov 2023cs.CV cs.CRcited by 8

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

The advancement in text-to-image models has led to astonishing artistic performances. However, several studios and websites illegally fine-tune these models using artists' artworks to mimic their styles for profit, which violates the copyrights of artists and diminishes their motivation to produce original works. Currently, there is a notable lack of research focusing on this issue. In this paper, we propose a novel watermarking framework that detects mimicry in text-to-image models through fine-tuning. This framework embeds subtle watermarks into digital artworks to protect their copyrights while still preserving the artist's visual expression. If someone takes watermarked artworks as training data to mimic an artist's style, these watermarks can serve as detectable indicators. By analyzing the distribution of these watermarks in a series of generated images, acts of fine-tuning mimicry using stolen victim data will be exposed. In various fine-tune scenarios and against watermark attack methods, our research confirms that analyzing the distribution of watermarks in artificially generated images reliably detects unauthorized mimicry.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 17 of its 27 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

17 of 27 references.

References · 17

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  8. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  9. 2016Generative Adversarial Text to Image Synthesiscited by 735
  10. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  11. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  12. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
5 more
  1. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
  2. 2019Controllable Text-to-Image Generationcited by 187
  3. 2019Robust Invisible Video Watermarking with Attentioncited by 144
  4. 2015Generating Images from Captions with Attentioncited by 135
  5. 2021Watermarking Images in Self-Supervised Latent Spacescited by 90

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 2; 2026: 2.

8 papers.