Steal My Artworks for Fine-tuning? A Watermarking Framework for Detecting Art Theft Mimicry in Text-to-Image Models
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
The advancement in text-to-image models has led to astonishing artistic performances. However, several studios and websites illegally fine-tune these models using artists' artworks to mimic their styles for profit, which violates the copyrights of artists and diminishes their motivation to produce original works. Currently, there is a notable lack of research focusing on this issue. In this paper, we propose a novel watermarking framework that detects mimicry in text-to-image models through fine-tuning. This framework embeds subtle watermarks into digital artworks to protect their copyrights while still preserving the artist's visual expression. If someone takes watermarked artworks as training data to mimic an artist's style, these watermarks can serve as detectable indicators. By analyzing the distribution of these watermarks in a series of generated images, acts of fine-tuning mimicry using stolen victim data will be exposed. In various fine-tune scenarios and against watermark attack methods, our research confirms that analyzing the distribution of watermarks in artificially generated images reliably detects unauthorized mimicry.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 17 of its 27 references that are in the map. First posted on arXiv 22 Nov 2023.
Builds on
17 of 27 references.
References · 17
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Generative Adversarial Networkscited by 5,603
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
5 more
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2019Controllable Text-to-Image Generationcited by 187
- 2019Robust Invisible Video Watermarking with Attentioncited by 144
- 2015Generating Images from Captions with Attentioncited by 135
- 2021Watermarking Images in Self-Supervised Latent Spacescited by 90
Built on by
Citing papers per year: 2024: 4; 2025: 2; 2026: 2.
8 papers.
- 2024Towards Reliable Verification of Unauthorized Data Usage in Personalized Text-to-Image Diffusion Modelscited by 19
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
- 2025ArtistAuditor: Auditing Artist Style Pirate in Text-to-Image Generation Modelscited by 5
- 2025Training Data Provenance Verification: Did Your Model Use Synthetic Data from My Generative Model for Training?cited by 4
- 2024Training Data Attribution: Was Your Model Secretly Trained On Data Created By Mine?cited by 3
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemescited by 1
- 2024Exploiting Watermark-Based Defense Mechanisms in Text-to-Image Diffusion Models for Unauthorized Data Usagecited by 0
- 2026UniMark: Unified Adaptive Multi-bit Watermarking for Autoregressive Image Generatorscited by 0
- 2026UniMark: Unified Adaptive Multi-bit Watermarking for Autoregressive Image Generators12 Apr 2026
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemes25 Feb 2026
- 2025ArtistAuditor: Auditing Artist Style Pirate in Text-to-Image Generation Models17 Apr 2025
- 2025Training Data Provenance Verification: Did Your Model Use Synthetic Data from My Generative Model for Training?12 Mar 2025
- 2024Exploiting Watermark-Based Defense Mechanisms in Text-to-Image Diffusion Models for Unauthorized Data Usage22 Nov 2024
- 2024Towards Reliable Verification of Unauthorized Data Usage in Personalized Text-to-Image Diffusion Models14 Oct 2024
- 2024Training Data Attribution: Was Your Model Secretly Trained On Data Created By Mine?24 Sep 2024
- 2024Replication in Visual Diffusion Models: A Survey and Outlook7 Jul 2024