mlsanityData to 7 Oct 2026

Protect-Your-IP: Scalable Source-Tracing and Attribution against Personalized Generation

arXiv 2405.16596 ↗First posted 26 May 2024cs.CVcited by 3

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

With the advent of personalized generation models, users can more readily create images resembling existing content, heightening the risk of violating portrait rights and intellectual property (IP). Traditional post-hoc detection and source-tracing methods for AI-generated content (AIGC) employ proactive watermark approaches; however, these are less effective against personalized generation models. Moreover, attribution techniques for AIGC rely on passive detection but often struggle to differentiate AIGC from authentic images, presenting a substantial challenge. Integrating these two processes into a cohesive framework not only meets the practical demands for protection and forensics but also improves the effectiveness of attribution tasks. Inspired by this insight, we propose a unified approach for image copyright source-tracing and attribution, introducing an innovative watermarking-attribution method that blends proactive and passive strategies. We embed copyright watermarks into protected images and train a watermark decoder to retrieve copyright information from the outputs of personalized models, using this watermark as an initial step for confirming if an image is AIGC-generated. To pinpoint specific generation techniques, we utilize powerful visual backbone networks for classification. Additionally, we implement an incremental learning strategy to adeptly attribute new personalized models without losing prior knowledge, thereby enhancing the model's adaptability to novel generation methods. We have conducted experiments using various celebrity portrait series sourced online, and the results affirm the efficacy of our method in source-tracing and attribution tasks, as well as its robustness against knowledge forgetting.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 45 of its 53 references that are in the map. First posted on arXiv 26 May 2024.

Builds on

45 of 53 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Unified High-binding Watermark for Unconditional Image Generation Models14 Oct
  2. 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detection10 May
  3. 2021Deep Model Intellectual Property Protection via Deep Watermarking8 Mar

Other references · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  11. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  12. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
30 more
  1. 2016Learning without Forgettingcited by 2,465
  2. 2017Improved Training of Wasserstein GANscited by 2,223
  3. 2023Consistency Modelscited by 1,778
  4. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  5. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  6. 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
  7. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  8. 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 240
  9. 2017Embedding Watermarks into Deep Neural Networkscited by 227
  10. 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
  11. 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 114
  12. 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 109
  13. 2023Mist: Towards Improved Adversarial Examples for Diffusion Modelscited by 91
  14. 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 90
  15. 2021Combining EfficientNet and Vision Transformers for Video Deepfake Detectioncited by 81
  16. 2020Incremental Learning In Online Scenariocited by 71
  17. 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
  18. 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
  19. 2022Deepfake Network Architecture Attributioncited by 47
  20. 2023Security and Privacy on Generative Data in AIGC: A Surveycited by 34
  21. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  22. 2024V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protectioncited by 27
  23. 2014StegExpose - A Tool for Detecting LSB Steganographycited by 25
  24. 2020Detection, Attribution and Localization of GAN Generated Imagescited by 24
  25. 2023Attributing Image Generative Models using Latent Fingerprintscited by 20
  26. 2021Learning to Disentangle GAN Fingerprint for Fake Image Attributioncited by 19
  27. 2021Explaining deep learning models for spoofing and deepfake detection with SHapley Additive exPlanationscited by 13
  28. 2023What can Discriminator do? Towards Box-free Ownership Verification of Generative Adversarial Networkcited by 10
  29. 2024Detecting Origin Attribution for Text-to-Image Diffusion Modelscited by 7
  30. 2024Regeneration Based Training-free Attribution of Fake Images Generated by Text-to-Image Generative Modelscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.