Protect-Your-IP: Scalable Source-Tracing and Attribution against Personalized Generation
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
With the advent of personalized generation models, users can more readily create images resembling existing content, heightening the risk of violating portrait rights and intellectual property (IP). Traditional post-hoc detection and source-tracing methods for AI-generated content (AIGC) employ proactive watermark approaches; however, these are less effective against personalized generation models. Moreover, attribution techniques for AIGC rely on passive detection but often struggle to differentiate AIGC from authentic images, presenting a substantial challenge. Integrating these two processes into a cohesive framework not only meets the practical demands for protection and forensics but also improves the effectiveness of attribution tasks. Inspired by this insight, we propose a unified approach for image copyright source-tracing and attribution, introducing an innovative watermarking-attribution method that blends proactive and passive strategies. We embed copyright watermarks into protected images and train a watermark decoder to retrieve copyright information from the outputs of personalized models, using this watermark as an initial step for confirming if an image is AIGC-generated. To pinpoint specific generation techniques, we utilize powerful visual backbone networks for classification. Additionally, we implement an incremental learning strategy to adeptly attribute new personalized models without losing prior knowledge, thereby enhancing the model's adaptability to novel generation methods. We have conducted experiments using various celebrity portrait series sourced online, and the results affirm the efficacy of our method in source-tracing and attribution tasks, as well as its robustness against knowledge forgetting.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 45 of its 53 references that are in the map. First posted on arXiv 26 May 2024.
Builds on
45 of 53 references.
Closest ancestors · 3
Same direction, newest first
- 2023Unified High-binding Watermark for Unconditional Image Generation Models14 Oct
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detection10 May
- 2021Deep Model Intellectual Property Protection via Deep Watermarking8 Mar
Other references · 42
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
30 more
- 2016Learning without Forgettingcited by 2,465
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2023Consistency Modelscited by 1,778
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 240
- 2017Embedding Watermarks into Deep Neural Networkscited by 227
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 114
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 109
- 2023Mist: Towards Improved Adversarial Examples for Diffusion Modelscited by 91
- 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 90
- 2021Combining EfficientNet and Vision Transformers for Video Deepfake Detectioncited by 81
- 2020Incremental Learning In Online Scenariocited by 71
- 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
- 2022Deepfake Network Architecture Attributioncited by 47
- 2023Security and Privacy on Generative Data in AIGC: A Surveycited by 34
- 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
- 2024V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protectioncited by 27
- 2014StegExpose - A Tool for Detecting LSB Steganographycited by 25
- 2020Detection, Attribution and Localization of GAN Generated Imagescited by 24
- 2023Attributing Image Generative Models using Latent Fingerprintscited by 20
- 2021Learning to Disentangle GAN Fingerprint for Fake Image Attributioncited by 19
- 2021Explaining deep learning models for spoofing and deepfake detection with SHapley Additive exPlanationscited by 13
- 2023What can Discriminator do? Towards Box-free Ownership Verification of Generative Adversarial Networkcited by 10
- 2024Detecting Origin Attribution for Text-to-Image Diffusion Modelscited by 7
- 2024Regeneration Based Training-free Attribution of Fake Images Generated by Text-to-Image Generative Modelscited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 111
- 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localizationcited by 9
- 2025GaussianSeal: Rooting Adaptive Watermarks for 3D Gaussian Generation Modelcited by 4
- 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localization3 Oct 2025
- 2025GaussianSeal: Rooting Adaptive Watermarks for 3D Gaussian Generation Model1 Mar 2025
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models3 Oct 2024