CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversion
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Diffusion Models (DMs) have evolved into advanced image generation tools, especially for few-shot generation where a pretrained model is fine-tuned on a small set of images to capture a specific style or object. Despite their success, concerns exist about potential copyright violations stemming from the use of unauthorized data in this process. In response, we present Contrasting Gradient Inversion for Diffusion Models (CGI-DM), a novel method featuring vivid visual representations for digital copyright authentication. Our approach involves removing partial information of an image and recovering missing details by exploiting conceptual differences between the pretrained and fine-tuned models. We formulate the differences as KL divergence between latent variables of the two models when given the same input image, which can be maximized through Monte Carlo sampling and Projected Gradient Descent (PGD). The similarity between original and recovered images serves as a strong indicator of potential infringements. Extensive experiments on the WikiArt and Dreambooth datasets demonstrate the high accuracy of CGI-DM in digital copyright authentication, surpassing alternative validation techniques. Code implementation is available at https://github.com/Nicholas0228/Revelio.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 33 of its 40 references that are in the map. First posted on arXiv 17 Mar 2024.
Builds on
33 of 40 references.
Closest ancestors · 8
Same direction, newest first
- 2023White-box Membership Inference Attacks against Diffusion Models11 Aug
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
- 2023An Efficient Membership Inference Attack for the Diffusion Model by Proximal Initialization26 May
- 2023DiffusionShield: A Watermark for Copyright Protection against Generative Diffusion Models25 May
- 2023A Recipe for Watermarking Diffusion Models17 Mar
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples9 Feb
- 2023Are Diffusion Models Vulnerable to Membership Inference Attacks?2 Feb
- 2023Extracting Training Data from Diffusion Models30 Jan
Other references · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
13 more
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
- 2021See through Gradients: Image Batch Recovery via GradInversioncited by 326
- 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 246
- 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
- 2023Understanding and Mitigating Copying in Diffusion Modelscited by 209
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
- 2020Knowledge-Enriched Distributional Model Inversion Attackscited by 67
- 2022Do Gradient Inversion Attacks Make Federated Learning Unsafe?cited by 44
- 2023Re-thinking Model Inversion Attacks Against Deep Neural Networkscited by 39
- 2023Security and Privacy on Generative Data in AIGC: A Surveycited by 34
- 2023AltDiffusion: A Multilingual Text-to-Image Diffusion Modelcited by 30
Built on by
Citing papers per year: 2024: 4; 2025: 2.
6 papers.
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
- 2024An Inversion-based Measure of Memorization for Diffusion Modelscited by 6
- 2025Time-Unified Diffusion Policy with Action Discrimination for Robotic Manipulationcited by 5
- 2025Harnessing Frequency Spectrum Insights for Image Copyright Protection Against Diffusion Modelscited by 4
- 2024Leveraging Model Guidance to Extract Training Data from Personalized Diffusion Modelscited by 1
- 2024Real-World Benchmarks Make Membership Inference Attacks Fail on Diffusion Modelscited by 1
- 2025Time-Unified Diffusion Policy with Action Discrimination for Robotic Manipulation11 Jun 2025
- 2025Harnessing Frequency Spectrum Insights for Image Copyright Protection Against Diffusion Models14 Mar 2025
- 2024Real-World Benchmarks Make Membership Inference Attacks Fail on Diffusion Models4 Oct 2024
- 2024Leveraging Model Guidance to Extract Training Data from Personalized Diffusion Models3 Oct 2024
- 2024Replication in Visual Diffusion Models: A Survey and Outlook7 Jul 2024
- 2024An Inversion-based Measure of Memorization for Diffusion Models9 May 2024
Similar, not cited
Close in wording, no citation either way
- 2025Copyright Infringement Detection in Text-to-Image Diffusion Models via Differential Privacy
- 2023On Copyright Risks of Text-to-Image Diffusion Models
- 2024The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methods
- 2024CopyrightShield: Enhancing Diffusion Model Security against Copyright Infringement Attacks
- 2024RLCP: A Reinforcement Learning-based Copyright Protection Method for Text-to-Image Diffusion Model
- 2024CopyrightMeter: Revisiting Copyright Protection in Text-to-image Models
- 2024Disguised Copyright Infringement of Latent Diffusion Models
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challenges