mlsanityData to 7 Oct 2026

Image Copy Detection for Diffusion Models

arXiv 2409.19952 ↗First posted 30 Sep 2024cs.CVcited by 4

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Images produced by diffusion models are increasingly popular in digital artwork and visual marketing. However, such generated images might replicate content from existing ones and pose the challenge of content originality. Existing Image Copy Detection (ICD) models, though accurate in detecting hand-crafted replicas, overlook the challenge from diffusion models. This motivates us to introduce ICDiff, the first ICD specialized for diffusion models. To this end, we construct a Diffusion-Replication (D-Rep) dataset and correspondingly propose a novel deep embedding method. D-Rep uses a state-of-the-art diffusion model (Stable Diffusion V1.5) to generate 40, 000 image-replica pairs, which are manually annotated into 6 replication levels ranging from 0 (no replication) to 5 (total replication). Our method, PDF-Embedding, transforms the replication level of each image-replica pair into a probability density function (PDF) as the supervision signal. The intuition is that the probability of neighboring replication levels should be continuous and smooth. Experimental results show that PDF-Embedding surpasses protocol-driven methods and non-PDF choices on the D-Rep test set. Moreover, by utilizing PDF-Embedding, we find that the replication ratios of well-known diffusion models against an open-source gallery range from 10% to 20%. The project is publicly available at https://icdiff.github.io/.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 42 of its 52 references that are in the map. First posted on arXiv 30 Sep 2024.

Builds on

42 of 52 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Detecting, Explaining, and Mitigating Memorization in Diffusion Models31 Jul
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  3. 2023Understanding and Mitigating Copying in Diffusion Models31 May
  4. 2023On the De-duplication of LAION-2B17 Mar
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec

Other references · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  7. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  8. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  9. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  10. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  12. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
25 more
  1. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  2. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  3. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  5. 2022A ConvNet for the 2020scited by 3,545
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  7. 2023Extracting Training Data from Diffusion Modelscited by 723
  8. 2021SLIP: Self-supervision meets Language-Image Pre-trainingcited by 434
  9. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  10. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  11. 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Modelscited by 297
  12. 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 175
  13. 2023A Recipe for Watermarking Diffusion Modelscited by 136
  14. 2023On Provable Copyright Protection for Generative Modelscited by 97
  15. 2023Talkin' 'Bout AI Generation: Copyright and the Generative-AI Supply Chaincited by 45
  16. 2021The 2021 Image Similarity Dataset and Challengecited by 44
  17. 2021Contrastive Vision-Language Pre-training with Limited Resourcescited by 25
  18. 2021Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detectioncited by 23
  19. 2023FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Modelscited by 20
  20. 2021Bag of Tricks and A Strong baseline for Image Copy Detectioncited by 14
  21. 2022Results and findings of the 2021 Image Similarity Challengecited by 10
  22. 2022A Benchmark and Asymmetrical-Similarity Learning for Practical Image Copy Detectioncited by 9
  23. 2021Producing augmentation-invariant embeddings from real-life imagerycited by 6
  24. 2023My Art My Choice: Adversarial Protection Against Unruly AIcited by 5
  25. 2024AnyPattern: Towards In-context Image Copy Detectioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Replication in Visual Diffusion Models: A Survey and Outlook
  2. 2023DIRE for Diffusion-Generated Image Detection
  3. 2022Markup-to-Image Diffusion Models with Scheduled Sampling
  4. 2024Diffusion Models Need Visual Priors for Image Generation
  5. 2024LoyalDiffusion: A Diffusion Model Guarding Against Data Replication
  6. 2024The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methods
  7. 2022Diffusion Models: A Comprehensive Survey of Methods and Applications
  8. 2024Frame by Familiar Frame: Understanding Replication in Video Diffusion Models