mlsanityData to 7 Oct 2026

Model Synthesis for Zero-Shot Model Attribution

arXiv 2307.15977 ↗First posted 29 Jul 2023cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Nowadays, generative models are shaping various fields such as art, design, and human-computer interaction, yet accompanied by challenges related to copyright infringement and content management. In response, existing research seeks to identify the unique fingerprints on the images they generate, which can be leveraged to attribute the generated images to their source models. Existing methods, however, are constrained to identifying models within a static set included in the classifier training, failing to adapt to newly emerged unseen models dynamically. To bridge this gap, we aim to develop a generalized model fingerprint extractor capable of zero-shot attribution, effectively attributes unseen models without exposure during training. Central to our method is a model synthesis technique, which generates numerous synthetic models mimicking the fingerprint patterns of real-world generative models. The design of the synthesis technique is motivated by observations on how the basic generative model's architecture building blocks and parameters influence fingerprint patterns, and it is validated through two designed metrics that examine synthetic models' fidelity and diversity. Our experiments demonstrate that this fingerprint extractor, trained solely on synthetic models, achieves impressive zero-shot generalization on a wide range of real-world generative models, improving model identification and verification accuracy on unseen models by over 40% and 15%, respectively, compared to existing approaches.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 51 of its 76 references that are in the map. First posted on arXiv 29 Jul 2023.

Builds on

51 of 76 references.

References · 51

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  11. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  12. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
38 more
  1. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  2. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  3. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  4. 2018Demystifying MMD GANscited by 1,268
  5. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  6. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  7. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  8. 2018Self-Attention Generative Adversarial Networkscited by 809
  9. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
  10. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
  11. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  12. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
  13. 2019Residual Flows for Invertible Generative Modelingcited by 256
  14. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
  15. 2018Do GANs leave artificial fingerprints?cited by 188
  16. 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
  17. 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
  18. 2019Fourier Spectrum Discrepancies in Deep Network Generated Imagescited by 138
  19. 2023A Recipe for Watermarking Diffusion Modelscited by 136
  20. 2017InfoVAE: Information Maximizing Variational Autoencoderscited by 124
  21. 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 121
  22. 2021Generative Adversarial Transformerscited by 120
  23. 2021Learning to See by Looking at Noisecited by 92
  24. 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 90
  25. 2021A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detectioncited by 68
  26. 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
  27. 2021On the Frequency Bias of Generative Modelscited by 60
  28. 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
  29. 2022Deepfake Network Architecture Attributioncited by 47
  30. 2022RepMix: Representation Mixing for Robust Attribution of Synthesized Imagescited by 39
  31. 2020Spatial Frequency Bias in Convolutional Generative Adversarial Networkscited by 35
  32. 2023Progressive Open Space Expansion for Open-Set Model Attributioncited by 32
  33. 2021Styleformer: Transformer based Generative Adversarial Networks with Style Vectorcited by 27
  34. 2021Task2Sim : Towards Effective Pre-training and Transfer from Synthetic Datacited by 26
  35. 2019Source Generator Attribution via Inversioncited by 21
  36. 2023Attributing Image Generative Models using Latent Fingerprintscited by 20
  37. 2022Exposing Deepfake Face Forgeries with Guided Residualscited by 17
  38. 2019Scalable Fine-grained Generated Image Classification Based on Deep Metric Learningcited by 6

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 2.

5 papers.