mlsanityData to 14 Oct 2026

Open Set Synthetic Image Source Attribution

arXiv 2308.11557 ↗First posted 22 Aug 2023eess.IV cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

AI-generated images have become increasingly realistic and have garnered significant public attention. While synthetic images are intriguing due to their realism, they also pose an important misinformation threat. To address this new threat, researchers have developed multiple algorithms to detect synthetic images and identify their source generators. However, most existing source attribution techniques are designed to operate in a closed-set scenario, i.e. they can only be used to discriminate between known image generators. By contrast, new image-generation techniques are rapidly emerging. To contend with this, there is a great need for open-set source attribution techniques that can identify when synthetic images have originated from new, unseen generators. To address this problem, we propose a new metric learning-based approach. Our technique works by learning transferrable embeddings capable of discriminating between generators, even when they are not seen during training. An image is first assigned to a candidate generator, then is accepted or rejected based on its distance in the embedding space from known generators' learned reference points. Importantly, we identify that initializing our source attribution embedding network by pretraining it on image camera identification can improve our embeddings' transferability. Through a series of experiments, we demonstrate our approach's ability to attribute the source of synthetic images in open-set scenarios.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 31 of its 53 references that are in the map. First posted on arXiv 22 Aug 2023.

Builds on

31 of 53 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  10. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  11. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  12. 2021Alias-Free Generative Adversarial Networkscited by 1,184
19 more
  1. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  2. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  3. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  4. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  5. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  6. 2020Media Forensics and DeepFakes: an overviewcited by 209
  7. 2021Projected GANs Converge Fastercited by 208
  8. 2017Deep Bilateral Learning for Real-Time Image Enhancementcited by 200
  9. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  10. 2021Are GAN generated images easy to detect? A critical analysis of the state-of-the-artcited by 139
  11. 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
  12. 2018Noiseprint: a CNN-based camera model fingerprintcited by 114
  13. 2020ProxyNCA++: Revisiting and Revitalizing Proxy Neighborhood Component Analysiscited by 107
  14. 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
  15. 2022RepMix: Representation Mixing for Robust Attribution of Synthesized Imagescited by 39
  16. 2019Forensic Similarity for Digital Imagescited by 27
  17. 2019Source Generator Attribution via Inversioncited by 22
  18. 2019Exposing Fake Images with Forensic Similarity Graphscited by 18
  19. 2019An In-Depth Study on Open-Set Camera Model Identificationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 6; 2026: 2.

12 papers.