Transferable Class-Modelling for Decentralized Source Attribution of GAN-Generated Images
Not on the map. Why?
Abstract (arXiv)
GAN-generated deepfakes as a genre of digital images are gaining ground as both catalysts of artistic expression and malicious forms of deception, therefore demanding systems to enforce and accredit their ethical use. Existing techniques for the source attribution of synthetic images identify subtle intrinsic fingerprints using multiclass classification neural nets limited in functionality and scalability. Hence, we redefine the deepfake detection and source attribution problems as a series of related binary classification tasks. We leverage transfer learning to rapidly adapt forgery detection networks for multiple independent attribution problems, by proposing a semi-decentralized modular design to solve them simultaneously and efficiently. Class activation mapping is also demonstrated as an effective means of feature localization for model interpretation. Our models are determined via experimentation to be competitive with current benchmarks, and capable of decent performance on human portraits in ideal conditions. Decentralized fingerprint-based attribution is found to retain validity in the presence of novel sources, but is more susceptible to type II errors that intensify with image perturbations and attributive uncertainty. We describe both our conceptual framework and model prototypes for further enhancement when investigating the technical limits of reactive deepfake attribution.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 44 references that are in the map. First posted on arXiv 18 Mar 2022.
Builds on
31 of 44 references.
References · 31
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2018Demystifying MMD GANscited by 1,268
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
19 more
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
- 2020Media Forensics and DeepFakes: an overviewcited by 208
- 2018Do GANs leave artificial fingerprints?cited by 188
- 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
- 2017The Cramer Distance as a Solution to Biased Wasserstein Gradientscited by 116
- 2018Noiseprint: a CNN-based camera model fingerprintcited by 114
- 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
- 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2020DeepFake Detection: Current Challenges and Next Stepscited by 44
- 2019GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detectioncited by 42
- 2020Detection, Attribution and Localization of GAN Generated Imagescited by 24
- 2018Learning to Detect Fake Face Images in the Wildcited by 22
- 2020Training CNNs in Presence of JPEG Compression: Multimedia Forensics vs Computer Visioncited by 17
- 2020Decentralized Attribution of Generative Modelscited by 16
- 2019SpoC: Spoofing Camera Fingerprintscited by 14
Built on by
Not cited yet.