Few-shot Forgery Detection via Guided Adversarial Interpolation
Not on the map. Why?
Abstract (arXiv)
The increase in face manipulation models has led to a critical issue in society - the synthesis of realistic visual media. With the emergence of new forgery approaches at an unprecedented rate, existing forgery detection methods suffer from significant performance drops when applied to unseen novel forgery approaches. In this work, we address the few-shot forgery detection problem by 1) designing a comprehensive benchmark based on coverage analysis among various forgery approaches, and 2) proposing Guided Adversarial Interpolation (GAI). Our key insight is that there exist transferable distribution characteristics between majority and minority forgery classes1. Specifically, we enhance the discriminative ability against novel forgery approaches via adversarially interpolating the forgery artifacts of the minority samples to the majority samples under the guidance of a teacher network. Unlike the standard re-balancing method which usually results in over-fitting to minority classes, our method simultaneously takes account of the diversity of majority information as well as the significance of minority information. Extensive experiments demonstrate that our GAI achieves state-of-the-art performances on the established few-shot forgery detection benchmark. Notably, our method is also validated to be robust to choices of majority and minority forgery approaches. The formal publication version is available in Pattern Recognition.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 53 of its 73 references that are in the map. First posted on arXiv 12 Apr 2022.
Builds on
53 of 73 references.
References · 53
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2013Intriguing properties of neural networkscited by 5,155
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
38 more
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2016Pixel Recurrent Neural Networkscited by 816
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
- 2020First Order Motion Model for Image Animationcited by 704
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2014Understanding Deep Image Representations by Inverting Themcited by 403
- 2019BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognitioncited by 403
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2019On the Detection of Digital Face Manipulationcited by 260
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
- 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
- 2020The Creation and Detection of Deepfakes: A Surveycited by 247
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 220
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
- 2020Learning From Multiple Experts: Self-paced Knowledge Distillation for Long-tailed Classificationcited by 175
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2020M2m: Imbalanced Classification via Major-to-minor Translationcited by 134
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 132
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 126
- 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
- 2020Deep Representation Learning on Long-tailed Data: A Learnable Embedding Augmentation Perspectivecited by 120
- 2019SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Colorcited by 106
- 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
- 2019Text-based Editing of Talking-head Videocited by 103
- 2019Dynamic Curriculum Learning for Imbalanced Data Classificationcited by 93
- 2019SemanticAdv: Generating Adversarial Examples via Attribute-conditional Image Editingcited by 93
- 2018Detecting GAN-generated Imagery using Color Cuescited by 76
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.