Leveraging Failed Samples: A Few-Shot and Training-Free Framework for Generalized Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Recent deepfake detection studies often treat unseen sample detection as a ``zero-shot" task, training on images generated by known models but generalizing to unknown ones. A key real-world challenge arises when a model performs poorly on unknown samples, yet these samples remain available for analysis. This highlights that it should be approached as a ``few-shot" task, where effectively utilizing a small number of samples can lead to significant improvement. Unlike typical few-shot tasks focused on semantic understanding, deepfake detection prioritizes image realism, which closely mirrors real-world distributions. In this work, we propose the Few-shot Training-free Network (FTNet) for real-world few-shot deepfake detection. Simple yet effective, FTNet differs from traditional methods that rely on large-scale known data for training. Instead, FTNet uses only one fake samplefrom an evaluation set, mimicking the scenario where new samples emerge in the real world and can be gathered for use, without any training or parameter updates. During evaluation, each test sample is compared to the known fake and real samples, and it is classified based on the category of the nearest sample. We conduct a comprehensive analysis of AI-generated images from 29 different generative models and achieve a new SoTA performance, with an average improvement of 8.7% compared to existing methods. This work introduces a fresh perspective on real-world deepfake detection: when the model struggles to generalize on a few-shot sample, leveraging the failed samples leads to better performance.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 43 of its 54 references that are in the map. First posted on arXiv 13 Aug 2025.
Builds on
43 of 54 references.
References · 43
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,213
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,000
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,323
- 2021Zero-Shot Text-to-Image Generationcited by 4,284
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,605
- 2017Prototypical Networks for Few-shot Learningcited by 3,011
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,975
31 more
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,619
- 2015Learning Deep Features for Discriminative Localizationcited by 2,434
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,296
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,097
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 846
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 520
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 488
- 2018Learning to See in the Darkcited by 459
- 2021Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modelingcited by 430
- 2023DIRE for Diffusion-Generated Image Detectioncited by 389
- 2022Detecting Deepfakes with Self-Blended Imagescited by 333
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 279
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2018Do GANs leave artificial fingerprints?cited by 190
- 2024A Sanity Check for AI-generated Image Detectioncited by 187
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 181
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 112
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 103
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
- 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
- 2018Diverse Image Synthesis from Semantic Layouts via Conditional IMLEcited by 60
- 2024LaRE2: Latent Reconstruction Error Based Method for Diffusion-Generated Image Detectioncited by 47
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 43
- 2025Few-Shot Learner Generalizes Across AI-Generated Image Detectioncited by 13
Built on by
Citing papers per year: 2026: 2.
2 papers.