Open Set Face Forgery Detection via Dual-Level Evidence Collection
Not on the map. Why?
Abstract (arXiv)
The surge in face forgeries has increasingly undermined confidence in the authenticity of online content. As generation algorithms rapidly evolve, new fake categories will constantly emerge, severely challenging existing face forgery detection methods. Although face forgery detection has recently improved, current techniques remain largely confined to binary Real-vs-Fake classification or the recognition of known fake categories. Moreover, they fail to identify the emergence of entirely new forgery methods. In this work, we study the Open Set Face Forgery Detection (OSFFD) problem, which requires the detection model to identify novel fake categories. To enhance its real-world applicability, we reformulate the OSFFD problem and address it through uncertainty estimation. Specifically, we propose the Dual-Level Evidential face forgery Detection (DLED) approach, which estimates prediction uncertainty by extracting and integrating category-specific evidence on the spatial and frequency levels. Comprehensive experiments across diverse settings demonstrate that our proposed DLED approach achieves state-of-the-art performance. Notably, it surpasses various existing baseline models by a 20% margin on average when identifying forgeries from novel fake categories. Concurrently, our DLED method yields competitive performance on the standard binary Real-versus-Fake face forgery detection task.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 57 of its 78 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
57 of 78 references.
References · 57
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2020First Order Motion Model for Image Animationcited by 698
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
38 more
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
- 2023DIRE for Diffusion-Generated Image Detectioncited by 386
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 180
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
- 2021Evidential Deep Learning for Open Set Action Recognitioncited by 96
- 2021Trusted Multi-View Classificationcited by 94
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
- 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
- 2021Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learningcited by 60
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
- 2022Deepfake Network Architecture Attributioncited by 47
- 2024CLIPping the Deception: Adapting Vision-Language Models for Universal Deepfake Detectioncited by 47
- 2021Energy-Based Open-World Uncertainty Modeling for Confidence Calibrationcited by 46
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 43
- 2020Uncertainty-Aware Deep Classifiers using Generative Modelscited by 41
- 2016Learning Residual Images for Face Attribute Manipulationcited by 40
- 2024CFPL-FAS: Class Free Prompt Learning for Generalizable Face Anti-spoofingcited by 39
- 2022On Improving Cross-dataset Generalization of Deepfake Detectorscited by 34
- 2023Contrastive Pseudo Learning for Open-World DeepFake Attributioncited by 27
- 2023Open Set Action Recognition via Multi-Label Evidential Learningcited by 26
- 2023Copyright Protection and Accountability of Generative AI:Attack, Watermarking and Attributioncited by 15
50 most cited of 57 All 57 (JSON)
Built on by
Not cited yet.