Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning
Not on the map. Why?
Abstract (arXiv)
The proliferation of synthetic facial imagery has intensified the need for robust Open-World DeepFake Attribution (OW-DFA), which aims to attribute both known and unknown forgeries using labeled data for known types and unlabeled data containing a mixture of known and novel types. However, existing OW-DFA methods face two critical limitations: 1) A confidence skew that leads to unreliable pseudo-labels for novel forgeries, resulting in biased training. 2) An unrealistic assumption that the number of unknown forgery types is known *a priori*. To address these challenges, we propose a Confidence-Aware Asymmetric Learning (CAL) framework, which adaptively balances model confidence across known and novel forgery types. CAL mainly consists of two components: Confidence-Aware Consistency Regularization (CCR) and Asymmetric Confidence Reinforcement (ACR). CCR mitigates pseudo-label bias by dynamically scaling sample losses based on normalized confidence, gradually shifting the training focus from high- to low-confidence samples. ACR complements this by separately calibrating confidence for known and novel classes through selective learning on high-confidence samples, guided by their confidence gap. Together, CCR and ACR form a mutually reinforcing loop that significantly improves the model's OW-DFA performance. Moreover, we introduce a Dynamic Prototype Pruning (DPP) strategy that automatically estimates the number of novel forgery types in a coarse-to-fine manner, removing the need for unrealistic prior assumptions and enhancing the scalability of our methods to real-world OW-DFA scenarios. Extensive experiments on the standard OW-DFA benchmark and a newly extended benchmark incorporating advanced manipulations demonstrate that CAL consistently outperforms previous methods, achieving new state-of-the-art performance on both known and novel forgery attribution.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 73 of its 109 references that are in the map. First posted on arXiv 14 Dec 2025.
Builds on
73 of 109 references.
References · 73
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
38 more
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2019On the Detection of Digital Face Manipulationcited by 260
- 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
- 2019Learning to Discover Novel Visual Categories via Deep Transfer Clusteringcited by 225
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 201
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 178
- 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 175
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2021Open-World Semi-Supervised Learningcited by 165
- 2021A Unified Objective for Novel Class Discoverycited by 162
- 2020Automatically Discovering and Learning New Visual Categories with Ranking Statisticscited by 143
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 126
- 2021Neighborhood Contrastive Learning for Novel Class Discoverycited by 121
- 2022Parametric Classification for Generalized Category Discovery: A Baseline Studycited by 113
- 2019SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Colorcited by 106
- 2021Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillationcited by 104
- 2020OpenMix: Reviving Known Knowledge for Discovering Novel Visual Categories in An Open Worldcited by 93
- 2023Dynamic Conceptional Contrastive Learning for Generalized Category Discoverycited by 92
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
- 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
- 2022FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swappingcited by 44
- 2022MobileFaceSwap: A Lightweight Framework for Video Face Swappingcited by 39
- 2023Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discoverycited by 39
- 2024SelEx: Self-Expertise in Fine-Grained Generalized Category Discoverycited by 34
- 2022Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformerscited by 33
- 2023Contrastive Pseudo Learning for Open-World DeepFake Attributioncited by 27
- 2024GET: Unlocking the Multi-modal Potential of CLIP for Generalized Category Discoverycited by 27
- 2022Modeling Inter-Class and Intra-Class Constraints in Novel Class Discoverycited by 26
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026The Eleventh NTIRE 2026 Efficient Super-Resolution Challenge Reportcited by 25
- 2026Agile-VLA: Few-Shot Industrial Pose Rectification via Implicit Affordance Anchoringcited by 1
- 2026The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discoverycited by 0
- 2026Face-Trace: Open-Set Attribution and Progressive Discovery of Synthetic Face Generatorscited by 0
- 2026HumanForge: A Human-Centric Deepfake Video Benchmark with Multi-Agent Forgery Rationalescited by 0
- 2026HumanForge: A Human-Centric Deepfake Video Benchmark with Multi-Agent Forgery Rationales9 Jul 2026
- 2026Face-Trace: Open-Set Attribution and Progressive Discovery of Synthetic Face Generators8 Jul 2026
- 2026The Eleventh NTIRE 2026 Efficient Super-Resolution Challenge Report3 Apr 2026
- 2026The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery25 Mar 2026
- 2026Agile-VLA: Few-Shot Industrial Pose Rectification via Implicit Affordance Anchoring24 Mar 2026