Deepfake Detection that Generalizes Across Benchmarks
Not on the map. Why?
Abstract (arXiv)
The generalization of deepfake detectors to unseen manipulation techniques remains a challenge for practical deployment. Although many approaches adapt foundation models by introducing significant architectural complexity, this work demonstrates that robust generalization is achievable through a parameter-efficient adaptation of one of the foundational pre-trained vision encoders. The proposed method, GenD, fine-tunes only the Layer Normalization parameters (0.03% of the total) and enhances generalization by enforcing a hyperspherical feature manifold using L2 normalization and metric learning on it. We conducted an extensive evaluation on 14 benchmark datasets spanning from 2019 to 2025. The proposed method achieves state-of-the-art performance, outperforming more complex, recent approaches in average cross-dataset AUROC. Our analysis yields two primary findings for the field: 1) training on paired real-fake data from the same source video is essential for mitigating shortcut learning and improving generalization, and 2) detection difficulty on academic datasets has not strictly increased over time, with models trained on older, diverse datasets showing strong generalization capabilities. This work delivers a computationally efficient and reproducible method, proving that state-of-the-art generalization is attainable by making targeted, minimal changes to a pre-trained foundational image encoder model. The code is at: https://github.com/yermandy/GenD
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 55 of its 73 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
55 of 73 references.
References · 55
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2013Intriguing properties of neural networkscited by 5,155
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2015Cyclical Learning Rates for Training Neural Networkscited by 629
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
38 more
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 89
- 2021Face Forensics in the Wildcited by 87
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
- 2024Exploiting Style Latent Flows for Generalizing Deepfake Video Detectioncited by 59
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 59
- 2024Can We Leave Deepfake Data Behind in Training Deepfake Detector?cited by 49
- 2024CLIPping the Deception: Adapting Vision-Language Models for Universal Deepfake Detectioncited by 47
- 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 38
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 36
- 2022Proactive Image Manipulation Detectioncited by 35
- 2024Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakescited by 32
- 2025Exploring Unbiased Deepfake Detection via Token-Level Shuffling and Mixingcited by 27
- 2025OmniSync: Towards Universal Lip Synchronization via Diffusion Transformerscited by 27
- 2023MaLP: Manipulation Localization Using a Proactive Schemecited by 26
- 2024Learning Natural Consistency Representation for Face Forgery Video Detectioncited by 26
- 2024Learning Spatiotemporal Inconsistency via Thumbnail Layout for Face Deepfake Detectioncited by 21
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 21
- 2022Parameter-Efficient Tuning on Layer Normalization for Pre-trained Language Modelscited by 19
- 2022Model Attribution of Face-swap Deepfake Videoscited by 17
- 2021FaceGuard: Proactive Deepfake Detectioncited by 16
- 2024PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Datasetcited by 16
- 2022Testing Human Ability To Detect Deepfake Images of Human Facescited by 15
- 2024Exploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysiscited by 15
- 2024Identity-Driven Multimedia Forgery Detection via Reference Assistancecited by 14
- 2024Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modificationcited by 14
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 20.
21 papers.
Sort:
By area:
- 2026Robust Deepfake Detection, NTIRE 2026 Challenge: Reportcited by 6
- 2025Generalized Design Choices for Deepfake Detectorscited by 2
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detectioncited by 1
- 2026LOGER: Local--Global Ensemble for Robust Deepfake Detection in the Wildcited by 1
- 2026TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detectioncited by 1
- 2026Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Imagescited by 1
- 2026Uncertainty-Aware Deepfake Detection via Multi-View Structural Learningcited by 1
- 2026Na"ive Exposure of Generative AI Capabilities Undermines Deepfake Detectioncited by 0
- 2026Evidence Packing for Cross-Domain Image Deepfake Detection with LVLMscited by 0
- 2026Aletheia: Physics-Conditioned Localized Artifact Attention (PhyLAA-X) for End-to-End Generalizable and Robust Deepfake Video Detectioncited by 0
- 2026Energy-Based Constraint Networks: Learning Structural Coherence Across Modalitiescited by 0
- 2026The Alpha Blending Hypothesis: Compositing Shortcut in Deepfake Detectioncited by 0
9 more
- 2026The DeepSpeak-Agentic Datasetcited by 0
- 2026Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptationcited by 0
- 2026What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representationscited by 0
- 2026Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detectioncited by 0
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Expertscited by 0
- 2026GAN-Blot: A Controllable Structure-Style Synthesis Benchmark for Western Blot Forensicscited by 0
- 2026DF26: We Cannot Tell Fake From Real Anymorecited by 0
- 2026ModalFidelity: Routing Modalities for Deepfake Detection on a Budgetcited by 0
- 2026Interpretable Deepfake Detection in Videos via Explicit Forensic Features and Temporal Modelingcited by 0
- 2026Interpretable Deepfake Detection in Videos via Explicit Forensic Features and Temporal Modeling2 Oct 2026
- 2026ModalFidelity: Routing Modalities for Deepfake Detection on a Budget29 Sep 2026
- 2026DF26: We Cannot Tell Fake From Real Anymore7 Sep 2026
- 2026GAN-Blot: A Controllable Structure-Style Synthesis Benchmark for Western Blot Forensics6 Sep 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Uncertainty-Aware Deepfake Detection via Multi-View Structural Learning30 Jul 2026
- 2026Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detection28 Jul 2026
- 2026What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representations24 Jun 2026
- 2026Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptation3 Jun 2026
- 2026The DeepSpeak-Agentic Dataset2 Jun 2026
- 2026Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Images30 May 2026
- 2026The Alpha Blending Hypothesis: Compositing Shortcut in Deepfake Detection11 May 2026
9 more
- 2026Energy-Based Constraint Networks: Learning Structural Coherence Across Modalities1 May 2026
- 2026TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detection29 Apr 2026
- 2026Robust Deepfake Detection, NTIRE 2026 Challenge: Report27 Apr 2026
- 2026Aletheia: Physics-Conditioned Localized Artifact Attention (PhyLAA-X) for End-to-End Generalizable and Robust Deepfake Video Detection13 Apr 2026
- 2026LOGER: Local--Global Ensemble for Robust Deepfake Detection in the Wild4 Apr 2026
- 2026Evidence Packing for Cross-Domain Image Deepfake Detection with LVLMs18 Mar 2026
- 2026Na"ive Exposure of Generative AI Capabilities Undermines Deepfake Detection11 Mar 2026
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection2 Feb 2026
- 2025Generalized Design Choices for Deepfake Detectors26 Nov 2025
- 2026The DeepSpeak-Agentic Datasetcited by 0
- 2026The DeepSpeak-Agentic Dataset2 Jun 2026
- 2026Robust Deepfake Detection, NTIRE 2026 Challenge: Reportcited by 6
- 2025Generalized Design Choices for Deepfake Detectorscited by 2
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detectioncited by 1
- 2026LOGER: Local--Global Ensemble for Robust Deepfake Detection in the Wildcited by 1
- 2026TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detectioncited by 1
- 2026Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Imagescited by 1
- 2026Uncertainty-Aware Deepfake Detection via Multi-View Structural Learningcited by 1
- 2026Na"ive Exposure of Generative AI Capabilities Undermines Deepfake Detectioncited by 0
- 2026Evidence Packing for Cross-Domain Image Deepfake Detection with LVLMscited by 0
- 2026Aletheia: Physics-Conditioned Localized Artifact Attention (PhyLAA-X) for End-to-End Generalizable and Robust Deepfake Video Detectioncited by 0
- 2026Energy-Based Constraint Networks: Learning Structural Coherence Across Modalitiescited by 0
- 2026The Alpha Blending Hypothesis: Compositing Shortcut in Deepfake Detectioncited by 0
12 most cited of 18 All 18 (JSON)
- 2026Interpretable Deepfake Detection in Videos via Explicit Forensic Features and Temporal Modeling2 Oct 2026
- 2026ModalFidelity: Routing Modalities for Deepfake Detection on a Budget29 Sep 2026
- 2026DF26: We Cannot Tell Fake From Real Anymore7 Sep 2026
- 2026GAN-Blot: A Controllable Structure-Style Synthesis Benchmark for Western Blot Forensics6 Sep 2026
- 2026Uncertainty-Aware Deepfake Detection via Multi-View Structural Learning30 Jul 2026
- 2026Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detection28 Jul 2026
- 2026Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptation3 Jun 2026
- 2026Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Images30 May 2026
- 2026The Alpha Blending Hypothesis: Compositing Shortcut in Deepfake Detection11 May 2026
- 2026Energy-Based Constraint Networks: Learning Structural Coherence Across Modalities1 May 2026
- 2026TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detection29 Apr 2026
- 2026Robust Deepfake Detection, NTIRE 2026 Challenge: Report27 Apr 2026
12 newest of 18 All 18 (JSON)