Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization
Not on the map. Why?
Abstract (arXiv)
In this paper, we analyse the generalization ability of binary classifiers for the task of deepfake detection. We find that the stumbling block to their generalization is caused by the unexpected learned identity representation on images. Termed as the Implicit Identity Leakage, this phenomenon has been qualitatively and quantitatively verified among various DNNs. Furthermore, based on such understanding, we propose a simple yet effective method named the ID-unaware Deepfake Detection Model to reduce the influence of this phenomenon. Extensive experimental results demonstrate that our method outperforms the state-of-the-art in both in-dataset and cross-dataset evaluation. The code is available at https://github.com/megvii-research/CADDM.
Key facts. Cited by 123 papers in the map (data through 14 Oct 2026). Builds on 63 of its 94 references that are in the map. First posted on arXiv 26 Oct 2022.
Builds on
63 of 94 references.
References · 63
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
38 more
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2015Fast R-CNNcited by 2,933
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2016YOLO9000: Better, Faster, Strongercited by 1,431
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 553
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2019Scale-Aware Trident Networks for Object Detectioncited by 159
- 2017S3FD: Single Shot Scale-invariant Face Detectorcited by 142
- 2017Receptive Field Block Net for Accurate and Fast Object Detectioncited by 141
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 132
- 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
- 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 120
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2020ID-Reveal: Identity-aware DeepFake Video Detectioncited by 97
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2023: 12; 2024: 45; 2025: 45; 2026: 21.
123 papers.
Sort:
By area:
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 89
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
- 2024Exploiting Style Latent Flows for Generalizing Deepfake Video Detectioncited by 59
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
38 more
- 2023Improving Fairness in Deepfake Detectioncited by 40
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 40
- 2024FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMscited by 38
- 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 38
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 31
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
- 2024MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detectioncited by 27
- 2025Exploring Unbiased Deepfake Detection via Token-Level Shuffling and Mixingcited by 27
- 2024Revisiting Tampered Scene Text Detection in the Era of Generative AIcited by 21
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarkscited by 21
- 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detectioncited by 21
- 2023Robust Identity Perceptual Watermark Against Deepfake Face Swappingcited by 17
- 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Frameworkcited by 14
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasingcited by 14
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 13
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Modelscited by 13
- 2025Beyond Spatial Frequency: Pixel-wise Temporal Frequency-based Deepfake Video Detectioncited by 13
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Tracescited by 12
- 2024Learning to Discover Forgery Cues for Face Forgery Detectioncited by 11
- 2025Dual Frequency Branch Framework with Reconstructed Sliding Windows Attention for AI-Generated Image Detectioncited by 11
- 2025TalkingHeadBench: A Multi-Modal Benchmark & Analysis of Talking-Head DeepFake Detectioncited by 11
- 2023GenAI Mirage: The Impostor Bias and the Deepfake Detection Challenge in the Era of Artificial Illusionscited by 10
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2025Vulnerability-Aware Spatio-Temporal Learning for Generalizable Deepfake Video Detectioncited by 9
- 2024Diffusion Deepfakecited by 8
- 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunitiescited by 8
- 2024Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Methodcited by 8
- 2024ED4: Explicit Data-level Debiasing for Deepfake Detectioncited by 8
- 2025NullSwap: Proactive Identity Cloaking Against Deepfake Face Swappingcited by 8
- 2025A Multimodal Deviation Perceiving Framework for Weakly-Supervised Temporal Forgery Localizationcited by 8
- 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakescited by 7
- 2025Fair Deepfake Detectors Can Generalizecited by 7
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2024FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detectioncited by 6
- 2025AvatarShield: Visual Reinforcement Learning for Human-Centric Synthetic Video Detectioncited by 6
- 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillationcited by 6
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attributioncited by 5
50 most cited of 123 All 123 (JSON)
- 2026Not Every Cue Is Evidence: Cue Supportability for Forensic Distillation in Face Forgery Detection12 Oct 2026
- 2026Revisiting Cross-Reconstruction for Generalizable Deepfake Detection1 Oct 2026
- 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection28 Sep 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detection18 Aug 2026
- 2026FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detection3 Aug 2026
- 2026Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection System14 Jul 2026
- 2026Phantom: A Unified Face-Swap Deepfake Protection Framework with Latent and Spatial Constraints30 Jun 2026
- 2026When AUC Misleads: Polarization-Aware Evaluation of Deepfake Detectors under Domain Shift17 Jun 2026
- 2026Suppressing Forgery-Specific Shortcuts for Generalizable Deepfake Detection1 Jun 2026
- 2026EMO-BOOST: Emotion-Augmented Audio-Visual Features for Improved Generalization in Deepfake Detection19 May 2026
- 2026Detecting Deepfakes via Hamiltonian Dynamics6 May 2026
38 more
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2026SAVe: Self-Supervised Audio-visual Deepfake Detection Exploiting Visual Artifacts and Audio-visual Misalignment26 Mar 2026
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detection25 Mar 2026
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correction14 Mar 2026
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection10 Mar 2026
- 2026Can We Build a Monolithic Model for Fake Image Detection? SICA: Semantic-Induced Constrained Adaptation for Unified-Yet-Discriminative Artifact Feature Space Reconstruction6 Feb 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2026MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Models28 Jan 2026
- 2026Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detection17 Jan 2026
- 2025Patch-Discontinuity Mining for Generalized Deepfake Detection26 Dec 2025
- 2025FakeRadar: Probing Forgery Outliers to Detect Unknown Deepfake Videos16 Dec 2025
- 2025UMCL: Unimodal-generated Multimodal Contrastive Learning for Cross-compression-rate Deepfake Detection24 Nov 2025
- 2025When Generative Replay Meets Evolving Deepfakes: Dual Confusion-Aware Regularization for Incremental Face Forgery Detection23 Nov 2025
- 2025Through the Lens: Benchmarking Deepfake Detectors Against Moir'e-Induced Distortions27 Oct 2025
- 2025Can Current Detectors Catch Face-to-Voice Deepfake Attacks?23 Oct 2025
- 2025Towards Robust and Realible Multimodal Misinformation Recognition with Incomplete Modality7 Oct 2025
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasing26 Sep 2025
- 2025Paired-Sampling Contrastive Framework for Joint Physical-Digital Face Attack Detection20 Aug 2025
- 2025Forgery Guided Learning Strategy with Dual Perception Network for Deepfake Cross-domain Detection14 Aug 2025
- 2025Leveraging Unlabeled Data from Unknown Sources via Dual-Path Guidance for Deepfake Face Detection12 Aug 2025
- 2025From Prediction to Explanation: Multimodal, Explainable, and Interactive Deepfake Detection Framework for Non-Expert Users11 Aug 2025
- 2025When Deepfake Detection Meets Graph Neural Network:a Unified and Lightweight Learning Framework7 Aug 2025
- 2025Visual Language Models as Zero-Shot Deepfake Detectors30 Jul 2025
- 2025Evaluating Deepfake Detectors in the Wild29 Jul 2025
- 2025Suppressing Gradient Conflict for Generalizable Deepfake Detection29 Jul 2025
- 2025Enhanced Deep Learning DeepFake Detection Integrating Handcrafted Features28 Jul 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025A Multimodal Deviation Perceiving Framework for Weakly-Supervised Temporal Forgery Localization22 Jul 2025
- 2025Fair Deepfake Detectors Can Generalize3 Jul 2025
- 2025Beyond Spatial Frequency: Pixel-wise Temporal Frequency-based Deepfake Video Detection3 Jul 2025
- 2025Trident: Detecting Face Forgeries with Adversarial Triplet Learning29 Jun 2025
- 2025SELFI: Selective Fusion of Identity for Generalizable Deepfake Detection21 Jun 2025
- 2025Noise-Informed Diffusion-Generated Image Detection with Anomaly Attention20 Jun 2025
- 2025TalkingHeadBench: A Multi-Modal Benchmark & Analysis of Talking-Head DeepFake Detection30 May 2025
- 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakes26 May 2025
- 2025Towards Generalized Proactive Defense against Face Swapping with Contour-Hybrid Watermark25 May 2025
- 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillation21 May 2025
- 2025AvatarShield: Visual Reinforcement Learning for Human-Centric Synthetic Video Detection21 May 2025
50 newest of 123 All 123 (JSON)
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 40
- 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detectioncited by 21
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Modelscited by 13
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2026MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Modelscited by 4
- 2025Visual Language Models as Zero-Shot Deepfake Detectorscited by 2
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detectioncited by 0
- 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detectioncited by 0
- 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection28 Sep 2026
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detection25 Mar 2026
- 2026MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Models28 Jan 2026
- 2025Visual Language Models as Zero-Shot Deepfake Detectors30 Jul 2025
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector26 Mar 2025
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models19 Mar 2025
- 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detection19 Mar 2025
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models3 Oct 2024
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistant19 Aug 2024
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges11 Jun 2024
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
- 2025Dual Frequency Branch Framework with Reconstructed Sliding Windows Attention for AI-Generated Image Detectioncited by 11
- 2024Diffusion Deepfakecited by 8
- 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunitiescited by 8
- 2025Noise-Informed Diffusion-Generated Image Detection with Anomaly Attentioncited by 3
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Modelscited by 1
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
- 2026When AUC Misleads: Polarization-Aware Evaluation of Deepfake Detectors under Domain Shiftcited by 0
- 2026When AUC Misleads: Polarization-Aware Evaluation of Deepfake Detectors under Domain Shift17 Jun 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2025Noise-Informed Diffusion-Generated Image Detection with Anomaly Attention20 Jun 2025
- 2025Dual Frequency Branch Framework with Reconstructed Sliding Windows Attention for AI-Generated Image Detection25 Jan 2025
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion6 Oct 2024
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Models19 Jun 2024
- 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunities25 Apr 2024
- 2024Diffusion Deepfake2 Apr 2024
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 89
- 2024Exploiting Style Latent Flows for Generalizing Deepfake Video Detectioncited by 59
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2023Improving Fairness in Deepfake Detectioncited by 40
- 2024FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMscited by 38
12 most cited of 99 All 99 (JSON)
- 2026Not Every Cue Is Evidence: Cue Supportability for Forensic Distillation in Face Forgery Detection12 Oct 2026
- 2026Revisiting Cross-Reconstruction for Generalizable Deepfake Detection1 Oct 2026
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detection18 Aug 2026
- 2026FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detection3 Aug 2026
- 2026Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection System14 Jul 2026
- 2026Phantom: A Unified Face-Swap Deepfake Protection Framework with Latent and Spatial Constraints30 Jun 2026
- 2026Suppressing Forgery-Specific Shortcuts for Generalizable Deepfake Detection1 Jun 2026
- 2026EMO-BOOST: Emotion-Augmented Audio-Visual Features for Improved Generalization in Deepfake Detection19 May 2026
- 2026Detecting Deepfakes via Hamiltonian Dynamics6 May 2026
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2026SAVe: Self-Supervised Audio-visual Deepfake Detection Exploiting Visual Artifacts and Audio-visual Misalignment26 Mar 2026
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correction14 Mar 2026
12 newest of 99 All 99 (JSON)