Environment-Invariant Subspace Learning for Generalizable Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Cross-distribution generalization remains a critical bottleneck in deepfake detection. While recent efforts leverage the semantic priors of large-scale visual foundation models (VFMs), a noteworthy yet underexplored challenge remains: the susceptibility of these semantic priors to environmental interference from factors such as lighting and style. Crucially, this interference establishes spurious correlations between forgery cues and environmental patterns that severely limit generalization. To address this fundamental challenge, we propose an innovative Environment-Invariant Subspace Learning (EISL) framework. The core contribution of EISL is that it aims to disentangle features into orthogonal forgery-relevant invariant factors and environment-related residual factors via a learnable low-rank projection. To facilitate robust feature disentanglement, we also design an Environmental Intervention module that generates diverse and challenging intervention pairs, simulating out-of-distribution environmental shifts to guide the model toward discovering truly invariant forgery representations. Experiments across cross-dataset, cross-generator, whole-face synthesis, and corruption settings show consistent gains and competitive or leading performance against strong detectors, demonstrating improved robustness to unseen forgery types and environmental variations. This work provides a new perspective and a valuable exploration for understanding and tackling the generalization barriers of VFMs in deepfake detection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 70 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
57 of 70 references.
References · 57
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
38 more
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2019On the Detection of Digital Face Manipulationcited by 260
- 2017MMD GAN: Towards Deeper Understanding of Moment Matching Networkcited by 254
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2022Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP)cited by 138
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 89
- 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
- 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
- 2024Exploiting Style Latent Flows for Generalizing Deepfake Video Detectioncited by 59
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 59
- 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
- 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
- 2024CLIPping the Deception: Adapting Vision-Language Models for Universal Deepfake Detectioncited by 47
- 2024Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detectioncited by 47
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2024Diffusion Facial Forgery Detectioncited by 41
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
- 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 31
- 2024Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake Detectioncited by 30
50 most cited of 57 All 57 (JSON)
Built on by
Not cited yet.