Beyond Flicker: Detecting Kinematic Inconsistencies for Generalizable Deepfake Video Detection
Not on the map. Why?
Abstract (arXiv)
Generalizing deepfake detection to unseen manipulations remains a key challenge. A recent approach to tackle this issue is to train a network with pristine face images that have been manipulated with hand-crafted artifacts to extract more generalizable clues. While effective for static images, extending this to the video domain is an open issue. Existing methods model temporal artifacts as frame-to-frame instabilities, overlooking a key vulnerability: the violation of natural motion dependencies between different facial regions. In this paper, we propose a synthetic video generation method that creates training data with subtle kinematic inconsistencies. We train an autoencoder to decompose facial landmark configurations into motion bases. By manipulating these bases, we selectively break the natural correlations in facial movements and introduce these artifacts into pristine videos via face morphing. A network trained on our data learns to spot these sophisticated biomechanical flaws, achieving state-of-the-art generalization results on several popular benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 86 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
59 of 86 references.
References · 59
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
38 more
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 89
- 2019Unmasking DeepFakes with simple Featurescited by 78
- 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
- 2022FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbationscited by 75
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 59
- 2021Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Featurescited by 57
- 2022MARLIN: Masked Autoencoder for facial video Representation LearnINgcited by 57
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
- 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 38
- 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
- 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 31
- 2020How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signalscited by 29
- 2020DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimationcited by 29
- 2023DeepFake-Adapter: Dual-Level Adapter for DeepFake Detectioncited by 26
- 2022Shape Preserving Facial Landmarks with Graph Attention Networkscited by 23
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.