Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces
Not on the map. Why?
Abstract (arXiv)
The exploitation of Deepfake techniques for malicious intentions has driven significant research interest in Deepfake detection. Deepfake manipulations frequently introduce random tampered traces, leading to unpredictable outcomes in different facial regions. However, existing detection methods heavily rely on specific forgery indicators, and as the forgery mode improves, these traces become increasingly randomized, resulting in a decline in the detection performance of methods reliant on specific forgery traces. To address the limitation, we propose Recap, a novel Deepfake detection model that exposes unspecific facial part inconsistencies by recovering faces and enlarges the differences between real and fake by mapping recovered faces. In the recovering stage, the model focuses on randomly masking regions of interest (ROIs) and reconstructing real faces without unpredictable tampered traces, resulting in a relatively good recovery effect for real faces while a poor recovery effect for fake faces. In the mapping stage, the output of the recovery phase serves as supervision to guide the facial mapping process. This mapping process strategically emphasizes the mapping of fake faces with poor recovery, leading to a further deterioration in their representation, while enhancing and refining the mapping of real faces with good representation. As a result, this approach significantly amplifies the discrepancies between real and fake videos. Our extensive experiments on standard benchmarks demonstrate that Recap is effective in multiple scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 61 references that are in the map. First posted on arXiv 19 Aug 2023.
Builds on
38 of 61 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021Multi-attentional Deepfake Detectioncited by 339
26 more
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2018Deep Facial Expression Recognition: A Surveycited by 269
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
- 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2019Recurrent Convolutional Strategies for Face Manipulation Detection in Videoscited by 118
- 2020Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cuescited by 111
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
- 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
- 2020Sharp Multiple Instance Learning for DeepFake Video Detectioncited by 54
- 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
- 2022On Improving Cross-dataset Generalization of Deepfake Detectorscited by 34
- 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
- 2021Deepfake Forensics via An Adversarial Gamecited by 15
Built on by
Not cited yet.