mlsanityData to 7 Oct 2026

Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces

arXiv 2308.09921 ↗First posted 19 Aug 2023cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The exploitation of Deepfake techniques for malicious intentions has driven significant research interest in Deepfake detection. Deepfake manipulations frequently introduce random tampered traces, leading to unpredictable outcomes in different facial regions. However, existing detection methods heavily rely on specific forgery indicators, and as the forgery mode improves, these traces become increasingly randomized, resulting in a decline in the detection performance of methods reliant on specific forgery traces. To address the limitation, we propose Recap, a novel Deepfake detection model that exposes unspecific facial part inconsistencies by recovering faces and enlarges the differences between real and fake by mapping recovered faces. In the recovering stage, the model focuses on randomly masking regions of interest (ROIs) and reconstructing real faces without unpredictable tampered traces, resulting in a relatively good recovery effect for real faces while a poor recovery effect for fake faces. In the mapping stage, the output of the recovery phase serves as supervision to guide the facial mapping process. This mapping process strategically emphasizes the mapping of fake faces with poor recovery, leading to a further deterioration in their representation, while enhancing and refining the mapping of real faces with good representation. As a result, this approach significantly amplifies the discrepancies between real and fake videos. Our extensive experiments on standard benchmarks demonstrate that Recap is effective in multiple scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 61 references that are in the map. First posted on arXiv 19 Aug 2023.

Builds on

38 of 61 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  4. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  5. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  6. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  7. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  8. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  9. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  10. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  11. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  12. 2021Multi-attentional Deepfake Detectioncited by 339
26 more
  1. 2022Detecting Deepfakes with Self-Blended Imagescited by 332
  2. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
  3. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
  4. 2020What makes fake images detectable? Understanding properties that generalizecited by 272
  5. 2018Deep Facial Expression Recognition: A Surveycited by 269
  6. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
  7. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
  8. 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
  9. 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
  10. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  11. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  12. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
  13. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
  14. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  15. 2019Recurrent Convolutional Strategies for Face Manipulation Detection in Videoscited by 118
  16. 2020Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cuescited by 111
  17. 2021Local Relation Learning for Face Forgery Detectioncited by 100
  18. 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
  19. 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
  20. 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
  21. 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
  22. 2020Sharp Multiple Instance Learning for DeepFake Video Detectioncited by 54
  23. 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
  24. 2022On Improving Cross-dataset Generalization of Deepfake Detectorscited by 34
  25. 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
  26. 2021Deepfake Forensics via An Adversarial Gamecited by 15

Built on by

Not cited yet.