FFR_FD: Effective and Fast Detection of DeepFakes Based on Feature Point Defects
Not on the map. Why?
Abstract (arXiv)
The internet is filled with fake face images and videos synthesized by deep generative models. These realistic DeepFakes pose a challenge to determine the authenticity of multimedia content. As countermeasures, artifact-based detection methods suffer from insufficiently fine-grained features that lead to limited detection performance. DNN-based detection methods are not efficient enough, given that a DeepFake can be created easily by mobile apps and DNN-based models require high computational resources. For the first time, we show that DeepFake faces have fewer feature points than real ones, especially in certain facial regions. Inspired by feature point detector-descriptors to extract discriminative features at the pixel level, we propose the Fused Facial Region_Feature Descriptor (FFR_FD) for effective and fast DeepFake detection. FFR_FD is only a vector extracted from the face, and it can be constructed from any feature point detector-descriptors. We train a random forest classifier with FFR_FD and conduct extensive experiments on six large-scale DeepFake datasets, whose results demonstrate that our method is superior to most state of the art DNN-based models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 51 of its 91 references that are in the map. First posted on arXiv 5 Jul 2021.
Builds on
51 of 91 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
38 more
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 208
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 208
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
- 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 143
- 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
- 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
- 2019Recurrent Convolutional Strategies for Face Manipulation Detection in Videoscited by 118
- 2020Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cuescited by 111
- 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
- 2020Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localizationcited by 89
- 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
- 2019Unmasking DeepFakes with simple Featurescited by 78
- 2020DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythmscited by 65
- 2019Use of a Capsule Network to Detect Fake Images and Videoscited by 63
- 2020Sharp Multiple Instance Learning for DeepFake Video Detectioncited by 54
- 2020Deepfakes Detection with Automatic Face Weightingcited by 35
- 2020FakePolisher: Making DeepFakes More Detection-Evasive by Shallow Reconstructioncited by 33
- 2017Image Matching Using SIFT, SURF, BRIEF and ORB: Performance Comparison for Distorted Imagescited by 30
- 2020Spectral Distribution Aware Image Generationcited by 29
- 2014Facial Feature Point Detection: A Comprehensive Surveycited by 13
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.