mlsanityData to 14 Oct 2026

Face Forgery Detection Based on Facial Region Displacement Trajectory Series

arXiv 2212.03678 ↗First posted 7 Dec 2022cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Deep-learning-based technologies such as deepfakes ones have been attracting widespread attention in both society and academia, particularly ones used to synthesize forged face images. These automatic and professional-skill-free face manipulation technologies can be used to replace the face in an original image or video with any target object while maintaining the expression and demeanor. Since human faces are closely related to identity characteristics, maliciously disseminated identity manipulated videos could trigger a crisis of public trust in the media and could even have serious political, social, and legal implications. To effectively detect manipulated videos, we focus on the position offset in the face blending process, resulting from the forced affine transformation of the normalized forged face. We introduce a method for detecting manipulated videos that is based on the trajectory of the facial region displacement. Specifically, we develop a virtual-anchor-based method for extracting the facial trajectory, which can robustly represent displacement information. This information was used to construct a network for exposing multidimensional artifacts in the trajectory sequences of manipulated videos that is based on dual-stream spatial-temporal graph attention and a gated recurrent unit backbone. Testing of our method on various manipulation datasets demonstrated that its accuracy and generalization ability is competitive with that of the leading detection methods.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 7 Dec 2022.

Builds on

22 of 33 references.

References · 22

  1. 2017Graph Attention Networkscited by 8,923
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  5. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  7. 2021How Attentive are Graph Attention Networks?cited by 835
  8. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  9. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
  10. 2021Graph Neural Network-Based Anomaly Detection in Multivariate Time Seriescited by 301
  11. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
  12. 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
10 more
  1. 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
  2. 2020Multivariate Time-series Anomaly Detection via Graph Attention Networkcited by 167
  3. 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
  4. 2019Recurrent Convolutional Strategies for Face Manipulation Detection in Videoscited by 118
  5. 2020Video-based Remote Physiological Measurement via Cross-verified Feature Disentanglingcited by 79
  6. 2021Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Featurescited by 57
  7. 2017TimeNet: Pre-trained deep recurrent neural network for time series classificationcited by 46
  8. 2019Exposing GAN-synthesized Faces Using Landmark Locationscited by 30
  9. 2020How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signalscited by 29
  10. 2019Insights into LSTM Fully Convolutional Networks for Time Series Classificationcited by 18

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 2.

4 papers.

  1. 2023GenConViT: Deepfake Video Detection Using Generative Convolutional Vision Transformercited by 13
  2. 2024Generating Attribution Reports for Manipulated Facial Images: A Dataset and Baselinecited by 6
  3. 2023Generalized Deepfakes Detection with Reconstructed-Blended Images and Multi-scale Feature Reconstruction Networkcited by 2
  4. 2024The Tug-of-War Between Deepfake Generation and Detectioncited by 1