Deepfake Detection in Social Media: A Temporal Artifact Analysis Using 3D Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
Synthetic facial videos have proliferated across social media faster than platform moderation can respond, raising the cost of disinformation and identity-based attacks. Frame-level deepfake detectors degrade sharply as generator quality increases; high-quality 128x128 GAN output cuts spatial-only accuracy by five percentage points while leaving temporal inconsistencies largely intact. We address this gap with a 3D Convolutional Neural Network detector based on R3D-18, trained with a composite loss that combines binary cross-entropy with a temporal-consistency regularizer. The model processes 16-frame clips from the DeepfakeTIMIT dataset and is initialized from Kinetics-400 action-recognition weights. We report 92.8% accuracy on intra-dataset evaluation at 128x128 resolution; cross-dataset transfer to FaceForensics++ without fine-tuning reaches 76.4%, rising after minimal fine-tuning. Ablation studies show that transfer learning contributes 7.2 percentage points and face tracking adds 3.5 points, while temporal consistency regularization provides additional gains on high-quality fakes. The results establish that temporal artifacts generalize more broadly than spatial ones, providing a detection signal that survives social-media re-encoding.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 32 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
25 of 32 references.
References · 25
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
- 2019Recurrent Convolutional Strategies for Face Manipulation Detection in Videoscited by 118
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 57
- 2024Real-Time Deepfake Detection in the Real-Worldcited by 49
- 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 37
- 2024Faster Than Lies: Real-time Deepfake Detection using Binary Neural Networkscited by 27
- 2024Learning Natural Consistency Representation for Face Forgery Video Detectioncited by 26
- 2024Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learningcited by 20
- 2024Exploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysiscited by 15
13 more
- 2024A Timely Survey on Vision Transformer for Deepfake Detectioncited by 10
- 2024Wavelet-Driven Generalizable Framework for Deepfake Face Forgery Detectioncited by 8
- 2025Vulnerability-Aware Spatio-Temporal Learning for Generalizable Deepfake Video Detectioncited by 8
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2024Contextual Cross-Modal Attention for Audio-Visual Deepfake Detection and Localizationcited by 6
- 2024FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detectioncited by 6
- 2024Compressed Deepfake Video Detection Based on 3D Spatiotemporal Trajectoriescited by 4
- 2024Adaptive Meta-Learning for Robust Deepfake Detection: A Multi-Agent Framework to Data Drift and Model Generalizationcited by 4
- 2025HFMF: Hierarchical Fusion Meets Multi-Stream Models for Deepfake Detectioncited by 4
- 2024UniForensics: Face Forgery Detection via General Facial Representationcited by 3
- 2024A Multimodal Framework for Deepfake Detectioncited by 3
- 2025Reduced Spatial Dependency for More General Video-level Deepfake Detectioncited by 2
- 2025FAME: A Lightweight Spatio-Temporal Network for Model Attribution of Face-Swap Deepfakescited by 2
Built on by
Not cited yet.