CAM-VFD: Cross-Attention Multimodal Video Forgery Detection
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of Deepfake technologies and video manipulation tools poses a critical challenge to multimedia forensics, judicial evidence integrity, and information authenticity. Current detectors rely on single-modality signals, treating appearance, geometry, and motion independently. However, advanced generators maintain within-modality consistency while producing cross-modal contradictions, which are forensically discriminative but invisible to any single-modal detector. We propose CAM-VFD, a Cross-Attention Multimodal Video Forgery Detection framework that models cross-modal contradiction as a directional forensic signal. The framework uses a cross-attention fusion mechanism in which CLIP-based appearance representations serve as queries against VideoMAE motion features and MiDaS depth features, enabling the identification of contradictions between visual, temporal, and geometric evidence. We examine this design through cross-modal attention discrepancy analysis, observing statistically separable real and fake distributions (p<0.001, Cohen's d=0.68). Experimental results on two generative video benchmarks indicate consistent performance, with 95.31% Top-1 accuracy on GenVidBench and 93.43% accuracy, 90.63% F1-score, and 96.56% AUROC on GenVideo. Moreover, CAM-VFD demonstrates stable performance under compression, noise, blur, and adversarial perturbations, suggesting that cross-modal reasoning may improve robustness in media forensics. The code is publicly available at urlhttps://github.com/Hoda-Osama/CAM-VFD/tree/main.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 51 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
34 of 51 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2021Video Swin Transformercited by 1,091
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
22 more
- 2017Temporal Relational Reasoning in Videoscited by 324
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2020Temporal Pyramid Network for Action Recognitioncited by 163
- 2018AdaFrame: Adaptive Frame Selection for Fast Video Recognitioncited by 134
- 2022UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormercited by 116
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 2021Make It Move: Controllable Image-to-Video Generation with Text Descriptionscited by 88
- 2020DeepFake Detection by Analyzing Convolutional Tracescited by 81
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2023A Recipe for Scaling up Text-to-Video Generation with Text-free Videoscited by 51
- 2020Temporal Interlacing Networkcited by 45
- 2024Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakescited by 32
- 2025Physics-Driven Spatiotemporal Modeling for AI-Generated Video Detectioncited by 27
- 2024Exposing Lip-syncing Deepfakes from Mouth Inconsistenciescited by 15
- 2025STiL: Semi-supervised Tabular-Image Learning for Comprehensive Task-Relevant Information Exploration in Multimodal Classificationcited by 12
- 2022Generalizable Deepfake Detection with Phase-Based Motion Analysiscited by 10
- 2025Vulnerability-Aware Spatio-Temporal Learning for Generalizable Deepfake Video Detectioncited by 9
- 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillationcited by 6
- 2024Human Action CLIPs: Detecting AI-generated Human Motioncited by 4
- 2025A Spatial-Frequency Aware Multi-Scale Fusion Network for Real-Time Deepfake Detectioncited by 2
Built on by
Not cited yet.