Video Forgery Detection with Optical Flow Residuals and Spatial-Temporal Consistency
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
The rapid advancement of diffusion-based video generation models has led to increasingly realistic synthetic content, presenting new challenges for video forgery detection. Existing methods often struggle to capture fine-grained temporal inconsistencies, particularly in AI-generated videos with high visual fidelity and coherent motion. In this work, we propose a detection framework that leverages spatial-temporal consistency by combining RGB appearance features with optical flow residuals. The model adopts a dual-branch architecture, where one branch analyzes RGB frames to detect appearance-level artifacts, while the other processes flow residuals to reveal subtle motion anomalies caused by imperfect temporal synthesis. By integrating these complementary features, the proposed method effectively detects a wide range of forged videos. Extensive experiments on text-to-video and image-to-video tasks across ten diverse generative models demonstrate the robustness and strong generalization ability of the proposed approach.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 24 of its 28 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
24 of 28 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
12 more
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
- 2019Video Instance Segmentationcited by 393
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 87
- 2024Distinguish Any Fake Videos: Unleashing the Power of Large-scale Data and Motion Featurescited by 21
- 2024Turns Out I'm Not Real: Towards Robust Detection of AI-Generated Videoscited by 21
- 2024How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approachcited by 16
- 2024Exposing Lip-syncing Deepfakes from Mouth Inconsistenciescited by 15
- 2024Exposing AI-generated Videos: A Benchmark Dataset and a Local-and-Global Temporal Defect Based Detection Methodcited by 9
- 2025Detecting Lip-Syncing Deepfakes: Vision Temporal Transformer for Analyzing Mouth Inconsistenciescited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026TRACE: Trajectory Representation and Consistency Estimation for AI-Generated Video Detection
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning
- 2026CoCoVideo: The High-Quality Commercial-Model-Based Contrastive Benchmark for AI-Generated Video Detection
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos
- 2026Towards multi-modal forgery representation learning for AI-generated video detection and localization
- 2024On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detection
- 2025AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequences
- 2025LDR-Net: A Novel Framework for AI-generated Image Detection via Localized Discrepancy Representation