mlsanityData to 14 Oct 2026

Mind the Rift: Cross-Scale Coupling Mismatch for AI-Generated Video Detection

arXiv 2609.00742 ↗First posted 1 Sep 2026cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

As AI video generators achieve cinematic realism, reliable detection becomes essential for safeguarding digital trust. We identify cross-scale coupling mismatch as a new forensic signal, where scale refers to the level of abstraction (semantic dynamics vs. pixel-level residuals): in natural videos, macro-level temporal dynamics and micro-level residual patterns are intrinsically coupled by the unified imaging physics pipeline, whereas AI generators, whose training objectives do not explicitly preserve this joint distribution, systematically violate this coupling. Detecting such mismatch is challenging because it requires independently extracting information at both scales while simultaneously quantifying their cross-scale relationship. We propose RIFT (Representation Inconsistency Forensics on Trajectories), an orthogonal forensic framework that addresses this through three interlocking components: a macro stream that builds a dynamic baseline of expected temporal evolution via differential geometry and persistent homology on learned manifold trajectories, a micro stream that acts as a sensitive forensic probe via steganalytic filtering and temporal modeling, and a coupling divergence module that measures the conditional dependency between the two streams. Gram-Schmidt orthogonality guarantees the information-theoretic validity of this measurement. Experiments on two benchmarks (VidProM, 120K videos, 7 generators; GenVidBench, 68K videos, 4 generators) demonstrate that RIFT achieves 99.33% and 99.72% F1-score respectively, with 97.87% unseen-generator detection rate in leave-one-out evaluation, while exhibiting encoder agnosticism: scaling from ViT-S/14 (22M) to ViT-L/14 (300M) changes F1 by less than 0.1%, and switching to a different encoder family (DINOv1) reduces F1 by only 0.73 pp. Code is available at https://github.com/Litsay/RIFT

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 42 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

20 of 42 references.

References · 20

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  6. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  7. 2018MINE: Mutual Information Neural Estimationcited by 683
  8. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  9. 2023ModelScope Text-to-Video Technical Reportcited by 658
  10. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  11. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  12. 2017Latent Space Oddity: on the Curvature of Deep Generative Modelscited by 174
8 more
  1. 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
  2. 2023Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detectioncited by 41
  3. 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 34
  4. 2023Locate and Verify: A Two-Stream Network for Improved Deepfake Detectioncited by 26
  5. 2024Detecting AI-Generated Video via Frame Consistencycited by 26
  6. 2024Frequency Masking for Universal Deepfake Detectioncited by 23
  7. 2025Brought a Gun to a Knife Fight: Modern VFM Baselines Outgun Specialized Detectors on In-the-Wild AI Image Detectioncited by 10
  8. 2026MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuationscited by 2

Built on by

Not cited yet.