PIVOT: Physics-Grounded Verification for AI-Generated Audio-Video Detection
Not on the map. Why?
Abstract (arXiv)
As generative models continue to advance, AI-generated content (AIGC) is becoming increasingly realistic, weakening the artifact cues commonly exploited by existing detectors. Nevertheless, faithfully reproducing the physical behavior of real-world events remains challenging for current generators. We therefore explore detecting AIGC by assessing whether the depicted event satisfies measurable constraints derived from physical laws. We introduce PIVOT, a physics-grounded AIGC detector, instantiated here for audio-video clips, that estimates physical quantities from video and audio, selects physical laws relevant to each clip, and verifies their measurable constraints. Beyond a real/fake decision, PIVOT returns supporting evidence that records the verification outcome, relevant time window, and supporting quantities for each applicable law. Although instantiated and evaluated here on audio-video data, the framework can, in principle, extend to other AIGC modalities whenever the physical quantities required for verification can be estimated reliably. We also introduce PhysForensics-Bench, comprising paired real and generated audio-video clips from nine event-centric scene families and two recent audio-video generators. On PhysForensics-Bench, PIVOT achieves 70.30% accuracy and 64.29% F1 score on Real+Seedance, and 72.16% accuracy and 65.82% F1 on Real+VEO. In comparison, direct inspection with Gemini 3.1 Pro obtains 53.96% accuracy and 60.09% F1 on Real+Seedance, and 57.22% accuracy and 63.44% F1 on Real+Veo. These results demonstrate the practical promise of physical-consistency verification as a structured and inspectable source of evidence that complements artifact-based AIGC detection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 60 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
49 of 60 references.
References · 49
- 2023Segment Anythingcited by 8,234
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2017Look, Listen and Learncited by 458
37 more
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2018Audio-Visual Scene Analysis with Self-Supervised Multisensory Featurescited by 335
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2020The Creation and Detection of Deepfakes: A Surveycited by 247
- 2023Track Anything: Segment Anything Meets Videoscited by 234
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2020Media Forensics and DeepFakes: an overviewcited by 209
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 148
- 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
- 2015Visually Indicated Soundscited by 128
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 122
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 2021The Benefit Of Temporally-Strong Labels In Audio Event Classificationcited by 83
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 43
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 34
- 2025Physics-Driven Spatiotemporal Modeling for AI-Generated Video Detectioncited by 27
- 2015Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Imagescited by 26
- 2024Detecting AI-Generated Video via Frame Consistencycited by 26
- 2025GenVidBench: A 6-Million Benchmark for AI-Generated Video Detectioncited by 25
- 2024Effective Pre-Training of Audio Transformers for Sound Event Detectioncited by 12
- 2025PhyAVBench: A Challenging Audio Physics-Sensitivity Benchmark for Physically Grounded Text-to-Audio-Video Generationcited by 11
- 2026Do Joint Audio-Video Generation Models Understand Physics?cited by 8
- 2024Detecting Audio-Visual Deepfakes with Fine-Grained Inconsistenciescited by 7
- 2025Audio-Visual Deepfake Detection With Local Temporal Inconsistenciescited by 4
- 2025DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detectioncited by 3
- 2026SAVe: Self-Supervised Audio-visual Deepfake Detection Exploiting Visual Artifacts and Audio-visual Misalignmentcited by 1
- 2026Generalizing Video DeepFake Detection by Self-generated Audio-Visual Pseudo-Fakescited by 1
Built on by
Not cited yet.