mlsanityData to 14 Oct 2026

PIVOT: Physics-Grounded Verification for AI-Generated Audio-Video Detection

arXiv 2609.15562 ↗First posted 14 Sep 2026cs.CV cs.AI cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

As generative models continue to advance, AI-generated content (AIGC) is becoming increasingly realistic, weakening the artifact cues commonly exploited by existing detectors. Nevertheless, faithfully reproducing the physical behavior of real-world events remains challenging for current generators. We therefore explore detecting AIGC by assessing whether the depicted event satisfies measurable constraints derived from physical laws. We introduce PIVOT, a physics-grounded AIGC detector, instantiated here for audio-video clips, that estimates physical quantities from video and audio, selects physical laws relevant to each clip, and verifies their measurable constraints. Beyond a real/fake decision, PIVOT returns supporting evidence that records the verification outcome, relevant time window, and supporting quantities for each applicable law. Although instantiated and evaluated here on audio-video data, the framework can, in principle, extend to other AIGC modalities whenever the physical quantities required for verification can be estimated reliably. We also introduce PhysForensics-Bench, comprising paired real and generated audio-video clips from nine event-centric scene families and two recent audio-video generators. On PhysForensics-Bench, PIVOT achieves 70.30% accuracy and 64.29% F1 score on Real+Seedance, and 72.16% accuracy and 65.82% F1 on Real+VEO. In comparison, direct inspection with Gemini 3.1 Pro obtains 53.96% accuracy and 60.09% F1 on Real+Seedance, and 57.22% accuracy and 63.44% F1 on Real+Veo. These results demonstrate the practical promise of physical-consistency verification as a structured and inspectable source of evidence that complements artifact-based AIGC detection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 60 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

49 of 60 references.

References · 49

  1. 2023Segment Anythingcited by 8,234
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  7. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  8. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  9. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  10. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  11. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  12. 2017Look, Listen and Learncited by 458
37 more
  1. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  2. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  3. 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
  4. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  5. 2018Audio-Visual Scene Analysis with Self-Supervised Multisensory Featurescited by 335
  6. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  7. 2020The Creation and Detection of Deepfakes: A Surveycited by 247
  8. 2023Track Anything: Segment Anything Meets Videoscited by 234
  9. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  10. 2020Media Forensics and DeepFakes: an overviewcited by 209
  11. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
  12. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  13. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  14. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
  15. 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 148
  16. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  17. 2015Visually Indicated Soundscited by 128
  18. 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 122
  19. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  20. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
  21. 2021The Benefit Of Temporally-Strong Labels In Audio Event Classificationcited by 83
  22. 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
  23. 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 43
  24. 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
  25. 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 34
  26. 2025Physics-Driven Spatiotemporal Modeling for AI-Generated Video Detectioncited by 27
  27. 2015Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Imagescited by 26
  28. 2024Detecting AI-Generated Video via Frame Consistencycited by 26
  29. 2025GenVidBench: A 6-Million Benchmark for AI-Generated Video Detectioncited by 25
  30. 2024Effective Pre-Training of Audio Transformers for Sound Event Detectioncited by 12
  31. 2025PhyAVBench: A Challenging Audio Physics-Sensitivity Benchmark for Physically Grounded Text-to-Audio-Video Generationcited by 11
  32. 2026Do Joint Audio-Video Generation Models Understand Physics?cited by 8
  33. 2024Detecting Audio-Visual Deepfakes with Fine-Grained Inconsistenciescited by 7
  34. 2025Audio-Visual Deepfake Detection With Local Temporal Inconsistenciescited by 4
  35. 2025DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detectioncited by 3
  36. 2026SAVe: Self-Supervised Audio-visual Deepfake Detection Exploiting Visual Artifacts and Audio-visual Misalignmentcited by 1
  37. 2026Generalizing Video DeepFake Detection by Self-generated Audio-Visual Pseudo-Fakescited by 1

Built on by

Not cited yet.