Physics-Aware Deepfake Detection via Distance-Speech Consistency
Not on the map. Why?
Abstract (arXiv)
Recent progress in generative models has made talking-head deepfakes highly realistic and easy to create, jeopardizing public trust. However, most audio-visual deepfake detectors rely on lip-speech synchronization and are designed for static, frontal videos, limiting their reliability in dynamic, in-the-wild recordings where the speaker moves and lip cues are degraded or missing. As an alternative, we propose a physics-aware detector for dynamic speaking videos that leverages an acoustic constraint: in real recordings, speech energy varies predictably with speaker-to-camera distance, whereas deepfake generation can break this coupling. Our method combines distance estimates from video with distance-dependent acoustic measures from speech to detect deepfakes. Experiments on in-the-wild benchmarks show that the proposed physical cue is effective in dynamic scenarios, and that it complements lip-sync-based detectors, with a simple ensemble achieving consistent gains across datasets. Codes are available at https://byulharang.github.io/PADD/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 33 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
21 of 33 references.
References · 21
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2022Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Predictioncited by 287
- 2025Video models are zero-shot learners and reasonerscited by 220
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
- 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 45
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 43
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 34
9 more
- 2022Revisiting Over-Smoothness in Text to Speechcited by 32
- 2025SAM Audio: Segment Anything in Audiocited by 30
- 2024Cross-Modality and Within-Modality Regularization for Audio-Visual DeepFake Detectioncited by 24
- 2025Vulnerability-Aware Spatio-Temporal Learning for Generalizable Deepfake Video Detectioncited by 9
- 2022Distance-Based Sound Separationcited by 8
- 2024Detecting Audio-Visual Deepfakes with Fine-Grained Inconsistenciescited by 7
- 2025SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detectioncited by 7
- 2025AuViRe: Audio-visual Speech Representation Reconstruction for Deepfake Temporal Localizationcited by 4
- 2024Zero-Shot Mono-to-Binaural Speech Synthesiscited by 1
Built on by
Not cited yet.