mlsanityData to 7 Oct 2026

AuViRe: Audio-visual Speech Representation Reconstruction for Deepfake Temporal Localization

arXiv 2511.18993 ↗First posted 24 Nov 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

With the rapid advancement of sophisticated synthetic audio-visual content, e.g., for subtle malicious manipulations, ensuring the integrity of digital media has become paramount. This work presents a novel approach to temporal localization of deepfakes by leveraging Audio-Visual Speech Representation Reconstruction (AuViRe). Specifically, our approach reconstructs speech representations from one modality (e.g., lip movements) based on the other (e.g., audio waveform). Cross-modal reconstruction is significantly more challenging in manipulated video segments, leading to amplified discrepancies, thereby providing robust discriminative cues for precise temporal forgery localization. AuViRe outperforms the state of the art by +8.9 [email protected] on LAV-DF, +9.6 [email protected] on AV-Deepfake1M, and +5.1 AUC on an in-the-wild experiment. Code available at https://github.com/mever-team/auvire.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

34 of 43 references.

References · 34

  1. 2016Layer Normalizationcited by 5,579
  2. 2015Fast R-CNNcited by 2,930
  3. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  4. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  5. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  6. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  7. 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
  8. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
  9. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  10. 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
  11. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  12. 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 380
22 more
  1. 2022Detecting Deepfakes with Self-Blended Imagescited by 332
  2. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
  3. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
  4. 2022Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Predictioncited by 277
  5. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  6. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  7. 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
  8. 2022Visual Speech Recognition for Multiple Languages in the Wildcited by 94
  9. 2020Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localizationcited by 89
  10. 2021Combining EfficientNet and Vision Transformers for Video Deepfake Detectioncited by 81
  11. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 79
  12. 2024Exploiting Style Latent Flows for Generalizing Deepfake Video Detectioncited by 58
  13. 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 57
  14. 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
  15. 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 42
  16. 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 37
  17. 2023UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localizationcited by 33
  18. 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 30
  19. 2023Locate and Verify: A Two-Stream Network for Improved Deepfake Detectioncited by 26
  20. 2021Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localizationcited by 21
  21. 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasingcited by 14
  22. 2024DiMoDif: Discourse Modality-information Differentiation for Audio-visual Deepfake Detection and Localizationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026Word-Anchored Temporal Forgery Localizationcited by 0
  2. 2026AViS-Mamba: Adaptive Visual Steering of Audio State-Space Dynamics for Violence Detectioncited by 0
  3. 2026Foundation Models are Implicit Deepfake Detectorscited by 0