mlsanityData to 7 Oct 2026

EVAS: Efficient Multimodal Temporal Forgery Localization via Audio-Visual Synergy and Steered Boundary Calibration

arXiv 2607.04472 ↗First posted 5 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The rapid proliferation of artificial intelligence-generated content necessitates reliable multimodal forensics. Beyond video-level binary classification, precisely localizing sparsely distributed forged segments in long-form videos remains a critical challenge. This task is particularly difficult when manipulations are subtly embedded and cross-modal signals are weak and temporally diffuse. To address these challenges, we propose EVAS, an end-to-end multimodal framework for temporal forgery localization. At its core, a Multi-Stage Audio-Visual Synergy mechanism facilitates progressive cross-modal interaction to learn deep multimodal forensic representations and capture high-order semantic traces of sparse manipulations. Furthermore, we introduce a Boundary-Aware Refinement strategy to achieve steered boundary calibration. By incorporating invalid-frame masking, this strategy suppresses ambiguous regions and sharpens transition predictions. We adopt a decoupled training paradigm with auxiliary heads to disentangle representation learning from inference objectives, enhancing model generalization and stability. Additionally, a lightweight HourglassFFN is incorporated to reduce computational overhead. Extensive experiments demonstrate that EVAS achieves state-of-the-art average localization accuracy and average recall across three benchmark datasets, validating its effectiveness for fine-grained temporal forgery localization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 52 references that are in the map. First posted on arXiv 5 Jul 2026.

Builds on

31 of 52 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2016Densely Connected Convolutional Networkscited by 6,691
  4. 2014Going Deeper with Convolutionscited by 4,231
  5. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  6. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
  7. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  8. 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
  9. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  10. 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 327
  11. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
  12. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
19 more
  1. 2019G-TAD: Sub-Graph Localization for Temporal Action Detectioncited by 248
  2. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  3. 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 141
  4. 2021SOFT: Softmax-free Transformer with Linear Complexitycited by 128
  5. 2021BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representationcited by 106
  6. 2021Local Relation Learning for Face Forgery Detectioncited by 100
  7. 2020Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localizationcited by 89
  8. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 79
  9. 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
  10. 2019Detecting Photoshopped Faces by Scripting Photoshopcited by 55
  11. 2021Activity Graph Transformer for Temporal Action Localizationcited by 48
  12. 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Framescited by 47
  13. 2021DCAN: Improving Temporal Action Detection via Dual Context Aggregationcited by 36
  14. 2023UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localizationcited by 33
  15. 2021Deep Learning-based Action Detection in Untrimmed Videos: A Surveycited by 32
  16. 2025Zooming In on Fakes: A Novel Dataset for Localized AI-Generated Image Detection with Forgery Amplification Approachcited by 16
  17. 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Tracescited by 12
  18. 2025Bridge the Gap: From Weak to Full Supervision for Temporal Action Localization with PseudoFormercited by 5
  19. 2025Are Spatial-Temporal Graph Convolution Networks for Human Action Recognition Over-Parameterized?cited by 5

Built on by

Not cited yet.