EVAS: Efficient Multimodal Temporal Forgery Localization via Audio-Visual Synergy and Steered Boundary Calibration
Not on the map. Why?
Abstract (arXiv)
The rapid proliferation of artificial intelligence-generated content necessitates reliable multimodal forensics. Beyond video-level binary classification, precisely localizing sparsely distributed forged segments in long-form videos remains a critical challenge. This task is particularly difficult when manipulations are subtly embedded and cross-modal signals are weak and temporally diffuse. To address these challenges, we propose EVAS, an end-to-end multimodal framework for temporal forgery localization. At its core, a Multi-Stage Audio-Visual Synergy mechanism facilitates progressive cross-modal interaction to learn deep multimodal forensic representations and capture high-order semantic traces of sparse manipulations. Furthermore, we introduce a Boundary-Aware Refinement strategy to achieve steered boundary calibration. By incorporating invalid-frame masking, this strategy suppresses ambiguous regions and sharpens transition predictions. We adopt a decoupled training paradigm with auxiliary heads to disentangle representation learning from inference objectives, enhancing model generalization and stability. Additionally, a lightweight HourglassFFN is incorporated to reduce computational overhead. Extensive experiments demonstrate that EVAS achieves state-of-the-art average localization accuracy and average recall across three benchmark datasets, validating its effectiveness for fine-grained temporal forgery localization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 52 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
31 of 52 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2014Going Deeper with Convolutionscited by 4,231
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 327
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
19 more
- 2019G-TAD: Sub-Graph Localization for Temporal Action Detectioncited by 248
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 141
- 2021SOFT: Softmax-free Transformer with Linear Complexitycited by 128
- 2021BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representationcited by 106
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2020Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localizationcited by 89
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 79
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2019Detecting Photoshopped Faces by Scripting Photoshopcited by 55
- 2021Activity Graph Transformer for Temporal Action Localizationcited by 48
- 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Framescited by 47
- 2021DCAN: Improving Temporal Action Detection via Dual Context Aggregationcited by 36
- 2023UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localizationcited by 33
- 2021Deep Learning-based Action Detection in Untrimmed Videos: A Surveycited by 32
- 2025Zooming In on Fakes: A Novel Dataset for Localized AI-Generated Image Detection with Forgery Amplification Approachcited by 16
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Tracescited by 12
- 2025Bridge the Gap: From Weak to Full Supervision for Temporal Action Localization with PseudoFormercited by 5
- 2025Are Spatial-Temporal Graph Convolution Networks for Human Action Recognition Over-Parameterized?cited by 5
Built on by
Not cited yet.