MG-RWKV: Multi-Grained Context-Aware RWKV for Temporal Forgery Localization
Not on the map. Why?
Abstract (arXiv)
Driven by Artificial Intelligence-Generated Content (AIGC), the authenticity of audio-visual content is facing severe challenges. Temporal Forgery Localization (TFL) aims to precisely identify manipulated segments within untrimmed sequences. However, existing methods are limited by CNNs' local receptive fields or Transformers' quadratic complexity, while emerging linear models often struggle to balance global authentic context compression with local abrupt forgery perception. To address this, we propose MG-RWKV, a multi-granularity framework that leverages the data-dependent state evolution of RWKV to achieve efficient full-sequence processing with O(T) complexity. Our framework features three core innovations: (1) a Bidirectional RWKV architecture that captures bidirectional temporal contexts without quadratic overhead; (2) a Multi-Granularity Mixture of Experts (MG-MoE) that performs dynamic routing over explicit temporal receptive fields, adaptively selecting granularities based on forgery duration to significantly enhance decision interpretability; and (3) Cross-Granularity Consistency (CGC), which aligns adjacent feature pyramid levels through hierarchical scale-wise pairing and spatial boundary-aware weighting, effectively reducing false positives in authentic regions. Extensive experiments on Lav-DF, TVIL, and Psynd datasets demonstrate that MG-RWKV achieves state-of-the-art performance with low computational cost.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 59 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
45 of 59 references.
References · 45
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2020Rethinking Attention with Performerscited by 1,584
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
- 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 380
- 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 327
- 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
33 more
- 2022Mega: Moving Average Equipped Gated Attentioncited by 178
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2017R-C3D: Region Convolutional 3D Network for Temporal Activity Detectioncited by 161
- 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 141
- 2025RWKV-7 "Goose" with Expressive Dynamic State Evolutioncited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2017Single Shot Temporal Action Detectioncited by 123
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2021BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representationcited by 106
- 2020Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localizationcited by 89
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 79
- 2021Activity Graph Transformer for Temporal Action Localizationcited by 48
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 42
- 2021DCAN: Improving Temporal Action Detection via Dual Context Aggregationcited by 36
- 2017Cascaded Boundary Regression for Temporal Action Detectioncited by 35
- 2023UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localizationcited by 33
- 2022Proposal-Free Temporal Action Detection via Global Segmentation Mask Learningcited by 29
- 2025IteRPrimE: Zero-shot Referring Image Segmentation with Iterative Grad-CAM Refinement and Primary Word Emphasiscited by 26
- 2021Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localizationcited by 21
- 2023Deepfakes, Misinformation, and Disinformation in the Era of Frontier AI, Generative AI, and Large AI Modelscited by 20
- 2024GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localizationcited by 19
- 2024DiMoDif: Discourse Modality-information Differentiation for Audio-visual Deepfake Detection and Localizationcited by 12
- 2026AdaMem: Adaptive User-Centric Memory for Long-Horizon Dialogue Agentscited by 11
- 2024Weakly Supervised Temporal Action Localization via Dual-Prior Collaborative Learning Guided by Multimodal Large Language Modelscited by 9
- 2025IMDPrompter: Adapting SAM to Image Manipulation Detection by Cross-View Automated Prompt Learningcited by 8
- 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunitiescited by 7
- 2025Rethinking Pseudo-Label Guided Learning for Weakly Supervised Temporal Action Localization from the Perspective of Noise Correctioncited by 7
- 2024Contextual Cross-Modal Attention for Audio-Visual Deepfake Detection and Localizationcited by 6
- 2026Learning Cross-View Object Correspondence via Cycle-Consistent Mask Predictioncited by 3
- 2025CLIP-AE: CLIP-assisted Cross-view Audio-Visual Enhancement for Unsupervised Temporal Action Localizationcited by 2
- 2026FCL-COD: Weakly Supervised Camouflaged Object Detection with Frequency-aware and Contrastive Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026UniSkip-Mamba: A Frequency-Aware State Space Model for Audio-Visual Temporal Forgery Localization
- 2026Towards multi-modal forgery representation learning for AI-generated video detection and localization
- 2025Weakly Supervised Multimodal Temporal Forgery Localization via Multitask Learning
- 2026DeformTrace: A Deformable State Space Model with Relay Tokens for Temporal Forgery Localization
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization
- 2025CLUE: Leveraging Low-Rank Adaptation to Capture Latent Uncovered Evidence for Image Forgery Localization
- 2026Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeries
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localization