Weakly-supervised Audio Temporal Forgery Localization via Progressive Audio-language Co-learning Network
Not on the map. Why?
Abstract (arXiv)
Audio temporal forgery localization (ATFL) aims to find the precise forgery regions of the partial spoof audio that is purposefully modified. Existing ATFL methods rely on training efficient networks using fine-grained annotations, which are obtained costly and challenging in real-world scenarios. To meet this challenge, in this paper, we propose a progressive audio-language co-learning network (LOCO) that adopts co-learning and self-supervision manners to prompt localization performance under weak supervision scenarios. Specifically, an audio-language co-learning module is first designed to capture forgery consensus features by aligning semantics from temporal and global perspectives. In this module, forgery-aware prompts are constructed by using utterance-level annotations together with learnable prompts, which can incorporate semantic priors into temporal content features dynamically. In addition, a forgery localization module is applied to produce forgery proposals based on fused forgery-class activation sequences. Finally, a progressive refinement strategy is introduced to generate pseudo frame-level labels and leverage supervised semantic contrastive learning to amplify the semantic distinction between real and fake content, thereby continuously optimizing forgery-aware features. Extensive experiments show that the proposed LOCO achieves SOTA performance on three public benchmarks.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 3 May 2025.
Builds on
23 of 29 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 152
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2021CoLA: Weakly-Supervised Temporal Action Localization with Snippet Contrastive Learningcited by 69
- 2021A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detectioncited by 56
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
- 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
11 more
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 43
- 2023Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detectioncited by 43
- 2023UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localizationcited by 33
- 2023Pixel-Inconsistency Modeling for Image Manipulation Localizationcited by 33
- 2024MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Samplingcited by 28
- 2024GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesiscited by 21
- 2023Proposal-Based Multiple Instance Learning for Weakly-Supervised Temporal Action Localizationcited by 20
- 2023An Efficient Temporary Deepfake Location Approach Based Embeddings for Partially Spoofed Audio Detectioncited by 10
- 2024Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localizationcited by 9
- 2023Revisiting Foreground and Background Separation in Weakly-supervised Temporal Action Localization: A Clustering-based Approachcited by 8
- 2024Full-Stage Pseudo Label Quality Enhancement for Weakly-supervised Temporal Action Localizationcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025A Multimodal Deviation Perceiving Framework for Weakly-Supervised Temporal Forgery Localizationcited by 8
- 2025Weakly-Supervised Image Forgery Localization via Vision-Language Collaborative Reasoning Frameworkcited by 4
- 2025Weakly Supervised Multimodal Temporal Forgery Localization via Multitask Learningcited by 3
- 2026Safeguarding Facial Identity against Diffusion-based Face Swapping via Cascading Pathway Disruptioncited by 1
- 2026CIEC: Coupling Implicit and Explicit Cues for Multimodal Weakly Supervised Manipulation Localizationcited by 1
- 2026GEM-TFL: Bridging Weak and Full Supervision for Forgery Localization through EM-Guided Decomposition and Temporal Refinementcited by 0
- 2026GEM-TFL: Bridging Weak and Full Supervision for Forgery Localization through EM-Guided Decomposition and Temporal Refinement5 Mar 2026
- 2026CIEC: Coupling Implicit and Explicit Cues for Multimodal Weakly Supervised Manipulation Localization2 Feb 2026
- 2026Safeguarding Facial Identity against Diffusion-based Face Swapping via Cascading Pathway Disruption21 Jan 2026
- 2025Weakly Supervised Multimodal Temporal Forgery Localization via Multitask Learning4 Aug 2025
- 2025Weakly-Supervised Image Forgery Localization via Vision-Language Collaborative Reasoning Framework2 Aug 2025
- 2025A Multimodal Deviation Perceiving Framework for Weakly-Supervised Temporal Forgery Localization22 Jul 2025