mlsanityData to 14 Oct 2026

Weakly-supervised Audio Temporal Forgery Localization via Progressive Audio-language Co-learning Network

arXiv 2505.01880 ↗First posted 3 May 2025cs.SD cs.CV cs.MMcited by 6

Not on the map. Why?

Abstract (arXiv)

Audio temporal forgery localization (ATFL) aims to find the precise forgery regions of the partial spoof audio that is purposefully modified. Existing ATFL methods rely on training efficient networks using fine-grained annotations, which are obtained costly and challenging in real-world scenarios. To meet this challenge, in this paper, we propose a progressive audio-language co-learning network (LOCO) that adopts co-learning and self-supervision manners to prompt localization performance under weak supervision scenarios. Specifically, an audio-language co-learning module is first designed to capture forgery consensus features by aligning semantics from temporal and global perspectives. In this module, forgery-aware prompts are constructed by using utterance-level annotations together with learnable prompts, which can incorporate semantic priors into temporal content features dynamically. In addition, a forgery localization module is applied to produce forgery proposals based on fused forgery-class activation sequences. Finally, a progressive refinement strategy is introduced to generate pseudo frame-level labels and leverage supervised semantic contrastive learning to amplify the semantic distinction between real and fake content, thereby continuously optimizing forgery-aware features. Extensive experiments show that the proposed LOCO achieves SOTA performance on three public benchmarks.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 3 May 2025.

Builds on

23 of 29 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  3. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
  4. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
  5. 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 152
  6. 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
  7. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
  8. 2021CoLA: Weakly-Supervised Temporal Action Localization with Snippet Contrastive Learningcited by 69
  9. 2021A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detectioncited by 56
  10. 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
  11. 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
  12. 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
11 more
  1. 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 43
  2. 2023Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detectioncited by 43
  3. 2023UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localizationcited by 33
  4. 2023Pixel-Inconsistency Modeling for Image Manipulation Localizationcited by 33
  5. 2024MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Samplingcited by 28
  6. 2024GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesiscited by 21
  7. 2023Proposal-Based Multiple Instance Learning for Weakly-Supervised Temporal Action Localizationcited by 20
  8. 2023An Efficient Temporary Deepfake Location Approach Based Embeddings for Partially Spoofed Audio Detectioncited by 10
  9. 2024Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localizationcited by 9
  10. 2023Revisiting Foreground and Background Separation in Weakly-supervised Temporal Action Localization: A Clustering-based Approachcited by 8
  11. 2024Full-Stage Pseudo Label Quality Enhancement for Weakly-supervised Temporal Action Localizationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.