3-Tracer: A Tri-level Temporal-Aware Framework for Audio Forgery Detection and Localization
Not on the map. Why?
Abstract (arXiv)
Recently, partial audio forgery has emerged as a new form of audio manipulation. Attackers selectively modify partial but semantically critical frames while preserving the overall perceptual authenticity, making such forgeries particularly difficult to detect. Existing methods focus on independently detecting whether a single frame is forged, lacking the hierarchical structure to capture both transient and sustained anomalies across different temporal levels. To address these limitations, We identify three key levels relevant to partial audio forgery detection and present T3-Tracer, the first framework that jointly analyzes audio at the frame, segment, and audio levels to comprehensively detect forgery traces. T3-Tracer consists of two complementary core modules: the Frame-Audio Feature Aggregation Module (FA-FAM) and the Segment-level Multi-Scale Discrepancy-Aware Module (SMDAM). FA-FAM is designed to detect the authenticity of each audio frame. It combines both frame-level and audio-level temporal information to detect intra-frame forgery cues and global semantic inconsistencies. To further refine and correct frame detection, we introduce SMDAM to detect forgery boundaries at the segment level. It adopts a dual-branch architecture that jointly models frame features and inter-frame differences across multi-scale temporal windows, effectively identifying abrupt anomalies that appeared on the forged boundaries. Extensive experiments conducted on three challenging datasets demonstrate that our approach achieves state-of-the-art performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
18 of 33 references.
References · 18
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
- 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 382
- 2020End-to-end anti-spoofing with RawNet2cited by 164
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 76
- 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 74
- 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
- 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
- 2023UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localizationcited by 33
- 2023Audio Deepfake Detection with Self-Supervised WavLM and Multi-Fusion Attentive Classifiercited by 27
- 2024Cross-Modality and Within-Modality Regularization for Audio-Visual DeepFake Detectioncited by 24
6 more
- 2022Waveform Boundary Detection for Partially Spoofed Audiocited by 15
- 2022Partially Fake Audio Detection by Self-attention-based Fake Span Discoverycited by 14
- 2024Dense Audio-Visual Event Localization under Cross-Modal Consistency and Multi-Temporal Granularity Collaborationcited by 12
- 2022Fully Automated End-to-End Fake Audio Detectioncited by 10
- 2023An Efficient Temporary Deepfake Location Approach Based Embeddings for Partially Spoofed Audio Detectioncited by 10
- 2023The defender's perspective on automatic speaker verification: An overviewcited by 9
Built on by
Not cited yet.