Partially Fake Audio Detection by Self-attention-based Fake Span Discovery
Not on the map. Why?
Abstract (arXiv)
The past few years have witnessed the significant advances of speech synthesis and voice conversion technologies. However, such technologies can undermine the robustness of broadly implemented biometric identification models and can be harnessed by in-the-wild attackers for illegal uses. The ASVspoof challenge mainly focuses on synthesized audios by advanced speech synthesis and voice conversion models, and replay attacks. Recently, the first Audio Deep Synthesis Detection challenge (ADD 2022) extends the attack scenarios into more aspects. Also ADD 2022 is the first challenge to propose the partially fake audio detection task. Such brand new attacks are dangerous and how to tackle such attacks remains an open question. Thus, we propose a novel framework by introducing the question-answering (fake span discovery) strategy with the self-attention mechanism to detect partially fake audios. The proposed fake span detection module tasks the anti-spoofing model to predict the start and end positions of the fake clip within the partially fake audio, address the model's attention into discovering the fake spans rather than other shortcuts with less generalization, and finally equips the model with the discrimination capacity between real and partially fake audios. Our submission ranked second in the partially fake audio detection track of ADD 2022.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 21 of its 38 references that are in the map. First posted on arXiv 14 Feb 2022.
Builds on
21 of 38 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2015MUSAN: A Music, Speech, and Noise Corpuscited by 425
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
- 2018Speaker Recognition from Raw Waveform with SincNetcited by 166
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
- 2018Attentive Statistics Pooling for Deep Speaker Embeddingcited by 114
- 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
- 2021A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detectioncited by 56
- 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
- 2020Replay and Synthetic Speech Detection with Res2net Architecturecited by 39
9 more
- 2021Continual Learning for Fake Audio Detectioncited by 27
- 2019ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworkscited by 23
- 2019Adversarial Attacks on Spoofing Countermeasures of automatic speaker verificationcited by 23
- 2020Defense against adversarial attacks on spoofing countermeasures of ASVcited by 20
- 2021Channel-wise Gated Res2Net: Towards Robust Detection of Synthetic Speech Attackscited by 18
- 2021Adversarial defense for automatic speaker verification by cascaded self-supervised learning modelscited by 16
- 2021Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learningcited by 16
- 2020Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learningcited by 12
- 2021Voting for the right answer: Adversarial defense for speaker verificationcited by 12
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 6; 2025: 2; 2026: 1.
14 papers.
Sort:
- 2024How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?cited by 10
- 2023The defender's perspective on automatic speaker verification: An overviewcited by 9
- 2024Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanismcited by 9
- 2024How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and Human Perceptioncited by 5
- 2024Spoof Diarization: "What Spoofed When" in Partially Spoofed Audiocited by 3
- 2025Pindrop it! Audio and Visual Deepfake Countermeasures for Robust Detection and Fine Grained-Localizationcited by 3
- 2022Spoofing-Aware Speaker Verification by Multi-Level Fusioncited by 2
- 2022Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verificationcited by 2
- 2022Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusioncited by 1
- 2024The Tug-of-War Between Deepfake Generation and Detectioncited by 1
- 2023TranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detectioncited by 0
- 2024An Unsupervised Domain Adaptation Method for Locating Manipulated Region in partially fake Audiocited by 0
- 2026Robust Spoofed Speech Detection via Temporal Pyramid Modeling15 Jun 2026
- 20253-Tracer: A Tri-level Temporal-Aware Framework for Audio Forgery Detection and Localization26 Nov 2025
- 2025Pindrop it! Audio and Visual Deepfake Countermeasures for Robust Detection and Fine Grained-Localization11 Aug 2025
- 2024How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and Human Perception14 Nov 2024
- 2024Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanism31 Jul 2024
- 2024An Unsupervised Domain Adaptation Method for Locating Manipulated Region in partially fake Audio11 Jul 2024
- 2024The Tug-of-War Between Deepfake Generation and Detection8 Jul 2024
- 2024Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio12 Jun 2024
- 2024How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?4 Jun 2024
- 2023TranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detection27 Jun 2023
- 2023The defender's perspective on automatic speaker verification: An overview22 May 2023
- 2022Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion18 Jun 2022
- 2024How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?cited by 10
- 2023The defender's perspective on automatic speaker verification: An overviewcited by 9
- 2024Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanismcited by 9
- 2024How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and Human Perceptioncited by 5
- 2024Spoof Diarization: "What Spoofed When" in Partially Spoofed Audiocited by 3
- 2025Pindrop it! Audio and Visual Deepfake Countermeasures for Robust Detection and Fine Grained-Localizationcited by 3
- 2022Spoofing-Aware Speaker Verification by Multi-Level Fusioncited by 2
- 2022Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verificationcited by 2
- 2022Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusioncited by 1
- 2024The Tug-of-War Between Deepfake Generation and Detectioncited by 1
- 2023TranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detectioncited by 0
- 2024An Unsupervised Domain Adaptation Method for Locating Manipulated Region in partially fake Audiocited by 0
12 most cited of 14 All 14 (JSON)
- 2026Robust Spoofed Speech Detection via Temporal Pyramid Modeling15 Jun 2026
- 20253-Tracer: A Tri-level Temporal-Aware Framework for Audio Forgery Detection and Localization26 Nov 2025
- 2025Pindrop it! Audio and Visual Deepfake Countermeasures for Robust Detection and Fine Grained-Localization11 Aug 2025
- 2024How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and Human Perception14 Nov 2024
- 2024Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanism31 Jul 2024
- 2024An Unsupervised Domain Adaptation Method for Locating Manipulated Region in partially fake Audio11 Jul 2024
- 2024The Tug-of-War Between Deepfake Generation and Detection8 Jul 2024
- 2024Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio12 Jun 2024
- 2024How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?4 Jun 2024
- 2023TranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detection27 Jun 2023
- 2023The defender's perspective on automatic speaker verification: An overview22 May 2023
- 2022Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion18 Jun 2022
12 newest of 14 All 14 (JSON)