mlsanityData to 14 Oct 2026

Partially Fake Audio Detection by Self-attention-based Fake Span Discovery

arXiv 2202.06684 ↗First posted 14 Feb 2022eess.AS cs.LG cs.SDcited by 14

Not on the map. Why?

Abstract (arXiv)

The past few years have witnessed the significant advances of speech synthesis and voice conversion technologies. However, such technologies can undermine the robustness of broadly implemented biometric identification models and can be harnessed by in-the-wild attackers for illegal uses. The ASVspoof challenge mainly focuses on synthesized audios by advanced speech synthesis and voice conversion models, and replay attacks. Recently, the first Audio Deep Synthesis Detection challenge (ADD 2022) extends the attack scenarios into more aspects. Also ADD 2022 is the first challenge to propose the partially fake audio detection task. Such brand new attacks are dangerous and how to tackle such attacks remains an open question. Thus, we propose a novel framework by introducing the question-answering (fake span discovery) strategy with the self-attention mechanism to detect partially fake audios. The proposed fake span detection module tasks the anti-spoofing model to predict the start and end positions of the fake clip within the partially fake audio, address the model's attention into discovering the fake spans rather than other shortcuts with less generalization, and finally equips the model with the discrimination capacity between real and partially fake audios. Our submission ranked second in the partially fake audio detection track of ADD 2022.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 21 of its 38 references that are in the map. First posted on arXiv 14 Feb 2022.

Builds on

21 of 38 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2017Squeeze-and-Excitation Networkscited by 4,789
  4. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 425
  5. 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
  6. 2018Speaker Recognition from Raw Waveform with SincNetcited by 166
  7. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
  8. 2018Attentive Statistics Pooling for Deep Speaker Embeddingcited by 114
  9. 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
  10. 2021A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detectioncited by 56
  11. 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
  12. 2020Replay and Synthetic Speech Detection with Res2net Architecturecited by 39
9 more
  1. 2021Continual Learning for Fake Audio Detectioncited by 27
  2. 2019ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworkscited by 23
  3. 2019Adversarial Attacks on Spoofing Countermeasures of automatic speaker verificationcited by 23
  4. 2020Defense against adversarial attacks on spoofing countermeasures of ASVcited by 20
  5. 2021Channel-wise Gated Res2Net: Towards Robust Detection of Synthetic Speech Attackscited by 18
  6. 2021Adversarial defense for automatic speaker verification by cascaded self-supervised learning modelscited by 16
  7. 2021Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learningcited by 16
  8. 2020Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learningcited by 12
  9. 2021Voting for the right answer: Adversarial defense for speaker verificationcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 2; 2024: 6; 2025: 2; 2026: 1.

14 papers.

Sort: