How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?
Not on the map. Why?
Abstract (arXiv)
Partially manipulating a sentence can greatly change its meaning. Recent work shows that countermeasures (CMs) trained on partially spoofed audio can effectively detect such spoofing. However, the current understanding of the decision-making process of CMs is limited. We utilize Grad-CAM and introduce a quantitative analysis metric to interpret CMs' decisions. We find that CMs prioritize the artifacts of transition regions created when concatenating bona fide and spoofed audio. This focus differs from that of CMs trained on fully spoofed audio, which concentrate on the pattern differences between bona fide and spoofed parts. Our further investigation explains the varying nature of CMs' focus while making correct or incorrect predictions. These insights provide a basis for the design of CM models and the creation of datasets. Moreover, this work lays a foundation of interpretability in the field of partial spoofed audio detection that has not been well explored previously.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 4 Jun 2024.
Builds on
32 of 38 references.
References · 32
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
- 2021Pay Attention to MLPscited by 368
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 96
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 61
- 2021A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detectioncited by 56
20 more
- 2024MLAAD: The Multi-Language Audio Anti-Spoofing Datasetcited by 56
- 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
- 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
- 2021Speech is Silver, Silence is Golden: What do ASVspoof-trained Models Really Learn?cited by 37
- 2022The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challengecited by 35
- 2023Improved DeepFake Detection Using Whisper Featurescited by 29
- 2021An Initial Investigation for Detecting Partially Spoofed Audiocited by 27
- 2020The Attacker's Perspective on Automatic Speaker Verification: An Overviewcited by 19
- 2022Waveform Boundary Detection for Partially Spoofed Audiocited by 15
- 2022Partially Fake Audio Detection by Self-attention-based Fake Span Discoverycited by 14
- 2020An explainability study of the constant Q cepstral coefficient spoofing countermeasure for automatic speaker verificationcited by 13
- 2021Explaining deep learning models for spoofing and deepfake detection with SHapley Additive exPlanationscited by 13
- 2023The Impact of Silence on Speech Anti-Spoofingcited by 13
- 2023Disentangling Voice and Content with Self-Supervision for Speaker Recognitioncited by 13
- 2022MFA: TDNN with Multi-scale Frequency-channel Attention for Text-independent Speaker Verification with Short Utterancescited by 12
- 2023Golden Gemini is All You Need: Finding the Sweet Spots for Speaker Verificationcited by 8
- 2022Explainable deepfake and spoofing detection: an attack analysis using SHapley Additive exPlanationscited by 5
- 2024Listening Between the Lines: Synthetic Speech Detection Disregarding Verbal Contentcited by 4
- 2023Phase perturbation improves channel robustness for speech spoofing countermeasurescited by 2
- 2024How phonemes contribute to deep speaker models?cited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 1.
10 papers.
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 19
- 2024Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 2024cited by 7
- 2024Towards Quantifying and Reducing Language Mismatch Effects in Cross-Lingual Speech Anti-Spoofingcited by 7
- 2024Analyzing the Impact of Splicing Artifacts in Partially Fake Speech Signalscited by 4
- 2025What Does an Audio Deepfake Detector Focus on? A Study in the Time Domaincited by 4
- 2025A Data-Driven Diffusion-based Approach for Audio Deepfake Explanationscited by 2
- 2025Localizing Audio-Visual Deepfakes via Hierarchical Boundary Modelingcited by 2
- 2025Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detectioncited by 2
- 2026SNAP: Speaker Nulling for Artifact Projection in Speech Deepfake Detectioncited by 0
- 2026SNAP: Speaker Nulling for Artifact Projection in Speech Deepfake Detection21 Mar 2026
- 2025Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detection25 Sep 2025
- 2025Localizing Audio-Visual Deepfakes via Hierarchical Boundary Modeling4 Aug 2025
- 2025A Data-Driven Diffusion-based Approach for Audio Deepfake Explanations3 Jun 2025
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing8 Apr 2025
- 2025What Does an Audio Deepfake Detector Focus on? A Study in the Time Domain23 Jan 2025
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models13 Oct 2024
- 2024Towards Quantifying and Reducing Language Mismatch Effects in Cross-Lingual Speech Anti-Spoofing12 Sep 2024
- 2024Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 20243 Sep 2024
- 2024Analyzing the Impact of Splicing Artifacts in Partially Fake Speech Signals25 Aug 2024