# Can large-scale vocoded spoofed data improve speech spoofing countermeasure with a self-supervised front end?

arXiv: https://arxiv.org/abs/2309.06014 · HTML: https://mlsanity.com/paper/2309.06014/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Sep 2023.

## Built on by (most cited first, 17 of 17)

- [Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024](https://mlsanity.com/paper/2503.02857/) (2025)
- [The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio](https://mlsanity.com/paper/2405.04880/) (2024)
- [SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection](https://mlsanity.com/paper/2407.18517/) (2024)
- [Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 2024](https://mlsanity.com/paper/2409.02302/) (2024)
- [Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio](https://mlsanity.com/paper/2406.08112/) (2024)
- [Learn from Real: Reality Defender's Submission to ASVspoof5 Challenge](https://mlsanity.com/paper/2410.07379/) (2024)
- [Improving Generalization for AI-Synthesized Voice Detection](https://mlsanity.com/paper/2412.19279/) (2024)
- [Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey](https://mlsanity.com/paper/2411.17911/) (2024)
- [What Does an Audio Deepfake Detector Focus on? A Study in the Time Domain](https://mlsanity.com/paper/2501.13887/) (2025)
- [Meta-Learning Approaches for Improving Detection of Unseen Speech Deepfakes](https://mlsanity.com/paper/2410.20578/) (2024)
- [AFSS: Artifact-Focused Self-Synthesis for Mitigating Bias in Audio Deepfake Detection](https://mlsanity.com/paper/2603.26856/) (2026)
- [Beyond Silence: Bias Analysis through Loss and Asymmetric Approach in Audio Anti-Spoofing](https://mlsanity.com/paper/2406.17246/) (2024)
- [A Data-Driven Diffusion-based Approach for Audio Deepfake Explanations](https://mlsanity.com/paper/2506.03425/) (2025)
- [Temporal Variability and Multi-Viewed Self-Supervised Representations to Tackle the ASVspoof5 Deepfake Challenge](https://mlsanity.com/paper/2408.06922/) (2024)
- [DeePen: Penetration Testing for Audio Deepfake Detection](https://mlsanity.com/paper/2502.20427/) (2025)
- [Alethia: A Foundational Encoder for Voice Deepfakes](https://mlsanity.com/paper/2605.00251/) (2026)
- [BEAT2AASIST model with layer fusion for ESDD 2026 Challenge](https://mlsanity.com/paper/2512.15180/) (2025)

## Abstract (arXiv)

A speech spoofing countermeasure (CM) that discriminates between unseen spoofed and bona fide data requires diverse training data. While many datasets use spoofed data generated by speech synthesis systems, it was recently found that data vocoded by neural vocoders were also effective as the spoofed training data. Since many neural vocoders are fast in building and generation, this study used multiple neural vocoders and created more than 9,000 hours of vocoded data on the basis of the VoxCeleb2 corpus. This study investigates how this large-scale vocoded data can improve spoofing countermeasures that use data-hungry self-supervised learning (SSL) models. Experiments demonstrated that the overall CM performance on multiple test sets improved when using features extracted by an SSL model continually trained on the vocoded data. Further improvement was observed when using a new SSL distilled from the two SSLs before and after the continual training. The CM with the distilled SSL outperformed the previous best model on challenging unseen test sets, including the ASVspoof 2019 logical access, WaveFake, and In-the-Wild.
