Temporal Variability and Multi-Viewed Self-Supervised Representations to Tackle the ASVspoof5 Deepfake Challenge
Not on the map. Why?
Abstract (arXiv)
ASVspoof5, the fifth edition of the ASVspoof series, is one of the largest global audio security challenges. It aims to advance the development of countermeasure (CM) to discriminate bonafide and spoofed speech utterances. In this paper, we focus on addressing the problem of open-domain audio deepfake detection, which corresponds directly to the ASVspoof5 Track1 open condition. At first, we comprehensively investigate various CM on ASVspoof5, including data expansion, data augmentation, and self-supervised learning (SSL) features. Due to the high-frequency gaps characteristic of the ASVspoof5 dataset, we introduce Frequency Mask, a data augmentation method that masks specific frequency bands to improve CM robustness. Combining various scale of temporal information with multiple SSL features, our experiments achieved a minDCF of 0.0158 and an EER of 0.55% on the ASVspoof 5 Track 1 evaluation progress set.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 13 Aug 2024.
Builds on
23 of 33 references.
References · 23
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2015MUSAN: A Music, Speech, and Noise Corpuscited by 425
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
- 2024VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizerscited by 122
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
- 2024MLAAD: The Multi-Language Audio Anti-Spoofing Datasetcited by 56
- 2021UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Trainingcited by 45
11 more
- 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audiocited by 31
- 2023Rethinking the Evaluation Protocol of Domain Generalizationcited by 20
- 2023Can large-scale vocoded spoofed data improve speech spoofing countermeasure with a self-supervised front end?cited by 17
- 2023The Impact of Silence on Speech Anti-Spoofingcited by 13
- 2022Representation Selective Self-distillation and wav2vec 2.0 Feature Exploration for Spoof-aware Speaker Verificationcited by 11
- 2024SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detectioncited by 8
- 2022Explainable deepfake and spoofing detection: an attack analysis using SHapley Additive exPlanationscited by 5
- 2024Generalized Fake Audio Detection via Deep Stable Learningcited by 5
- 2024Genuine-Focused Learning using Mask AutoEncoder for Generalized Fake Audio Detectioncited by 5
- 2024Experimental Study: Enhancing Voice Spoofing Detection Models with wav2vec 2.0cited by 4
- 2022Low Pass Filtering and Bandwidth Extension for Robust Anti-spoofing Countermeasure Against Codec Variabilitiescited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.