A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Self-supervised learning (SSL) has transformed speech processing, with benchmarks such as SUPERB establishing fair comparisons across diverse downstream tasks. Despite it's security-critical importance, Audio deepfake detection has remained outside these efforts. In this work, we introduce Spoof-SUPERB, a benchmark for audio deepfake detection that systematically evaluates 20 SSL models spanning generative, discriminative, and spectrogram-based architectures. We evaluated these models on multiple in-domain and out-of-domain datasets. Our results reveal that large-scale discriminative models such as XLS-R, UniSpeech-SAT, and WavLM Large consistently outperform other models, benefiting from multilingual pretraining, speaker-aware objectives, and model scale. We further analyze the robustness of these models under acoustic degradations, showing that generative approaches degrade sharply, while discriminative models remain resilient. This benchmark establishes a reproducible baseline and provides practical insights into which SSL representations are most reliable for securing speech systems against audio deepfakes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 66 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
54 of 66 references.
References · 54
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
- 2022High Fidelity Neural Audio Compressioncited by 673
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 353
- 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 233
- 2019Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoderscited by 196
- 2020TERA: Self-Supervised Learning of Transformer Encoder Representation for Speechcited by 186
38 more
- 2019An Unsupervised Autoregressive Model for Speech Representation Learningcited by 185
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
- 2021SSAST: Self-Supervised Audio Spectrogram Transformercited by 166
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 157
- 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 149
- 2023StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Modelscited by 148
- 2023Matcha-TTS: A fast TTS architecture with conditional flow matchingcited by 142
- 2022Does Audio Deepfake Detection Generalize?cited by 129
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 110
- 2020Unsupervised pretraining transfers well across languagescited by 100
- 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
- 2022MAE-AST: Masked Autoencoding Audio Spectrogram Transformercited by 82
- 2020DeCoAR 2.0: Deep Contextualized Acoustic Representations with Vector Quantizationcited by 77
- 2022SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilitiescited by 76
- 2023ML-SUPERB: Multilingual Speech Universal PERformance Benchmarkcited by 70
- 2020Vector-Quantized Autoregressive Predictive Codingcited by 69
- 2019Deep Contextualized Acoustic Representations For Semi-Supervised Speech Recognitioncited by 66
- 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 64
- 2021ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speechcited by 56
- 2024MLAAD: The Multi-Language Audio Anti-Spoofing Datasetcited by 55
- 2020Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependenciescited by 47
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
- 2021UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Trainingcited by 43
- 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 40
- 2024A Large-Scale Evaluation of Speech Foundation Modelscited by 38
- 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audiocited by 31
- 2024XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detectioncited by 27
- 2023Towards generalisable and calibrated synthetic speech detection with self-supervised representationscited by 23
- 2024SpoofCeleb: Speech Deepfake Detection and SASV In The Wildcited by 22
- 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Datasetcited by 20
- 2024Leveraging Mixture of Experts for Improved Speech Deepfake Detectioncited by 14
- 2024WavLM model ensemble for audio deepfake detectioncited by 12
- 2024Exploring WavLM Back-ends for Speech Spoofing and Deepfake Detectioncited by 10
- 2024BUT Systems and Analyses for the ASVspoof 5 Challengecited by 9
- 2023MiniSUPERB: Lightweight Benchmark for Self-supervised Speech Modelscited by 8
- 2024USTC-KXDIGIT System Description for ASVspoof5 Challengecited by 7
- 2021Beijing ZKJ-NPU Speaker Verification System for VoxCeleb Speaker Recognition Challenge 2021cited by 5
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.