mlsanityData to 7 Oct 2026

A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detection

arXiv 2603.01482 ↗First posted 2 Mar 2026eess.AS cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised learning (SSL) has transformed speech processing, with benchmarks such as SUPERB establishing fair comparisons across diverse downstream tasks. Despite it's security-critical importance, Audio deepfake detection has remained outside these efforts. In this work, we introduce Spoof-SUPERB, a benchmark for audio deepfake detection that systematically evaluates 20 SSL models spanning generative, discriminative, and spectrogram-based architectures. We evaluated these models on multiple in-domain and out-of-domain datasets. Our results reveal that large-scale discriminative models such as XLS-R, UniSpeech-SAT, and WavLM Large consistently outperform other models, benefiting from multilingual pretraining, speaker-aware objectives, and model scale. We further analyze the robustness of these models under acoustic degradations, showing that generative approaches degrade sharply, while discriminative models remain resilient. This benchmark establishes a reproducible baseline and provides practical insights into which SSL representations are most reliable for securing speech systems against audio deepfakes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 66 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

54 of 66 references.

References · 54

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  3. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  4. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
  5. 2022High Fidelity Neural Audio Compressioncited by 673
  6. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
  7. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  8. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
  9. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 353
  10. 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 233
  11. 2019Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoderscited by 196
  12. 2020TERA: Self-Supervised Learning of Transformer Encoder Representation for Speechcited by 186
38 more
  1. 2019An Unsupervised Autoregressive Model for Speech Representation Learningcited by 185
  2. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
  3. 2021SSAST: Self-Supervised Audio Spectrogram Transformercited by 166
  4. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 157
  5. 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 149
  6. 2023StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Modelscited by 148
  7. 2023Matcha-TTS: A fast TTS architecture with conditional flow matchingcited by 142
  8. 2022Does Audio Deepfake Detection Generalize?cited by 129
  9. 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
  10. 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 110
  11. 2020Unsupervised pretraining transfers well across languagescited by 100
  12. 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
  13. 2022MAE-AST: Masked Autoencoding Audio Spectrogram Transformercited by 82
  14. 2020DeCoAR 2.0: Deep Contextualized Acoustic Representations with Vector Quantizationcited by 77
  15. 2022SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilitiescited by 76
  16. 2023ML-SUPERB: Multilingual Speech Universal PERformance Benchmarkcited by 70
  17. 2020Vector-Quantized Autoregressive Predictive Codingcited by 69
  18. 2019Deep Contextualized Acoustic Representations For Semi-Supervised Speech Recognitioncited by 66
  19. 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 64
  20. 2021ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speechcited by 56
  21. 2024MLAAD: The Multi-Language Audio Anti-Spoofing Datasetcited by 55
  22. 2020Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependenciescited by 47
  23. 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
  24. 2021UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Trainingcited by 43
  25. 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 40
  26. 2024A Large-Scale Evaluation of Speech Foundation Modelscited by 38
  27. 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audiocited by 31
  28. 2024XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detectioncited by 27
  29. 2023Towards generalisable and calibrated synthetic speech detection with self-supervised representationscited by 23
  30. 2024SpoofCeleb: Speech Deepfake Detection and SASV In The Wildcited by 22
  31. 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Datasetcited by 20
  32. 2024Leveraging Mixture of Experts for Improved Speech Deepfake Detectioncited by 14
  33. 2024WavLM model ensemble for audio deepfake detectioncited by 12
  34. 2024Exploring WavLM Back-ends for Speech Spoofing and Deepfake Detectioncited by 10
  35. 2024BUT Systems and Analyses for the ASVspoof 5 Challengecited by 9
  36. 2023MiniSUPERB: Lightweight Benchmark for Self-supervised Speech Modelscited by 8
  37. 2024USTC-KXDIGIT System Description for ASVspoof5 Challengecited by 7
  38. 2021Beijing ZKJ-NPU Speaker Verification System for VoxCeleb Speaker Recognition Challenge 2021cited by 5

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.