mlsanityData to 7 Oct 2026

SpoofCeleb: Speech Deepfake Detection and SASV In The Wild

arXiv 2409.17285 ↗First posted 18 Sep 2024cs.SD cs.AI eess.AScited by 22

Not on the map. Why?

Abstract (arXiv)

This paper introduces SpoofCeleb, a dataset designed for Speech Deepfake Detection (SDD) and Spoofing-robust Automatic Speaker Verification (SASV), utilizing source data from real-world conditions and spoofing attacks generated by Text-To-Speech (TTS) systems also trained on the same real-world data. Robust recognition systems require speech data recorded in varied acoustic environments with different levels of noise to be trained. However, current datasets typically include clean, high-quality recordings (bona fide data) due to the requirements for TTS training; studio-quality or well-recorded read speech is typically necessary to train TTS models. Current SDD datasets also have limited usefulness for training SASV models due to insufficient speaker diversity. SpoofCeleb leverages a fully automated pipeline we developed that processes the VoxCeleb1 dataset, transforming it into a suitable form for TTS training. We subsequently train 23 contemporary TTS systems. SpoofCeleb comprises over 2.5 million utterances from 1,251 unique speakers, collected under natural, real-world conditions. The dataset includes carefully partitioned training, validation, and evaluation sets with well-controlled experimental protocols. We present the baseline results for both SDD and SASV tasks. All data, protocols, and baselines are publicly available at https://jungjee.github.io/spoofceleb.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 51 of its 68 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

51 of 68 references.

References · 51

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  4. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  5. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  6. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  7. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  8. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  9. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  10. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  11. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  12. 2023Simple and Controllable Music Generationcited by 480
38 more
  1. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  2. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
  3. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  4. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
  5. 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
  6. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
  7. 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 308
  8. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  9. 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 235
  10. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 179
  11. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 173
  12. 2020End-to-end anti-spoofing with RawNet2cited by 160
  13. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 157
  14. 2023Matcha-TTS: A fast TTS architecture with conditional flow matchingcited by 142
  15. 2022Does Audio Deepfake Detection Generalize?cited by 129
  16. 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 94
  17. 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
  18. 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
  19. 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
  20. 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 64
  21. 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
  22. 2024MLAAD: The Multi-Language Audio Anti-Spoofing Datasetcited by 55
  23. 2022Pushing the limits of raw waveform speaker recognitioncited by 49
  24. 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
  25. 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
  26. 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
  27. 2023A Vector Quantized Approach for Text to Speech Synthesis on Real-World Spontaneous Speechcited by 22
  28. 2024ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf modelscited by 22
  29. 2022SASV 2022: The First Spoofing-Aware Speaker Verification Challengecited by 19
  30. 2022Spoofed training data for speech spoofing countermeasure can be efficiently created using neural vocoderscited by 19
  31. 2022CFAD: A Chinese Dataset for Fake Audio Detectioncited by 14
  32. 2022Frequency and Multi-Scale Selective Kernel Attention for Speaker Verificationcited by 10
  33. 2023Towards single integrated spoofing-aware speaker verification embeddingscited by 7
  34. 2020Integrated Replay Spoofing-aware Text-independent Speaker Verificationcited by 6
  35. 2021FMFCC-A: A Challenging Mandarin Dataset for Synthetic Speech Detectioncited by 6
  36. 2024a-DCF: an architecture agnostic metric with application to spoofing-robust speaker verificationcited by 6
  37. 2024Text-To-Speech Synthesis In The Wildcited by 6
  38. 2016Spoofing detection under noisy conditions: a preliminary investigation and an initial databasecited by 2

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 13.

22 papers.

Sort:

By area:

  1. 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 40
  2. 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
  3. 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detectioncited by 5
  4. 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTORcited by 4
  5. 2025PhonemeFake: Redefining Deepfake Realism with Language-Driven Segmental Manipulation and Adaptive Bilevel Detectioncited by 3
  6. 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detectioncited by 3
  7. 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectorscited by 2
  8. 2025WildSpoof Challenge Evaluation Plancited by 1
  9. 2025On Deepfake Voice Detection -- It's All in the Presentationcited by 1
  10. 2025MVAD: A Benchmark Dataset for Multimodal AI-Generated Video-Audio Detectioncited by 1
  11. 2026Alethia: A Foundational Encoder for Voice Deepfakescited by 1
  12. 2026Teffic-Audio: Tell Fact from Fictioncited by 1
10 more
  1. 2025Multilingual Dataset Integration Strategies for Robust Audio Deepfake Detection: A SAFE Challenge Systemcited by 0
  2. 2026DFKI-Speech System for WildSpoof Challenge: A robust framework for SASV In-the-Wildcited by 0
  3. 2026A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detectioncited by 0
  4. 2026Quantum Vision Theory Applied to Audio Classification for Deepfake Speech Detectioncited by 0
  5. 2026ICLAD: In-Context Learning with Comparison-Guidance for Audio Deepfake Detectioncited by 0
  6. 2026Deepfake Audio Detection Using Self-supervised Fusion Representationscited by 0
  7. 2026Half-Truth Audio Detection and Localisation: A Lightweight Cross-Attentive Architecture and a Cross-Corpus Diagnostic Studycited by 0
  8. 2026Large Audio Language Models for Spoofing-Aware Speaker Verificationcited by 0
  9. 2026Audio-Anchored Fusion of Multi-Ratio DiT Reconstruction Residuals for Cross-Domain Audio Deepfake Detectioncited by 0
  10. 2026CoReLoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detectioncited by 0