SpoofCeleb: Speech Deepfake Detection and SASV In The Wild
Not on the map. Why?
Abstract (arXiv)
This paper introduces SpoofCeleb, a dataset designed for Speech Deepfake Detection (SDD) and Spoofing-robust Automatic Speaker Verification (SASV), utilizing source data from real-world conditions and spoofing attacks generated by Text-To-Speech (TTS) systems also trained on the same real-world data. Robust recognition systems require speech data recorded in varied acoustic environments with different levels of noise to be trained. However, current datasets typically include clean, high-quality recordings (bona fide data) due to the requirements for TTS training; studio-quality or well-recorded read speech is typically necessary to train TTS models. Current SDD datasets also have limited usefulness for training SASV models due to insufficient speaker diversity. SpoofCeleb leverages a fully automated pipeline we developed that processes the VoxCeleb1 dataset, transforming it into a suitable form for TTS training. We subsequently train 23 contemporary TTS systems. SpoofCeleb comprises over 2.5 million utterances from 1,251 unique speakers, collected under natural, real-world conditions. The dataset includes carefully partitioned training, validation, and evaluation sets with well-controlled experimental protocols. We present the baseline results for both SDD and SASV tasks. All data, protocols, and baselines are publicly available at https://jungjee.github.io/spoofceleb.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 51 of its 68 references that are in the map. First posted on arXiv 18 Sep 2024.
Builds on
51 of 68 references.
References · 51
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2023Simple and Controllable Music Generationcited by 480
38 more
- 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
- 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 308
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 235
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 179
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 173
- 2020End-to-end anti-spoofing with RawNet2cited by 160
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 157
- 2023Matcha-TTS: A fast TTS architecture with conditional flow matchingcited by 142
- 2022Does Audio Deepfake Detection Generalize?cited by 129
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 94
- 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
- 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 64
- 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
- 2024MLAAD: The Multi-Language Audio Anti-Spoofing Datasetcited by 55
- 2022Pushing the limits of raw waveform speaker recognitioncited by 49
- 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
- 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
- 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
- 2023A Vector Quantized Approach for Text to Speech Synthesis on Real-World Spontaneous Speechcited by 22
- 2024ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf modelscited by 22
- 2022SASV 2022: The First Spoofing-Aware Speaker Verification Challengecited by 19
- 2022Spoofed training data for speech spoofing countermeasure can be efficiently created using neural vocoderscited by 19
- 2022CFAD: A Chinese Dataset for Fake Audio Detectioncited by 14
- 2022Frequency and Multi-Scale Selective Kernel Attention for Speaker Verificationcited by 10
- 2023Towards single integrated spoofing-aware speaker verification embeddingscited by 7
- 2020Integrated Replay Spoofing-aware Text-independent Speaker Verificationcited by 6
- 2021FMFCC-A: A Challenging Mandarin Dataset for Synthetic Speech Detectioncited by 6
- 2024a-DCF: an architecture agnostic metric with application to spoofing-robust speaker verificationcited by 6
- 2024Text-To-Speech Synthesis In The Wildcited by 6
- 2016Spoofing detection under noisy conditions: a preliminary investigation and an initial databasecited by 2
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 9; 2026: 13.
22 papers.
Sort:
By area:
- 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 40
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detectioncited by 5
- 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTORcited by 4
- 2025PhonemeFake: Redefining Deepfake Realism with Language-Driven Segmental Manipulation and Adaptive Bilevel Detectioncited by 3
- 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detectioncited by 3
- 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectorscited by 2
- 2025WildSpoof Challenge Evaluation Plancited by 1
- 2025On Deepfake Voice Detection -- It's All in the Presentationcited by 1
- 2025MVAD: A Benchmark Dataset for Multimodal AI-Generated Video-Audio Detectioncited by 1
- 2026Alethia: A Foundational Encoder for Voice Deepfakescited by 1
- 2026Teffic-Audio: Tell Fact from Fictioncited by 1
10 more
- 2025Multilingual Dataset Integration Strategies for Robust Audio Deepfake Detection: A SAFE Challenge Systemcited by 0
- 2026DFKI-Speech System for WildSpoof Challenge: A robust framework for SASV In-the-Wildcited by 0
- 2026A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detectioncited by 0
- 2026Quantum Vision Theory Applied to Audio Classification for Deepfake Speech Detectioncited by 0
- 2026ICLAD: In-Context Learning with Comparison-Guidance for Audio Deepfake Detectioncited by 0
- 2026Deepfake Audio Detection Using Self-supervised Fusion Representationscited by 0
- 2026Half-Truth Audio Detection and Localisation: A Lightweight Cross-Attentive Architecture and a Cross-Corpus Diagnostic Studycited by 0
- 2026Large Audio Language Models for Spoofing-Aware Speaker Verificationcited by 0
- 2026Audio-Anchored Fusion of Multi-Ratio DiT Reconstruction Residuals for Cross-Domain Audio Deepfake Detectioncited by 0
- 2026CoReLoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detectioncited by 0
- 2026CoReLoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detection17 Sep 2026
- 2026Teffic-Audio: Tell Fact from Fiction30 Jul 2026
- 2026Audio-Anchored Fusion of Multi-Ratio DiT Reconstruction Residuals for Cross-Domain Audio Deepfake Detection29 Jul 2026
- 2026Large Audio Language Models for Spoofing-Aware Speaker Verification16 Jul 2026
- 2026Half-Truth Audio Detection and Localisation: A Lightweight Cross-Attentive Architecture and a Cross-Corpus Diagnostic Study28 May 2026
- 2026Deepfake Audio Detection Using Self-supervised Fusion Representations5 May 2026
- 2026Alethia: A Foundational Encoder for Voice Deepfakes30 Apr 2026
- 2026ICLAD: In-Context Learning with Comparison-Guidance for Audio Deepfake Detection17 Apr 2026
- 2026Quantum Vision Theory Applied to Audio Classification for Deepfake Speech Detection9 Apr 2026
- 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTOR6 Mar 2026
- 2026A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detection2 Mar 2026
- 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detection3 Feb 2026
10 more
- 2026DFKI-Speech System for WildSpoof Challenge: A robust framework for SASV In-the-Wild2 Feb 2026
- 2025MVAD: A Benchmark Dataset for Multimodal AI-Generated Video-Audio Detection29 Nov 2025
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detection6 Oct 2025
- 2025On Deepfake Voice Detection -- It's All in the Presentation30 Sep 2025
- 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectors25 Sep 2025
- 2025Multilingual Dataset Integration Strategies for Robust Audio Deepfake Detection: A SAFE Challenge System28 Aug 2025
- 2025WildSpoof Challenge Evaluation Plan23 Aug 2025
- 2025PhonemeFake: Redefining Deepfake Realism with Language-Driven Segmental Manipulation and Adaptive Bilevel Detection28 Jun 2025
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing8 Apr 2025
- 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 20244 Mar 2025
- 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 40
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detectioncited by 5
- 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTORcited by 4
- 2025PhonemeFake: Redefining Deepfake Realism with Language-Driven Segmental Manipulation and Adaptive Bilevel Detectioncited by 3
- 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detectioncited by 3
- 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectorscited by 2
- 2025WildSpoof Challenge Evaluation Plancited by 1
- 2025On Deepfake Voice Detection -- It's All in the Presentationcited by 1
- 2025MVAD: A Benchmark Dataset for Multimodal AI-Generated Video-Audio Detectioncited by 1
- 2026Alethia: A Foundational Encoder for Voice Deepfakescited by 1
- 2026Teffic-Audio: Tell Fact from Fictioncited by 1
12 most cited of 21 All 21 (JSON)
- 2026CoReLoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detection17 Sep 2026
- 2026Teffic-Audio: Tell Fact from Fiction30 Jul 2026
- 2026Audio-Anchored Fusion of Multi-Ratio DiT Reconstruction Residuals for Cross-Domain Audio Deepfake Detection29 Jul 2026
- 2026Large Audio Language Models for Spoofing-Aware Speaker Verification16 Jul 2026
- 2026Half-Truth Audio Detection and Localisation: A Lightweight Cross-Attentive Architecture and a Cross-Corpus Diagnostic Study28 May 2026
- 2026Deepfake Audio Detection Using Self-supervised Fusion Representations5 May 2026
- 2026Alethia: A Foundational Encoder for Voice Deepfakes30 Apr 2026
- 2026ICLAD: In-Context Learning with Comparison-Guidance for Audio Deepfake Detection17 Apr 2026
- 2026Quantum Vision Theory Applied to Audio Classification for Deepfake Speech Detection9 Apr 2026
- 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTOR6 Mar 2026
- 2026A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detection2 Mar 2026
- 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detection3 Feb 2026
12 newest of 21 All 21 (JSON)