mlsanityData to 7 Oct 2026

DiffSSD: A Diffusion-Based Dataset For Speech Forensics

arXiv 2409.13049 ↗First posted 19 Sep 2024eess.AS cs.CV cs.MMcited by 4

Not on the map. Why?

Abstract (arXiv)

Diffusion-based speech generators are ubiquitous. These methods can generate very high quality synthetic speech and several recent incidents report their malicious use. To counter such misuse, synthetic speech detectors have been developed. Many of these detectors are trained on datasets which do not include diffusion-based synthesizers. In this paper, we demonstrate that existing detectors trained on one such dataset, ASVspoof2019, do not perform well in detecting synthetic speech from recent diffusion-based synthesizers. We propose the Diffusion-Based Synthetic Speech Dataset (DiffSSD), a dataset consisting of about 200 hours of labeled speech, including synthetic speech generated by 8 diffusion-based open-source and 2 commercial generators. We also examine the performance of existing synthetic speech detectors on DiffSSD in both closed-set and open-set scenarios. The results highlight the importance of this dataset in detecting synthetic speech generated from recent open-source and commercial speech generators.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 20 of its 46 references that are in the map. First posted on arXiv 19 Sep 2024.

Builds on

20 of 46 references.

References · 20

  1. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  2. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  3. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
  4. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 277
  5. 2021Efficient Training of Audio Transformers with Patchoutcited by 222
  6. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 147
  7. 2022Does Audio Deepfake Detection Generalize?cited by 129
  8. 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
  9. 2018Neural Voice Cloning with a Few Samplescited by 100
  10. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
  11. 2022DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANscited by 43
  12. 2020Replay and Synthetic Speech Detection with Res2net Architecturecited by 38
8 more
  1. 2021Towards End-to-End Synthetic Speech Detectioncited by 37
  2. 2019Deep Residual Neural Networks for Audio Spoofing Detectioncited by 33
  3. 2023OpenVoice: Versatile Instant Voice Cloningcited by 30
  4. 2022TIMIT-TTS: a Text-to-Speech Dataset for Multimodal Synthetic Media Detectioncited by 16
  5. 2023UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Datacited by 15
  6. 2022An Overview of Recent Work in Media Forensics: Methods and Threatscited by 7
  7. 2021FMFCC-A: A Challenging Mandarin Dataset for Synthetic Speech Detectioncited by 6
  8. 2023Syn-Att: Synthetic Speech Attribution via Semi-Supervised Unknown Multi-Class Ensemble of CNNscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

  1. 2025Attention-based Mixture of Experts for Robust Speech Deepfake Detectioncited by 2
  2. 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectorscited by 2
  3. 2026Alethia: A Foundational Encoder for Voice Deepfakescited by 1
  4. 2026LJ-Spoof: A Generatively Varied Corpus for Audio Anti-Spoofing and Synthesis Source Tracingcited by 0