mlsanityData to 14 Oct 2026

Diffuse or Confuse: A Diffusion Deepfake Speech Dataset

arXiv 2410.06796 ↗First posted 9 Oct 2024cs.CR cs.AI cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Advancements in artificial intelligence and machine learning have significantly improved synthetic speech generation. This paper explores diffusion models, a novel method for creating realistic synthetic speech. We create a diffusion dataset using available tools and pretrained models. Additionally, this study assesses the quality of diffusion-generated deepfakes versus non-diffusion ones and their potential threat to current deepfake detection systems. Findings indicate that the detection of diffusion-based deepfakes is generally comparable to non-diffusion deepfakes, with some variability based on detector architecture. Re-vocoding with diffusion vocoders shows minimal impact, and the overall speech quality is comparable to non-diffusion methods.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 18 of its 25 references that are in the map. First posted on arXiv 9 Oct 2024.

Builds on

18 of 25 references.

References · 18

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  3. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 804
  4. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
  5. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  6. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 447
  7. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 282
  8. 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 273
  9. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  10. 2020FastPitch: Parallel Text-to-speech with Pitch Predictioncited by 151
  11. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 149
  12. 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
6 more
  1. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
  2. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
  3. 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesiscited by 64
  4. 2021A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detectioncited by 56
  5. 2019Location-Relative Attention Mechanisms For Robust Long-Form Speech Synthesiscited by 44
  6. 2022DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANscited by 43

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.

  1. 2025STOPA: A Database of Systematic VariaTion Of DeePfake Audio for Open-Set Source Tracing and Attributioncited by 6
  2. 2025SCDF: A Speaker Characteristics DeepFake Speech Dataset for Bias Analysiscited by 6
  3. 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectorscited by 2
  4. 2026Alethia: A Foundational Encoder for Voice Deepfakescited by 1
  5. 2026Ethical and Technical Limits of Deepfake Speech Datasetscited by 1
  6. 2026LJ-Spoof: A Generatively Varied Corpus for Audio Anti-Spoofing and Synthesis Source Tracingcited by 0
  7. 2026RAT: Reference-Augmented Training for ASV Anti-Spoofingcited by 0
  8. 2026What Do Deepfake Speech Detectors Actually Hear?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025A Data-Driven Diffusion-based Approach for Audio Deepfake Explanations
  2. 2023DiffAR: Denoising Diffusion Autoregressive Model for Raw Speech Waveform Generation
  3. 2025On the Design of Diffusion-based Neural Speech Codecs
  4. 2025AUDETER: A Large-scale Dataset for Deepfake Audio Detection in Open Worlds
  5. 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Dataset
  6. 2023From Discrete Tokens to High-Fidelity Audio Using Multi-Band Diffusion
  7. 2023Boosting Fast and High-Quality Speech Synthesis with Linear Diffusion
  8. 2024FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillation