mlsanityData to 14 Oct 2026

Cross-Domain Audio Deepfake Detection: Dataset and Analysis

arXiv 2404.04904 ↗First posted 7 Apr 2024cs.SD cs.AI eess.AScited by 11

Not on the map. Why?

Abstract (arXiv)

Audio deepfake detection (ADD) is essential for preventing the misuse of synthetic voices that may infringe on personal rights and privacy. Recent zero-shot text-to-speech (TTS) models pose higher risks as they can clone voices with a single utterance. However, the existing ADD datasets are outdated, leading to suboptimal generalization of detection models. In this paper, we construct a new cross-domain ADD dataset comprising over 300 hours of speech data that is generated by five advanced zero-shot TTS models. To simulate real-world scenarios, we employ diverse attack methods and audio prompts from different datasets. Experiments show that, through novel attack-augmented training, the Wav2Vec2-large and Whisper-medium models achieve equal error rates of 4.1% and 6.5% respectively. Additionally, we demonstrate our models' outstanding few-shot ADD ability by fine-tuning with just one minute of target-domain data. Nonetheless, neural codec compressors greatly affect the detection accuracy, necessitating further research.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 7 Apr 2024.

Builds on

20 of 30 references.

References · 20

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  4. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
  5. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
  6. 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 226
  7. 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Modelscited by 226
  8. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
  9. 2020Attention is All You Need in Speech Separationcited by 185
  10. 2023Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervisioncited by 169
  11. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
  12. 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 96
8 more
  1. 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
  2. 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
  3. 2019WHAMR!: Noisy and Reverberant Single-Channel Speech Separationcited by 61
  4. 2022The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challengecited by 35
  5. 2024As Good As A Coin Toss: Human detection of AI-generated images, videos, audio, and audiovisual stimulicited by 22
  6. 2024A robust audio deepfake detection system via multi-view featurecited by 19
  7. 2022Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detectioncited by 9
  8. 2022Audio Deep Fake Detection System with Neural Stitching for ADD 2022cited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 4.

11 papers.