mlsanityData to 14 Oct 2026

Speech DF Arena: A Leaderboard for Speech DeepFake Detection Models

arXiv 2509.02859 ↗First posted 2 Sep 2025cs.SD cs.CL eess.AScited by 21

Not on the map. Why?

Abstract (arXiv)

Parallel to the development of advanced deepfake audio generation, audio deepfake detection has also seen significant progress. However, a standardized and comprehensive benchmark is still missing. To address this, we introduce Speech DeepFake (DF) Arena, the first comprehensive benchmark for audio deepfake detection. Speech DF Arena provides a toolkit to uniformly evaluate detection systems, currently across 14 diverse datasets and attack scenarios, standardized evaluation metrics and protocols for reproducibility and transparency. It also includes a leaderboard to compare and rank the systems to help researchers and developers enhance their reliability and robustness. We include 14 evaluation sets, 12 state-of-the-art open-source and 3 proprietary detection systems. Our study presents many systems exhibiting high EER in out-of-domain scenarios, highlighting the need for extensive cross-domain evaluation. The leaderboard is hosted on Huggingface1 and a toolkit for reproducing results across the listed datasets is available on GitHub.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 32 of its 45 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

32 of 45 references.

References · 32

  1. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 425
  2. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
  3. 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
  4. 2020End-to-end anti-spoofing with RawNet2cited by 164
  5. 2022Does Audio Deepfake Detection Generalize?cited by 135
  6. 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
  7. 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
  8. 2020An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learningcited by 112
  9. 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 96
  10. 2024Recent Advances in Speech Language Models: A Surveycited by 87
  11. 2021End-to-End Spectro-Temporal Graph Attention Networks for Speaker Verification Anti-Spoofing and Speech Deepfake Detectioncited by 70
  12. 2015A Review of Feature Selection Methods Based on Mutual Informationcited by 67
20 more
  1. 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
  2. 2023Audio Deepfake Detection: A Surveycited by 50
  3. 2023AI-Synthesized Voice Detection Using Neural Vocoder Artifactscited by 41
  4. 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audiocited by 31
  5. 2024XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detectioncited by 30
  6. 2023Improved DeepFake Detection Using Whisper Featurescited by 29
  7. 2025ASVspoof 5: Design, Collection and Validation of Resources for Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speechcited by 26
  8. 2024Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detectioncited by 25
  9. 2023Warning: Humans Cannot Reliably Detect Speech Deepfakescited by 20
  10. 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Datasetcited by 20
  11. 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 19
  12. 2024CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detectioncited by 16
  13. 2020How Far Are We from Robust Voice Conversion: A Surveycited by 14
  14. 2025BiCrossMamba-ST: Speech Deepfake Detection with Bidirectional Mamba Spectro-Temporal Cross-Attentioncited by 10
  15. 2024VoiceWukong: Benchmarking Deepfake Voice Detectioncited by 5
  16. 2025Children's Voice Privacy: First Steps And Emerging Challengescited by 5
  17. 2025Unveiling Audio Deepfake Origins: A Deep Metric learning And Conformer Network Approach With Ensemble Fusioncited by 5
  18. 2025RawTFNet: A Lightweight CNN Architecture for Speech Anti-spoofingcited by 4
  19. 2024kNN Retrieval for Simple and Effective Zero-Shot Multi-speaker Text-to-Speechcited by 3
  20. 2024Towards Robust Audio Deepfake Detection: A Evolving Benchmark for Continual Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 18.

21 papers.

Sort:

By area:

  1. 2026AVBench: Human-Aligned and Automated Evaluation Benchmark for Audio-Video Generative Modelscited by 5
  2. 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTORcited by 4
  3. 2025Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detectioncited by 2
  4. 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectorscited by 2
  5. 2026CoReLoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detectioncited by 2
  6. 2025QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detectioncited by 1
  7. 2026Teffic-Audio: Tell Fact from Fictioncited by 1
  8. 2026HyperPotter: Spell the Charm of High-Order Interactions in Audio Deepfake Detectioncited by 0
  9. 2026What Counts as Real? Speech Restoration and Voice Quality Conversion Pose New Challenges to Deepfake Detectioncited by 0
  10. 2026A General Model for Deepfake Speech Detection: Diverse Bonafide Resources or Diverse AI-Based Generatorscited by 0
  11. 2026The DeepSpeak-Agentic Datasetcited by 0
  12. 2026Speaker-Invariant Representation Learning for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneckcited by 0
9 more
  1. 2026From Self-Supervised Speech Models to Mixture-of-Experts for Robust Anti-Spoofingcited by 0
  2. 2026Linguistic Bias Mitigation for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneckcited by 0
  3. 2026Explainable-by-Design Audio Deepfake Detection via Wiener-Hopf Linear Predictioncited by 0
  4. 2026Zero-Shot Temporal Localisation of Audio Deepfakes in Multi-Speaker Conversationscited by 0
  5. 2026Robust Workflow Generation via Adversarial Learning for Audio Deepfake Detectioncited by 0
  6. 2026WST-Graph: Topology-Preserving Wavelet Scattering Front-End for Speech Deepfake Detectioncited by 0
  7. 2026Tracing Decoder Artifacts for Compact Synthetic Speech Screeningcited by 0
  8. 2026Domain-Adaptive Dual-Gating Mixture of Experts for Generalizable Speech Deepfake Detectioncited by 0
  9. 2026Task-Aware Joint Pruning and Distillation for Efficient Audio Deepfake Detectioncited by 0