CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Recent singing voice synthesis and conversion advancements necessitate robust singing voice deepfake detection (SVDD) models. Current SVDD datasets face challenges due to limited controllability, diversity in deepfake methods, and licensing restrictions. Addressing these gaps, we introduce CtrSVDD, a large-scale, diverse collection of bonafide and deepfake singing vocals. These vocals are synthesized using state-of-the-art methods from publicly accessible singing voice datasets. CtrSVDD includes 47.64 hours of bonafide and 260.34 hours of deepfake singing vocals, spanning 14 deepfake methods and involving 164 singer identities. We also present a baseline system with flexible front-end features, evaluated against a structured train/dev/eval split. The experiments show the importance of feature selection and highlight a need for generalization towards deepfake methods that deviate further from training distribution. The CtrSVDD dataset and baselines are publicly accessible.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jun 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 5; 2025: 7; 2026: 4.
16 papers.
Sort:
By area:
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songscited by 21
- 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Modelscited by 20
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
- 2024Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 2024cited by 7
- 2025Detect All-Type Deepfake Audio: Wavelet Prompt Tuning for Enhanced Auditory Perceptioncited by 7
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessmentcited by 7
- 2024VoiceWukong: Benchmarking Deepfake Voice Detectioncited by 5
- 2026Interpretable All-Type Audio Deepfake Detection with Audio LLMs via Frequency-Time Reinforcement Learningcited by 5
- 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTORcited by 4
- 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectorscited by 2
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learningcited by 1
4 more
- 2024Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Modelscited by 0
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Featurescited by 0
- 2026ToolDF: Tool-Integrated Reasoning for Mixed-Authenticity Audio Deepfake Detectioncited by 0
- 2026ToolDF: Tool-Integrated Reasoning for Mixed-Authenticity Audio Deepfake Detection3 Sep 2026
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features15 Jun 2026
- 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTOR6 Mar 2026
- 2026Interpretable All-Type Audio Deepfake Detection with Audio LLMs via Frequency-Time Reinforcement Learning6 Jan 2026
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learning29 Nov 2025
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessment2 Oct 2025
- 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectors25 Sep 2025
- 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Models2 Sep 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025Detect All-Type Deepfake Audio: Wavelet Prompt Tuning for Enhanced Auditory Perception9 Apr 2025
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing8 Apr 2025
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models13 Oct 2024
4 more
- 2024Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Models21 Sep 2024
- 2024VoiceWukong: Benchmarking Deepfake Voice Detection10 Sep 2024
- 2024Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 20243 Sep 2024
- 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songs26 Aug 2024
- 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songscited by 21
- 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Modelscited by 20
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
- 2024Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 2024cited by 7
- 2025Detect All-Type Deepfake Audio: Wavelet Prompt Tuning for Enhanced Auditory Perceptioncited by 7
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessmentcited by 7
- 2024VoiceWukong: Benchmarking Deepfake Voice Detectioncited by 5
- 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTORcited by 4
- 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectorscited by 2
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learningcited by 1
- 2024Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Modelscited by 0
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
12 most cited of 14 All 14 (JSON)
- 2026ToolDF: Tool-Integrated Reasoning for Mixed-Authenticity Audio Deepfake Detection3 Sep 2026
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features15 Jun 2026
- 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTOR6 Mar 2026
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learning29 Nov 2025
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessment2 Oct 2025
- 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectors25 Sep 2025
- 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Models2 Sep 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025Detect All-Type Deepfake Audio: Wavelet Prompt Tuning for Enhanced Auditory Perception9 Apr 2025
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing8 Apr 2025
- 2024Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Models21 Sep 2024
- 2024VoiceWukong: Benchmarking Deepfake Voice Detection10 Sep 2024
12 newest of 14 All 14 (JSON)