mlsanityData to 7 Oct 2026

Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 2024

arXiv 2409.02302 ↗First posted 3 Sep 2024eess.AS cs.AI cs.SDcited by 7

Not on the map. Why?

Abstract (arXiv)

This work details our approach to achieving a leading system with a 1.79% pooled equal error rate (EER) on the evaluation set of the Controlled Singing Voice Deepfake Detection (CtrSVDD). The rapid advancement of generative AI models presents significant challenges for detecting AI-generated deepfake singing voices, attracting increased research attention. The Singing Voice Deepfake Detection (SVDD) Challenge 2024 aims to address this complex task. In this work, we explore the ensemble methods, utilizing speech foundation models to develop robust singing voice anti-spoofing systems. We also introduce a novel Squeeze-and-Excitation Aggregation (SEA) method, which efficiently and effectively integrates representation features from the speech foundation models, surpassing the performance of our other individual systems. Evaluation results confirm the efficacy of our approach in detecting deepfake singing voices. The codes can be accessed at https://github.com/Anmol2059/SVDD2024.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 3 Sep 2024.

Builds on

35 of 42 references.

References · 35

  1. 2017Squeeze-and-Excitation Networkscited by 4,763
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  4. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
  5. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  6. 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 173
  7. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 173
  8. 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 110
  9. 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 64
  10. 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
  11. 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
  12. 2022The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challengecited by 33
23 more
  1. 2024Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detectioncited by 24
  2. 2019ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworkscited by 23
  3. 2019Adversarial Attacks on Spoofing Countermeasures of automatic speaker verificationcited by 23
  4. 2023SingFake: Singing Voice Deepfake Detectioncited by 21
  5. 2023Can large-scale vocoded spoofed data improve speech spoofing countermeasure with a self-supervised front end?cited by 17
  6. 2024Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detectioncited by 17
  7. 2024CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detectioncited by 16
  8. 2024CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systemscited by 15
  9. 2020JVS-MuSiC: Japanese multispeaker singing-voice corpuscited by 14
  10. 2022MFA: TDNN with Multi-scale Frequency-channel Attention for Text-independent Speaker Verification with Short Utterancescited by 12
  11. 2023FSD: An Initial Chinese Dataset for Fake Song Detectioncited by 12
  12. 2023Improving Short Utterance Anti-Spoofing with AASIST2cited by 11
  13. 2023Disentangling Voice and Content with Self-Supervision for Speaker Recognitioncited by 10
  14. 2024How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?cited by 10
  15. 2024Singing Voice Graph Modeling for SingFake Detectioncited by 9
  16. 2019Ensemble Models for Spoofing Detection in Automatic Speaker Verificationcited by 8
  17. 2023Golden Gemini is All You Need: Finding the Sweet Spots for Speaker Verificationcited by 8
  18. 2024SVDD 2024: The Inaugural Singing Voice Deepfake Detection Challengecited by 8
  19. 2023Spoofing attack augmentation: can differently-trained attack models improve generalisation?cited by 3
  20. 2024SA-WavLM: Speaker-Aware Self-Supervised Pre-training for Mixture Speechcited by 3
  21. 2024SVDD Challenge 2024: A Singing Voice Deepfake Detection Challenge Evaluation Plancited by 2
  22. 2024Target Speech Diarization with Multimodal Promptscited by 2
  23. 2023Prompt-driven Target Speech Diarizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 4.

7 papers.

  1. 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
  2. 2024Towards Quantifying and Reducing Language Mismatch Effects in Cross-Lingual Speech Anti-Spoofingcited by 7
  3. 2026Interpretable All-Type Audio Deepfake Detection with Audio LLMs via Frequency-Time Reinforcement Learningcited by 5
  4. 2026AT-ADD: All-Type Audio Deepfake Detection Challenge Evaluation Plancited by 3
  5. 2025Speech-FT: Merging Pre-trained And Fine-Tuned Speech Representation Models For Cross-Task Generalizationcited by 2
  6. 2026Quantizer-Aware Hierarchical Neural Codec Modeling for Speech Deepfake Detectioncited by 0
  7. 2026Supervised Post-training of Speech Foundation Models for Robust Adaptation in Speech Deepfake Detectioncited by 0