FSD: An Initial Chinese Dataset for Fake Song Detection
Not on the map. Why?
Abstract (arXiv)
Singing voice synthesis and singing voice conversion have significantly advanced, revolutionizing musical experiences. However, the rise of "Deepfake Songs" generated by these technologies raises concerns about authenticity. Unlike Audio DeepFake Detection (ADD), the field of song deepfake detection lacks specialized datasets or methods for song authenticity verification. In this paper, we initially construct a Chinese Fake Song Detection (FSD) dataset to investigate the field of song deepfake detection. The fake songs in the FSD dataset are generated by five state-of-the-art singing voice synthesis and singing voice conversion methods. Our initial experiments on FSD revealed the ineffectiveness of existing speech-trained ADD models for the task of song deepFake detection. Thus, we employ the FSD dataset for the training of ADD models. We subsequently evaluate these models under two scenarios: one with the original songs and another with separated vocal tracks. Experiment results show that song-trained ADD models exhibit a 38.58% reduction in average equal error rate compared to speech-trained ADD models on the FSD test set.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 25 of its 26 references that are in the map. First posted on arXiv 5 Sep 2023.
Builds on
25 of 26 references.
References · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 173
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 173
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2022Does Audio Deepfake Detection Generalize?cited by 129
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
- 2020Neural Networks Fail to Learn Periodic Functions and How to Fix Itcited by 97
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 94
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 73
13 more
- 2021A Comparison of Discrete and Soft Speech Units for Improved Voice Conversioncited by 61
- 2022Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesiscited by 53
- 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
- 2020HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesiscited by 39
- 2022The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challengecited by 33
- 2020DeepSinger: Singing Voice Synthesis with Data Mined From the Webcited by 32
- 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 27
- 2020Unsupervised Cross-Domain Singing Voice Conversioncited by 23
- 2018Neural source-filter-based waveform model for statistical parametric speech synthesiscited by 21
- 2021ASVspoof 2021: Automatic Speaker Verification Spoofing and Countermeasures Challenge Evaluation Plancited by 18
- 2019PitchNet: Unsupervised Singing Voice Conversion with Pitch Adversarial Networkcited by 15
- 2022Anti-Spoofing Using Transfer Learning with Variational Information Bottleneckcited by 8
- 2023Self-Supervised Representations for Singing Voice Conversioncited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 7; 2025: 2; 2026: 2.
12 papers.
- 2023SingFake: Singing Voice Deepfake Detectioncited by 21
- 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songscited by 21
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
- 2024Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 2024cited by 7
- 2024Towards Quantifying and Reducing Language Mismatch Effects in Cross-Lingual Speech Anti-Spoofingcited by 7
- 2025Detect All-Type Deepfake Audio: Wavelet Prompt Tuning for Enhanced Auditory Perceptioncited by 7
- 2026Interpretable All-Type Audio Deepfake Detection with Audio LLMs via Frequency-Time Reinforcement Learningcited by 5
- 2024From Real to Cloned Singer Identificationcited by 3
- 2024SVDD Challenge 2024: A Singing Voice Deepfake Detection Challenge Evaluation Plancited by 2
- 2024Spectrogram-Based Detection of Auto-Tuned Vocals in Music Recordingscited by 0
- 2024Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Modelscited by 0
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Featurescited by 0
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features15 Jun 2026
- 2026Interpretable All-Type Audio Deepfake Detection with Audio LLMs via Frequency-Time Reinforcement Learning6 Jan 2026
- 2025Detect All-Type Deepfake Audio: Wavelet Prompt Tuning for Enhanced Auditory Perception9 Apr 2025
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing8 Apr 2025
- 2024Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Models21 Sep 2024
- 2024Towards Quantifying and Reducing Language Mismatch Effects in Cross-Lingual Speech Anti-Spoofing12 Sep 2024
- 2024Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 20243 Sep 2024
- 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songs26 Aug 2024
- 2024From Real to Cloned Singer Identification11 Jul 2024
- 2024SVDD Challenge 2024: A Singing Voice Deepfake Detection Challenge Evaluation Plan8 May 2024
- 2024Spectrogram-Based Detection of Auto-Tuned Vocals in Music Recordings8 Mar 2024
- 2023SingFake: Singing Voice Deepfake Detection14 Sep 2023