mlsanityData to 7 Oct 2026

FSD: An Initial Chinese Dataset for Fake Song Detection

arXiv 2309.02232 ↗First posted 5 Sep 2023cs.SD cs.AI eess.AScited by 12

Not on the map. Why?

Abstract (arXiv)

Singing voice synthesis and singing voice conversion have significantly advanced, revolutionizing musical experiences. However, the rise of "Deepfake Songs" generated by these technologies raises concerns about authenticity. Unlike Audio DeepFake Detection (ADD), the field of song deepfake detection lacks specialized datasets or methods for song authenticity verification. In this paper, we initially construct a Chinese Fake Song Detection (FSD) dataset to investigate the field of song deepfake detection. The fake songs in the FSD dataset are generated by five state-of-the-art singing voice synthesis and singing voice conversion methods. Our initial experiments on FSD revealed the ineffectiveness of existing speech-trained ADD models for the task of song deepFake detection. Thus, we employ the FSD dataset for the training of ADD models. We subsequently evaluate these models under two scenarios: one with the original songs and another with separated vocal tracks. Experiment results show that song-trained ADD models exhibit a 38.58% reduction in average equal error rate compared to speech-trained ADD models on the FSD test set.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 25 of its 26 references that are in the map. First posted on arXiv 5 Sep 2023.

Builds on

25 of 26 references.

References · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  4. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  5. 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 173
  6. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 173
  7. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  8. 2022Does Audio Deepfake Detection Generalize?cited by 129
  9. 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
  10. 2020Neural Networks Fail to Learn Periodic Functions and How to Fix Itcited by 97
  11. 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 94
  12. 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 73
13 more
  1. 2021A Comparison of Discrete and Soft Speech Units for Improved Voice Conversioncited by 61
  2. 2022Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesiscited by 53
  3. 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
  4. 2020HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesiscited by 39
  5. 2022The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challengecited by 33
  6. 2020DeepSinger: Singing Voice Synthesis with Data Mined From the Webcited by 32
  7. 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 27
  8. 2020Unsupervised Cross-Domain Singing Voice Conversioncited by 23
  9. 2018Neural source-filter-based waveform model for statistical parametric speech synthesiscited by 21
  10. 2021ASVspoof 2021: Automatic Speaker Verification Spoofing and Countermeasures Challenge Evaluation Plancited by 18
  11. 2019PitchNet: Unsupervised Singing Voice Conversion with Pitch Adversarial Networkcited by 15
  12. 2022Anti-Spoofing Using Transfer Learning with Variational Information Bottleneckcited by 8
  13. 2023Self-Supervised Representations for Singing Voice Conversioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 7; 2025: 2; 2026: 2.

12 papers.