mlsanityData to 7 Oct 2026

An End-to-End Multi-Module Audio Deepfake Generation System for ADD Challenge 2023

arXiv 2307.00729 ↗First posted 3 Jul 2023cs.SD cs.CL eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

The task of synthetic speech generation is to generate language content from a given text, then simulating fake human voice.The key factors that determine the effect of synthetic speech generation mainly include speed of generation, accuracy of word segmentation, naturalness of synthesized speech, etc. This paper builds an end-to-end multi-module synthetic speech generation model, including speaker encoder, synthesizer based on Tacotron2, and vocoder based on WaveRNN. In addition, we perform a lot of comparative experiments on different datasets and various model structures. Finally, we won the first place in the ADD 2023 challenge Track 1.1 with the weighted deception success rate (WDSR) of 44.97%.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 22 references that are in the map. First posted on arXiv 3 Jul 2023.

Builds on

17 of 22 references.

References · 17

  1. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  2. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  3. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  4. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  5. 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
  6. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
  7. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 400
  8. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 280
  9. 2015Highway Networkscited by 257
  10. 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
  11. 2020End-to-end anti-spoofing with RawNet2cited by 160
  12. 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
5 more
  1. 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
  2. 2021Towards End-to-End Synthetic Speech Detectioncited by 37
  3. 2021Fre-GAN: Adversarial Frequency-consistent Audio Synthesiscited by 24
  4. 2021ASVspoof 2021: Automatic Speaker Verification Spoofing and Countermeasures Challenge Evaluation Plancited by 18
  5. 2021HLT-NUS SUBMISSION FOR 2020 NIST Conversational Telephone Speech SREcited by 2

Built on by

Not cited yet.