mlsanityData to 13 Oct 2026

The ISCSLP 2024 Conversational Voice Clone (CoVoC) Challenge: Tasks, Results and Findings

arXiv 2411.00064 ↗First posted 31 Oct 2024cs.SD cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The ISCSLP 2024 Conversational Voice Clone (CoVoC) Challenge aims to benchmark and advance zero-shot spontaneous style voice cloning, particularly focusing on generating spontaneous behaviors in conversational speech. The challenge comprises two tracks: an unconstrained track without limitation on data and model usage, and a constrained track only allowing the use of constrained open-source datasets. A 100-hour high-quality conversational speech dataset is also made available with the challenge. This paper details the data, tracks, submitted systems, evaluation results, and findings.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 22 of its 23 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

22 of 23 references.

References · 22

  1. 2022Scalable Diffusion Models with Transformerscited by 5,973
  2. 2022Flow Matching for Generative Modelingcited by 5,542
  3. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 745
  4. 2022High Fidelity Neural Audio Compressioncited by 680
  5. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 559
  6. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 489
  7. 2023Simple and Controllable Music Generationcited by 484
  8. 2017Generalized End-to-End Loss for Speaker Verificationcited by 292
  9. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 281
  10. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 191
  11. 2023Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervisioncited by 169
  12. 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 141
10 more
  1. 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
  2. 2023Better speech synthesis through scalingcited by 63
  3. 2023Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Biascited by 51
  4. 2024WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmarkcited by 39
  5. 2024Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generationcited by 23
  6. 2021DelightfulTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2021cited by 19
  7. 2021Controllable Context-aware Conversational Speech Synthesiscited by 18
  8. 2023SponTTS: modeling and transferring spontaneous style for TTScited by 7
  9. 2024Spontaneous Style Text-to-Speech Synthesis with Controllable Spontaneous Behaviors Based on Language Modelscited by 7
  10. 2022DSPGAN: a GAN-based universal vocoder for high-fidelity TTS by time-frequency domain supervision from DSPcited by 5

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.