mlsanityData to 7 Oct 2026

How Far Are We from Robust Voice Conversion: A Survey

arXiv 2011.12063 ↗First posted 24 Nov 2020eess.AS cs.SDcited by 14

Not on the map. Why?

Abstract (arXiv)

Voice conversion technologies have been greatly improved in recent years with the help of deep learning, but their capabilities of producing natural sounding utterances in different conditions remain unclear. In this paper, we gave a thorough study of the robustness of known VC models. We also modified these models, such as the replacement of speaker embeddings, to further improve their performances. We found that the sampling rate and audio duration greatly influence voice conversion. All the VC models suffer from unseen data, but AdaIN-VC is relatively more robust. Also, the speaker embedding jointly trained is more suitable for voice conversion than those trained on speaker identification.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 0; 2023: 2; 2024: 3; 2025: 5; 2026: 1.

14 papers.

Sort:

  1. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
  2. 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
  3. 2024ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf modelscited by 22
  4. 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Modelscited by 20
  5. 2025Emilia: A Large-Scale, Extensive, Multilingual, and Diverse Dataset for Speech Generationcited by 19
  6. 2021Training Robust Zero-Shot Voice Conversion Models with Self-supervised Featurescited by 7
  7. 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTORcited by 4
  8. 2021Toward Degradation-Robust Voice Conversioncited by 3
  9. 2023Learning Repeatable Speech Embeddings Using An Intra-class Correlation Regularizercited by 3
  10. 2023Low-latency Real-time Voice Conversion on CPUcited by 3
  11. 2025Fast-VGAN: Lightweight Voice Conversion with Explicit Control of F0 and Duration Parameterscited by 2
  12. 2024Noro: Noise-Robust One-shot Voice Conversion with Hidden Speaker Representation Learningcited by 0
2 more
  1. 2025RoVo: Robust Voice Protection Against Unauthorized Speech Synthesis with Embedding-Level Perturbationscited by 0
  2. 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulationcited by 0