mlsanityData to 14 Oct 2026

Voice Cloning: Comprehensive Survey

arXiv 2505.00579 ↗First posted 1 May 2025cs.SD cs.AI eess.AScited by 4

Not on the map. Why?

Abstract (arXiv)

Voice Cloning has rapidly advanced in today's digital world, with many researchers and corporations working to improve these algorithms for various applications. This article aims to establish a standardized terminology for voice cloning and explore its different variations. It will cover speaker adaptation as the fundamental concept and then delve deeper into topics such as few-shot, zero-shot, and multilingual TTS within that context. Finally, we will explore the evaluation metrics commonly used in voice cloning research and related datasets. This survey compiles the available voice cloning algorithms to encourage research toward its generation and detection to limit its misuse.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 200 of its 286 references that are in the map. First posted on arXiv 1 May 2025.

Builds on

200 of 286 references.

References · 200

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  8. 2017Neural Discrete Representation Learningcited by 4,712
  9. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  10. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  11. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  12. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
38 more
  1. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  3. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  4. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  5. 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
  6. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 804
  7. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  8. 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
  9. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
  10. 2016Language Modeling with Gated Convolutional Networkscited by 702
  11. 2022High Fidelity Neural Audio Compressioncited by 687
  12. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
  13. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
  14. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  15. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  16. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
  17. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
  18. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 467
  19. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 447
  20. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
  21. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
  22. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
  23. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
  24. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  25. 2017Generalized End-to-End Loss for Speaker Verificationcited by 293
  26. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 282
  27. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
  28. 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 273
  29. 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 259
  30. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  31. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 235
  32. 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 235
  33. 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Modelscited by 226
  34. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
  35. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
  36. 2021A Survey on Neural Speech Synthesiscited by 184
  37. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
  38. 2023Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervisioncited by 169

50 most cited of 200 All 200 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

  1. 2025Audio2Face-3D: Audio-driven Realistic Facial Animation For Digital Avatarscited by 7
  2. 2026Probabilistic Verification of Voice Anti-Spoofing Modelscited by 0
  3. 2026Synthetic Speech, Real Signal: Paralinguistic Preservation and Cross-Lingual Augmentation via Voice Cloningcited by 0
  4. 2026Hearing the Whispers: Black-Box Membership Inference Attacks on Finetuned TTS Modelscited by 0