The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
Not on the map. Why?
Abstract (arXiv)
We present the Voice Conversion Challenge 2018, designed as a follow up to the 2016 edition with the aim of providing a common framework for evaluating and comparing different state-of-the-art voice conversion (VC) systems. The objective of the challenge was to perform speaker conversion (i.e. transform the vocal identity) of a source speaker to a target speaker while maintaining linguistic information. As an update to the previous challenge, we considered both parallel and non-parallel data to form the Hub and Spoke tasks, respectively. A total of 23 teams from around the world submitted their systems, 11 of them additionally participated in the optional Spoke task. A large-scale crowdsourced perceptual evaluation was then carried out to rate the submitted converted speech in terms of naturalness and similarity to the target speaker identity. In this paper, we present a brief summary of the state-of-the-art techniques for VC, followed by a detailed explanation of the challenge tasks and the results that were obtained.
Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 13; 2023: 14; 2024: 8; 2025: 9; 2026: 6.
68 papers.
Sort:
By area:
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 113
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2021CDPAM: Contrastive learning for perceptual audio similaritycited by 42
- 2021Deep Learning Based Assessment of Synthetic Speech Naturalnesscited by 35
- 2023The Singing Voice Conversion Challenge 2023cited by 25
- 2021LDNet: Unified Listener Dependent Modeling in MOS Prediction for Synthetic Speechcited by 24
- 2021Utilizing Self-supervised Representations for MOS Predictioncited by 20
- 2022SpeechLMScore: Evaluating speech generation using speech language modelcited by 19
- 2021MaskCycleGAN-VC: Learning Non-parallel Voice Conversion with Filling in Framescited by 18
38 more
- 2021EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Modelcited by 18
- 2022SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesiscited by 18
- 2021SpeechNet: A Universal Modularized Model for Speech Processing Taskscited by 16
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speechcited by 14
- 2022Fusion of Self-supervised Learned Models for MOS Predictioncited by 10
- 2021NVC-Net: End-to-End Adversarial Voice Conversioncited by 9
- 2023Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofingcited by 9
- 2024Harder or Different? Understanding Generalization of Audio Deepfake Detectioncited by 9
- 2024SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detectioncited by 8
- 2022DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scorescited by 7
- 2023MOSPC: MOS Prediction Based on Pairwise Comparisoncited by 7
- 2022Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Reviewcited by 6
- 2023DSVAE: Interpretable Disentangled Representation for Synthetic Speech Detectioncited by 6
- 2023Towards General-Purpose Text-Instruction-Guided Voice Conversioncited by 6
- 2024RankUp: Boosting Semi-Supervised Regression with an Auxiliary Ranking Classifiercited by 6
- 2022ECAPA-TDNN for Multi-speaker Text-to-speech Synthesiscited by 5
- 2021StarGAN-ZSVC: Towards Zero-Shot Voice Conversion in Low-Resource Contextscited by 4
- 2021Voicy: Zero-Shot Non-Parallel Voice Conversion in Noisy Reverberant Environmentscited by 4
- 2021SVSNet: An End-to-end Speaker Voice Similarity Assessment Modelcited by 4
- 2025Voice of a Continent: Mapping Africa's Speech Technology Frontiercited by 4
- 2021An Adaptive Learning based Generative Adversarial Network for One-To-One Voice Conversioncited by 3
- 2023In-the-wild Speech Emotion Conversion Using Disentangled Self-Supervised Representations and Neural Vocoder-based Resynthesiscited by 3
- 2024SpeechComposer: Unifying Multiple Speech Tasks with Prompt Compositioncited by 3
- 2025Multi-level SSL Feature Gating for Audio Deepfake Detectioncited by 3
- 2022Automatic Evaluation of Speaker Similaritycited by 2
- 2022Controllable Accented Text-to-Speech Synthesiscited by 2
- 2022Investigating Content-Aware Neural Text-To-Speech MOS Prediction Using Prosodic and Linguistic Featurescited by 2
- 2023Evaluation of Speech Representations for MOS predictioncited by 2
- 2023A Comparative Study of Voice Conversion Models with Large-Scale Speech and Singing Data: The T13 Systems for the Singing Voice Conversion Challenge 2023cited by 2
- 2023AE-Flow: AutoEncoder Normalizing Flowcited by 2
- 2024Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNetcited by 2
- 2025Attention-based Mixture of Experts for Robust Speech Deepfake Detectioncited by 2
- 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversioncited by 2
- 2021Low-Latency Real-Time Non-Parallel Voice Conversion based on Cyclic Variational Autoencoder and Multiband WaveRNN with Data-Driven Linear Predictioncited by 1
- 2022Boosting Star-GANs for Voice Conversion with Contrastive Discriminatorcited by 1
- 2023EventTrojan: Manipulating Non-Intrusive Speech Quality Assessment via Imperceptible Eventscited by 1
- 2024Compression Robust Synthetic Speech Detection Using Patched Spectrogram Transformercited by 1
- 2024SVSNet+: Enhancing Speaker Voice Similarity Assessment Models with Representations from Speech Foundation Modelscited by 1
50 most cited of 68 All 68 (JSON)
- 2026DAMOS: Learning Distortion-Aware Speech Quality Assessment through Explicit Distortion Localization21 Aug 2026
- 2026EmAvatar: Multimodal Empathetic Response Generation via Conflict Resolution and Expressive Guidance4 Aug 2026
- 2026Ethical and Technical Limits of Deepfake Speech Datasets9 Jun 2026
- 2026Spectro-Temporal Modulation Representation Framework for Human-Imitated Speech Detection25 Apr 2026
- 2026Acoustic and perceptual differences between standard and accented speech and their voice clones2 Apr 2026
- 2026MeanVoiceFlow: One-step Nonparallel Voice Conversion with Mean Flows20 Feb 2026
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
- 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversion31 Oct 2025
- 2025Attention-based Mixture of Experts for Robust Speech Deepfake Detection22 Sep 2025
- 2025Multi-level SSL Feature Gating for Audio Deepfake Detection3 Sep 2025
- 2025IndieFake Dataset: A Benchmark Dataset for Audio Deepfake Detection23 Jun 2025
- 2025SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction2 Jun 2025
38 more
- 2025Voice of a Continent: Mapping Africa's Speech Technology Frontier24 May 2025
- 2025FADEL: Uncertainty-aware Fake Audio Detection with Evidential Deep Learning22 Apr 2025
- 2025Collective Learning Mechanism based Optimal Transport Generative Adversarial Network for Non-parallel Voice Conversion18 Apr 2025
- 2024RankUp: Boosting Semi-Supervised Regression with an Auxiliary Ranking Classifier29 Oct 2024
- 2024SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection26 Jul 2024
- 2024An Unsupervised Domain Adaptation Method for Locating Manipulated Region in partially fake Audio11 Jul 2024
- 2024SVSNet+: Enhancing Speaker Voice Similarity Assessment Models with Representations from Speech Foundation Models12 Jun 2024
- 2024Harder or Different? Understanding Generalization of Audio Deepfake Detection5 Jun 2024
- 2024Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet19 Apr 2024
- 2024Compression Robust Synthetic Speech Detection Using Patched Spectrogram Transformer22 Feb 2024
- 2024SpeechComposer: Unifying Multiple Speech Tasks with Prompt Composition31 Jan 2024
- 2023AE-Flow: AutoEncoder Normalizing Flow27 Dec 2023
- 2023A Comparative Study of Voice Conversion Models with Large-Scale Speech and Singing Data: The T13 Systems for the Singing Voice Conversion Challenge 20238 Oct 2023
- 2023Towards General-Purpose Text-Instruction-Guided Voice Conversion25 Sep 2023
- 2023EventTrojan: Manipulating Non-Intrusive Speech Quality Assessment via Imperceptible Events4 Sep 2023
- 2023SCRAPS: Speech Contrastive Representations of Acoustic and Phonetic Spaces23 Jul 2023
- 2023The Singing Voice Conversion Challenge 202326 Jun 2023
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale23 Jun 2023
- 2023Automatic Speech Disentanglement for Voice Conversion using Rank Module and Speech Augmentation21 Jun 2023
- 2023MOSPC: MOS Prediction Based on Pairwise Comparison18 Jun 2023
- 2023Evaluation of Speech Representations for MOS prediction16 Jun 2023
- 2023In-the-wild Speech Emotion Conversion Using Disentangled Self-Supervised Representations and Neural Vocoder-based Resynthesis2 Jun 2023
- 2023Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofing31 May 2023
- 2023DSVAE: Interpretable Disentangled Representation for Synthetic Speech Detection6 Apr 2023
- 2023MooseNet: A Trainable Metric for Synthesized Speech with a PLDA Module17 Jan 2023
- 2022SpeechLMScore: Evaluating speech generation using speech language model8 Dec 2022
- 2022Investigating Content-Aware Neural Text-To-Speech MOS Prediction Using Prosodic and Linguistic Features1 Nov 2022
- 2022RedPen: Region- and Reason-Annotated Dataset of Unnatural Speech26 Oct 2022
- 2022Controllable Accented Text-to-Speech Synthesis22 Sep 2022
- 2022Boosting Star-GANs for Voice Conversion with Contrastive Discriminator21 Sep 2022
- 2022Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review21 Aug 2022
- 2022Automatic Evaluation of Speaker Similarity1 Jul 2022
- 2022Comparison of Speech Representations for the MOS Prediction System28 Jun 2022
- 2022Fusion of Self-supervised Learned Models for MOS Prediction11 Apr 2022
- 2022DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores7 Apr 2022
- 2022SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesis6 Apr 2022
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancement24 Mar 2022
- 2022ECAPA-TDNN for Multi-speaker Text-to-speech Synthesis20 Mar 2022
50 newest of 68 All 68 (JSON)
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 113
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2021CDPAM: Contrastive learning for perceptual audio similaritycited by 42
- 2021Deep Learning Based Assessment of Synthetic Speech Naturalnesscited by 35
- 2023The Singing Voice Conversion Challenge 2023cited by 25
- 2021LDNet: Unified Listener Dependent Modeling in MOS Prediction for Synthetic Speechcited by 24
- 2021Utilizing Self-supervised Representations for MOS Predictioncited by 20
- 2022SpeechLMScore: Evaluating speech generation using speech language modelcited by 19
- 2021MaskCycleGAN-VC: Learning Non-parallel Voice Conversion with Filling in Framescited by 18
12 most cited of 65 All 65 (JSON)
- 2026DAMOS: Learning Distortion-Aware Speech Quality Assessment through Explicit Distortion Localization21 Aug 2026
- 2026EmAvatar: Multimodal Empathetic Response Generation via Conflict Resolution and Expressive Guidance4 Aug 2026
- 2026Ethical and Technical Limits of Deepfake Speech Datasets9 Jun 2026
- 2026Spectro-Temporal Modulation Representation Framework for Human-Imitated Speech Detection25 Apr 2026
- 2026Acoustic and perceptual differences between standard and accented speech and their voice clones2 Apr 2026
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
- 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversion31 Oct 2025
- 2025Multi-level SSL Feature Gating for Audio Deepfake Detection3 Sep 2025
- 2025IndieFake Dataset: A Benchmark Dataset for Audio Deepfake Detection23 Jun 2025
- 2025SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction2 Jun 2025
- 2025Voice of a Continent: Mapping Africa's Speech Technology Frontier24 May 2025
- 2025FADEL: Uncertainty-aware Fake Audio Detection with Evidential Deep Learning22 Apr 2025
12 newest of 65 All 65 (JSON)