mlsanityData to 7 Oct 2026

The Singing Voice Conversion Challenge 2023

arXiv 2306.14422 ↗First posted 26 Jun 2023cs.SD cs.CL eess.AScited by 25

Not on the map. Why?

Abstract (arXiv)

We present the latest iteration of the voice conversion challenge (VCC) series, a bi-annual scientific event aiming to compare and understand different voice conversion (VC) systems based on a common dataset. This year we shifted our focus to singing voice conversion (SVC), thus named the challenge the Singing Voice Conversion Challenge (SVCC). A new database was constructed for two tasks, namely in-domain and cross-domain SVC. The challenge was run for two months, and in total we received 26 submissions, including 2 baselines. Through a large-scale crowd-sourced listening test, we observed that for both tasks, although human-level naturalness was achieved by the top system, no team was able to obtain a similarity score as high as the target speakers. Also, as expected, cross-domain SVC is harder than in-domain SVC, especially in the similarity aspect. We also investigated whether existing objective measurements were able to predict perceptual performance, and found that only few of them could reach a significant correlation.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 40 of its 63 references that are in the map. First posted on arXiv 26 Jun 2023.

Builds on

40 of 63 references.

References · 40

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  3. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  4. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  5. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
  6. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  7. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  8. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  9. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
  10. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  11. 2020Recent Developments on ESPnet Toolkit Boosted by Conformercited by 132
  12. 2020An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learningcited by 111
28 more
  1. 2020Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversioncited by 75
  2. 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 73
  3. 2021Generalization Ability of MOS Prediction Networkscited by 69
  4. 2018The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methodscited by 68
  5. 2021A Comparison of Discrete and Soft Speech Units for Improved Voice Conversioncited by 61
  6. 2021Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpuscited by 60
  7. 2021StarGANv2-VC: A Diverse, Unsupervised, Non-parallel Framework for Natural-Sounding Voice Conversioncited by 57
  8. 2022Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesiscited by 53
  9. 2022Pushing the limits of raw waveform speaker recognitioncited by 49
  10. 2021PortaSpeech: Portable and High-Quality Generative Text-to-Speechcited by 47
  11. 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
  12. 2020HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesiscited by 39
  13. 2021DiffSVC: A Diffusion Probabilistic Model for Singing Voice Conversioncited by 39
  14. 2019Voice Transformer Network: Sequence-to-Sequence Voice Conversion Using Transformer with Text-to-Speech Pretrainingcited by 29
  15. 2020Unsupervised Cross-Domain Singing Voice Conversioncited by 23
  16. 2020FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulationcited by 21
  17. 2019Singing Voice Conversion with Disentangled Representations of Singer and Vocal Technique Using Variational Autoencoderscited by 18
  18. 2020NHSS: A Speech and Singing Parallel Databasecited by 16
  19. 2019PitchNet: Unsupervised Singing Voice Conversion with Pitch Adversarial Networkcited by 15
  20. 2019Unsupervised Singing Voice Conversioncited by 14
  21. 2020Pretraining Techniques for Sequence-to-Sequence Voice Conversioncited by 13
  22. 2020PPG-based singing voice conversion with adversarial representation learningcited by 12
  23. 2022Source-Filter HiFi-GAN: Fast and Pitch Controllable High-Fidelity Neural Vocodercited by 11
  24. 2022Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesiscited by 10
  25. 2022A Comparative Study of Self-supervised Speech Representation Based Voice Conversioncited by 9
  26. 2020VAW-GAN for Singing Voice Conversion with Non-parallel Training Datacited by 6
  27. 2022Unified Source-Filter GAN with Harmonic-plus-Noise Source Excitation Generationcited by 5
  28. 2022DSPGAN: a GAN-based universal vocoder for high-fidelity TTS by time-frequency domain supervision from DSPcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 12; 2025: 11; 2026: 1.

25 papers.

Sort:

By area:

  1. 2024ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf modelscited by 22
  2. 2025BiCrossMamba-ST: Speech Deepfake Detection with Bidirectional Mamba Spectro-Temporal Cross-Attentioncited by 9
  3. 2024SongBsAb: A Dual Prevention Approach against Singing Voice Conversion based Illegal Song Coverscited by 5
  4. 2024SaMoye: Zero-shot Singing Voice Conversion Model Based on Feature Disentanglement and Enhancementcited by 5
  5. 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
  6. 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidancecited by 5
  7. 2024Optimal Transport Maps are Good Voice Converterscited by 4
  8. 2025From Scores to Preferences: Redefining MOS Benchmarking for Speech Quality Reward Modelingcited by 4
  9. 2025Generative Data Augmentation Challenge: Zero-Shot Speech Synthesis for Personalized Speech Enhancementcited by 3
  10. 2025Analyzing and Improving Speaker Similarity Assessment for Speech Synthesiscited by 3
  11. 2023A Comparative Study of Voice Conversion Models with Large-Scale Speech and Singing Data: The T13 Systems for the Singing Voice Conversion Challenge 2023cited by 2
  12. 2024SingVisio: Visual Analytics of Diffusion Model for Singing Voice Conversioncited by 2
13 more
  1. 2024Applications and Advances of Artificial Intelligence in Music Generation:A Reviewcited by 2
  2. 2024LHQ-SVC: Lightweight and High Quality Singing Voice Conversion Modelingcited by 2
  3. 2025DAFMSVC: One-Shot Singing Voice Conversion with Dual Attention Mechanism and Flow Matchingcited by 2
  4. 2025Singing Voice Conversion with Accompaniment Using Self-Supervised Representation-Based Melody Featurescited by 1
  5. 2025kNN-SVC: Robust Zero-Shot Singing Voice Conversion with Additive Synthesis and Concatenation Smoothness Optimizationcited by 1
  6. 2025Multi-Accent Mandarin Dry-Vocal Singing Dataset: Benchmark for Singing Accent Recognitioncited by 1
  7. 2024Low-Resource Cross-Domain Singing Voice Synthesis via Reduced Self-Supervised Speech Representationscited by 0
  8. 2024Automatic design optimization of preference-based subjective evaluation with online learning in crowdsourcing environmentcited by 0
  9. 2024Who is Authentic Speakercited by 0
  10. 2024Automatic Voice Identification after Speech Resynthesis using PPGcited by 0
  11. 2024Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Modelscited by 0
  12. 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulationcited by 0
  13. 2026Controllable Singing Style Conversion with Boundary-Aware Information Bottleneckcited by 0