mlsanityData to 7 Oct 2026

Effects of Convolutional Autoencoder Bottleneck Width on StarGAN-based Singing Technique Conversion

arXiv 2308.10021 ↗First posted 19 Aug 2023eess.AS cs.LG cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Singing technique conversion (STC) refers to the task of converting from one voice technique to another while leaving the original singer identity, melody, and linguistic components intact. Previous STC studies, as well as singing voice conversion research in general, have utilized convolutional autoencoders (CAEs) for conversion, but how the bottleneck width of the CAE affects the synthesis quality has not been thoroughly evaluated. To this end, we constructed a GAN-based multi-domain STC system which took advantage of the WORLD vocoder representation and the CAE architecture. We varied the bottleneck width of the CAE, and evaluated the conversion results subjectively. The model was trained on a Mandarin dataset which features four singers and four singing techniques: the chest voice, the falsetto, the raspy voice, and the whistle voice. The results show that a wider bottleneck corresponds to better articulation clarity but does not necessarily lead to higher likeness to the target technique. Among the four techniques, we also found that the whistle voice is the easiest target for conversion, while the other three techniques as a source produce more convincing conversion results than the whistle.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 16 references that are in the map. First posted on arXiv 19 Aug 2023.

Builds on

13 of 16 references.

References · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  4. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  5. 2020An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learningcited by 111
  6. 2018StarGAN-VC: Non-parallel many-to-many voice conversion with star generative adversarial networkscited by 78
  7. 2021DiffSVC: A Diffusion Probabilistic Model for Singing Voice Conversioncited by 39
  8. 2020FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulationcited by 21
  9. 2019Singing Voice Conversion with Disentangled Representations of Singer and Vocal Technique Using Variational Autoencoderscited by 18
  10. 2019PitchNet: Unsupervised Singing Voice Conversion with Pitch Adversarial Networkcited by 15
  11. 2019Unsupervised Singing Voice Conversioncited by 14
  12. 2019Walking the Tightrope: An Investigation of the Convolutional Autoencoder Bottleneckcited by 3
1 more
  1. 2021Zero-shot Singing Technique Conversioncited by 2

Built on by

Not cited yet.