mlsanityData to 14 Oct 2026

BiSinger: Bilingual Singing Voice Synthesis

arXiv 2309.14089 ↗First posted 25 Sep 2023eess.AS cs.LG cs.SDcited by 2

Not on the map. Why?

Abstract (arXiv)

Although Singing Voice Synthesis (SVS) has made great strides with Text-to-Speech (TTS) techniques, multilingual singing voice modeling remains relatively unexplored. This paper presents BiSinger, a bilingual pop SVS system for English and Chinese Mandarin. Current systems require separate models per language and cannot accurately represent both Chinese and English, hindering code-switch SVS. To address this gap, we design a shared representation between Chinese and English singing voices, achieved by using the CMU dictionary with mapping rules. We fuse monolingual singing datasets with open-source singing voice conversion techniques to generate bilingual singing voices while also exploring the potential use of bilingual speech data. Experiments affirm that our language-independent representation and incorporation of related datasets enable a single model with enhanced performance in English and code-switch SVS while maintaining Chinese song performance. Audio samples are available at https://bisinger-svs.github.io.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 25 Sep 2023.

Builds on

17 of 31 references.

References · 17

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  3. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  4. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
  5. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  6. 2019Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloningcited by 66
  7. 2018Bytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytescited by 54
  8. 2021VISinger: Variational Inference with Adversarial Learning for End-to-End Singing Voice Synthesiscited by 38
  9. 2020XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis Systemcited by 33
  10. 2020DeepSinger: Singing Voice Synthesis with Data Mined From the Webcited by 32
  11. 2020One Model, Many Languages: Meta-learning for Multilingual Text-to-Speechcited by 28
  12. 2020ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoderscited by 21
5 more
  1. 2018Learning pronunciation from a foreign language in speech synthesis networkscited by 12
  2. 2019Cross-lingual Multi-speaker Text-to-speech Synthesis for Voice Cloning without Using Parallel Corpus for Unseen Speakerscited by 11
  3. 2022Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesiscited by 10
  4. 2022NNSVS: A Neural Network-Based Singing Voice Synthesis Toolkitcited by 3
  5. 2022Improve Bilingual TTS Using Dynamic Language and Phonology Embeddingcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.

  1. 2024An End-to-End Approach for Chord-Conditioned Song Generationcited by 1
  2. 2025LAPS-Diff: A Diffusion-Based Framework for Singing Voice Synthesis With Language Aware Prosody-Style Guided Learningcited by 0