NNSVS: A Neural Network-Based Singing Voice Synthesis Toolkit
Not on the map. Why?
Abstract (arXiv)
This paper describes the design of NNSVS, an open-source software for neural network-based singing voice synthesis research. NNSVS is inspired by Sinsy, an open-source pioneer in singing voice synthesis research, and provides many additional features such as multi-stream models, autoregressive fundamental frequency models, and neural vocoders. Furthermore, NNSVS provides extensive documentation and numerous scripts to build complete singing voice synthesis systems. Experimental results demonstrate that our best system significantly outperforms our reproduction of Sinsy and other baseline systems. The toolkit is available at https://github.com/nnsvs/nnsvs.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 16 of its 44 references that are in the map. First posted on arXiv 28 Oct 2022.
Builds on
16 of 44 references.
References · 16
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
- 2020XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis Systemcited by 33
- 2020ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoderscited by 21
- 2019Sequence-to-sequence Singing Synthesis Using the Feed-forward Transformercited by 17
- 2021Sinsy: A Deep Neural Network-Based Singing Voice Synthesis Systemcited by 14
4 more
- 2022Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesiscited by 10
- 2019Singing Voice Synthesis Using Deep Autoregressive Neural Networks for Acoustic Modelingcited by 7
- 2020Sequence-to-sequence Singing Voice Synthesis with Perceptual Entropy Losscited by 6
- 2022Unified Source-Filter GAN with Harmonic-plus-Noise Source Excitation Generationcited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1.
3 papers.