Singing-Tacotron: Global duration control attention and dynamic filter for End-to-end singing voice synthesis
Not on the map. Why?
Abstract (arXiv)
End-to-end singing voice synthesis (SVS) is attractive due to the avoidance of pre-aligned data. However, the auto learned alignment of singing voice with lyrics is difficult to match the duration information in musical score, which will lead to the model instability or even failure to synthesize voice. To learn accurate alignment information automatically, this paper proposes an end-to-end SVS framework, named Singing-Tacotron. The main difference between the proposed framework and Tacotron is that the speech can be controlled significantly by the musical score's duration information. Firstly, we propose a global duration control attention mechanism for the SVS model. The attention mechanism can control each phoneme's duration. Secondly, a duration encoder is proposed to learn a set of global transition tokens from the musical score. These transition tokens can help the attention mechanism decide whether moving to the next phoneme or staying at each decoding step. Thirdly, to further improve the model's stability, a dynamic filter is designed to help the model overcome noise interference and pay more attention to local context information. Subjective and objective evaluation verify the effectiveness of the method. Furthermore, the role of global transition tokens and the effect of duration control are explored. Examples of experiments can be found at https://hairuo55.github.io/SingingTacotron.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 16 Feb 2022.
Builds on
13 of 24 references.
References · 13
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 803
- 2015Attention-Based Models for Speech Recognitioncited by 400
- 2018LPCNet: Improving Neural Speech Synthesis Through Linear Predictioncited by 110
- 2020HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesiscited by 39
- 2020XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis Systemcited by 33
- 2019Adversarially Trained End-to-end Korean Singing Voice Synthesis Systemcited by 22
- 2020ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoderscited by 21
- 2018Forward Attention in Sequence-to-sequence Acoustic Modelling for Speech Synthesiscited by 17
- 2019Sequence-to-sequence Singing Synthesis Using the Feed-forward Transformercited by 17
- 2019A Neural Vocoder with Hierarchical Generation of Amplitude and Phase Spectra for Statistical Parametric Speech Synthesiscited by 10
- 2019Singing Synthesis: with a little help from my attentioncited by 8
1 more
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 2.
4 papers.
- 2025CoMelSinger: Discrete Token-Based Zero-Shot Singing Synthesis With Structured Melody Control and Guidancecited by 3
- 2022Karaoker: Alignment-free singing voice synthesis with speech training datacited by 1
- 2022Singing Voice Synthesis Based on a Musical Note Position-Aware Attention Mechanismcited by 0
- 2025LAPS-Diff: A Diffusion-Based Framework for Singing Voice Synthesis With Language Aware Prosody-Style Guided Learningcited by 0
- 2025CoMelSinger: Discrete Token-Based Zero-Shot Singing Synthesis With Structured Melody Control and Guidance24 Sep 2025
- 2025LAPS-Diff: A Diffusion-Based Framework for Singing Voice Synthesis With Language Aware Prosody-Style Guided Learning7 Jul 2025
- 2022Singing Voice Synthesis Based on a Musical Note Position-Aware Attention Mechanism28 Dec 2022
- 2022Karaoker: Alignment-free singing voice synthesis with speech training data8 Apr 2022