mlsanityData to 7 Oct 2026

Singing-Tacotron: Global duration control attention and dynamic filter for End-to-end singing voice synthesis

arXiv 2202.07907 ↗First posted 16 Feb 2022cs.SD cs.LG eess.AScited by 4

Not on the map. Why?

Abstract (arXiv)

End-to-end singing voice synthesis (SVS) is attractive due to the avoidance of pre-aligned data. However, the auto learned alignment of singing voice with lyrics is difficult to match the duration information in musical score, which will lead to the model instability or even failure to synthesize voice. To learn accurate alignment information automatically, this paper proposes an end-to-end SVS framework, named Singing-Tacotron. The main difference between the proposed framework and Tacotron is that the speech can be controlled significantly by the musical score's duration information. Firstly, we propose a global duration control attention mechanism for the SVS model. The attention mechanism can control each phoneme's duration. Secondly, a duration encoder is proposed to learn a set of global transition tokens from the musical score. These transition tokens can help the attention mechanism decide whether moving to the next phoneme or staying at each decoding step. Thirdly, to further improve the model's stability, a dynamic filter is designed to help the model overcome noise interference and pay more attention to local context information. Subjective and objective evaluation verify the effectiveness of the method. Furthermore, the role of global transition tokens and the effect of duration control are explored. Examples of experiments can be found at https://hairuo55.github.io/SingingTacotron.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 16 Feb 2022.

Builds on

13 of 24 references.

References · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  3. 2015Attention-Based Models for Speech Recognitioncited by 400
  4. 2018LPCNet: Improving Neural Speech Synthesis Through Linear Predictioncited by 109
  5. 2020HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesiscited by 39
  6. 2020XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis Systemcited by 33
  7. 2019Adversarially Trained End-to-end Korean Singing Voice Synthesis Systemcited by 22
  8. 2020ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoderscited by 21
  9. 2018Forward Attention in Sequence-to-sequence Acoustic Modelling for Speech Synthesiscited by 17
  10. 2019Sequence-to-sequence Singing Synthesis Using the Feed-forward Transformercited by 17
  11. 2019A Neural Vocoder with Hierarchical Generation of Amplitude and Phase Spectra for Statistical Parametric Speech Synthesiscited by 10
  12. 2019Singing Synthesis: with a little help from my attentioncited by 8
1 more
  1. 2019Singing voice synthesis based on convolutional neural networkscited by 7

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 2.

4 papers.