RWEN-TTS: Relation-aware Word Encoding Network for Natural Text-to-Speech Synthesis
Not on the map. Why?
Abstract (arXiv)
With the advent of deep learning, a huge number of text-to-speech (TTS) models which produce human-like speech have emerged. Recently, by introducing syntactic and semantic information w.r.t the input text, various approaches have been proposed to enrich the naturalness and expressiveness of TTS models. Although these strategies showed impressive results, they still have some limitations in utilizing language information. First, most approaches only use graph networks to utilize syntactic and semantic information without considering linguistic features. Second, most previous works do not explicitly consider adjacent words when encoding syntactic and semantic information, even though it is obvious that adjacent words are usually meaningful when encoding the current word. To address these issues, we propose Relation-aware Word Encoding Network (RWEN), which effectively allows syntactic and semantic information based on two modules (i.e., Semantic-level Relation Encoding and Adjacent Word Relation Encoding). Experimental results show substantial improvements compared to previous works.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 15 Dec 2022.
Builds on
30 of 43 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
18 more
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 171
- 2022NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Qualitycited by 151
- 2020FastPitch: Parallel Text-to-speech with Pitch Predictioncited by 150
- 2021Text-Free Prosody-Aware Generative Spoken Language Modelingcited by 119
- 2015The Goldilocks Principle: Reading Children's Books with Explicit Memory Representationscited by 108
- 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
- 2021PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTScited by 52
- 2021One TTS Alignment To Rule Them Allcited by 47
- 2020TTS-by-TTS: TTS-driven Data Augmentation for Fast and High-Quality Speech Synthesiscited by 15
- 2022Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speechcited by 13
- 2020GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesiscited by 9
- 2021Mixer-TTS: non-autoregressive, fast and compact text-to-speech model conditioned on language model embeddingscited by 8
- 2022Distribution augmentation for low-resource expressive text-to-speechcited by 5
- 2022TTS-by-TTS 2: Data-selective augmentation for neural speech synthesis using ranking support vector machine with variational autoencodercited by 5
- 2018An Empirical Analysis of the Correlation of Syntax and Prosodycited by 4
- 2021Enhancing Word-Level Semantic Representation via Dependency Structure for Expressive Text-to-Speech Synthesiscited by 3
Built on by
Not cited yet.