Emotional End-to-End Neural Speech Synthesizer
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce an emotional speech synthesizer based on the recent end-to-end neural model, named Tacotron. Despite its benefits, we found that the original Tacotron suffers from the exposure bias problem and irregularity of the attention alignment. Later, we address the problem by utilization of context vector and residual connection at recurrent neural networks (RNNs). Our experiments showed that the model could successfully train and generate speech for given emotion labels.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 12; 2023: 5; 2024: 10; 2025: 1; 2026: 1.
30 papers.
Sort:
By area:
- 2022EmoDiff: Intensity Controllable Emotional Text-to-Speech with Soft-Label Guidancecited by 37
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 32
- 2022Speech Synthesis with Mixed Emotionscited by 28
- 2024Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speechcited by 19
- 2023EmoSpeech: Guiding FastSpeech2 Towards Emotional Text to Speechcited by 14
- 2022Self-supervised Context-aware Style Representation for Expressive Speech Synthesiscited by 10
- 2022STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agentcited by 9
- 2024Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotionscited by 8
- 2022Text-driven Emotional Style Control and Cross-speaker Style Transfer in Neural TTScited by 6
- 2024Style Mixture of Experts for Expressive Text-To-Speech Synthesiscited by 6
- 2024Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settingscited by 6
- 2023Fine-grained Emotional Control of Text-To-Speech: Learning To Rank Inter- And Intra-Class Emotion Intensitiescited by 5
18 more
- 2024DEX-TTS: Diffusion-based EXpressive Text-to-Speech with Style Modeling on Time Variabilitycited by 5
- 2024UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal Promptscited by 4
- 2024Exploring speech style spaces with language models: Emotional TTS without emotion labelscited by 4
- 2025Prompt-Unseen-Emotion: Zero-shot Expressive Speech Synthesis with Prompt-LLM Contextual Knowledge for Mixed Emotionscited by 4
- 2022A Review of Affective Generation Modelscited by 3
- 2022Emotion Selectable End-to-End Text-based Speech Editingcited by 3
- 2022Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representationscited by 2
- 2026Sparse Autoencoders for Interpretable Emotion Control in Text-to-Speechcited by 2
- 2021Multi-speaker Emotional Text-to-speech Synthesizercited by 1
- 2022Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethicscited by 1
- 2022ReCAB-VAE: Gumbel-Softmax Variational Inference Based on Analytic Divergencecited by 1
- 2022Contextual Expressive Text-to-Speechcited by 1
- 2023Affective social anthropomorphic intelligent systemcited by 1
- 2024Humane Speech Synthesis through Zero-Shot Emotion and Disfluency Generationcited by 1
- 2023Rhythm-controllable Attention with High Robustness for Long Sentence Speech Synthesiscited by 0
- 2023CASEIN: Cascading Explicit and Implicit Control for Fine-grained Emotion Intensity Regulationcited by 0
- 2024Daisy-TTS: Simulating Wider Spectrum of Emotions via Prosody Embedding Decompositioncited by 0
- 2024Making Social Platforms Accessible: Emotion-Aware Speech Generation with Integrated Text Analysiscited by 0
- 2026Sparse Autoencoders for Interpretable Emotion Control in Text-to-Speech31 May 2026
- 2025Prompt-Unseen-Emotion: Zero-shot Expressive Speech Synthesis with Prompt-LLM Contextual Knowledge for Mixed Emotions3 Jun 2025
- 2024Making Social Platforms Accessible: Emotion-Aware Speech Generation with Integrated Text Analysis24 Oct 2024
- 2024Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotions25 Sep 2024
- 2024Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settings19 Jul 2024
- 2024Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech17 Jul 2024
- 2024DEX-TTS: Diffusion-based EXpressive Text-to-Speech with Style Modeling on Time Variability27 Jun 2024
- 2024Style Mixture of Experts for Expressive Text-To-Speech Synthesis5 Jun 2024
- 2024Exploring speech style spaces with language models: Emotional TTS without emotion labels18 May 2024
- 2024UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal Prompts29 Apr 2024
- 2024Humane Speech Synthesis through Zero-Shot Emotion and Disfluency Generation31 Mar 2024
- 2024Daisy-TTS: Simulating Wider Spectrum of Emotions via Prosody Embedding Decomposition22 Feb 2024
18 more
- 2023EmoSpeech: Guiding FastSpeech2 Towards Emotional Text to Speech28 Jun 2023
- 2023CASEIN: Cascading Explicit and Implicit Control for Fine-grained Emotion Intensity Regulation27 Jun 2023
- 2023Rhythm-controllable Attention with High Robustness for Long Sentence Speech Synthesis5 Jun 2023
- 2023Affective social anthropomorphic intelligent system19 Apr 2023
- 2023Fine-grained Emotional Control of Text-To-Speech: Learning To Rank Inter- And Intra-Class Emotion Intensities2 Mar 2023
- 2022Emotion Selectable End-to-End Text-based Speech Editing20 Dec 2022
- 2022Contextual Expressive Text-to-Speech26 Nov 2022
- 2022EmoDiff: Intensity Controllable Emotional Text-to-Speech with Soft-Label Guidance17 Nov 2022
- 2022Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representations11 Nov 2022
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era6 Oct 2022
- 2022Speech Synthesis with Mixed Emotions11 Aug 2022
- 2022Text-driven Emotional Style Control and Cross-speaker Style Transfer in Neural TTS13 Jul 2022
- 2022Self-supervised Context-aware Style Representation for Expressive Speech Synthesis25 Jun 2022
- 2022ReCAB-VAE: Gumbel-Softmax Variational Inference Based on Analytic Divergence9 May 2022
- 2022STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agent28 Mar 2022
- 2022Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethics17 Mar 2022
- 2022A Review of Affective Generation Models22 Feb 2022
- 2021Multi-speaker Emotional Text-to-speech Synthesizer7 Dec 2021
- 2022EmoDiff: Intensity Controllable Emotional Text-to-Speech with Soft-Label Guidancecited by 37
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 32
- 2022Speech Synthesis with Mixed Emotionscited by 28
- 2024Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speechcited by 19
- 2023EmoSpeech: Guiding FastSpeech2 Towards Emotional Text to Speechcited by 14
- 2022Self-supervised Context-aware Style Representation for Expressive Speech Synthesiscited by 10
- 2022STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agentcited by 9
- 2024Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotionscited by 8
- 2022Text-driven Emotional Style Control and Cross-speaker Style Transfer in Neural TTScited by 6
- 2024Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settingscited by 6
- 2023Fine-grained Emotional Control of Text-To-Speech: Learning To Rank Inter- And Intra-Class Emotion Intensitiescited by 5
- 2024DEX-TTS: Diffusion-based EXpressive Text-to-Speech with Style Modeling on Time Variabilitycited by 5
12 most cited of 29 All 29 (JSON)
- 2026Sparse Autoencoders for Interpretable Emotion Control in Text-to-Speech31 May 2026
- 2025Prompt-Unseen-Emotion: Zero-shot Expressive Speech Synthesis with Prompt-LLM Contextual Knowledge for Mixed Emotions3 Jun 2025
- 2024Making Social Platforms Accessible: Emotion-Aware Speech Generation with Integrated Text Analysis24 Oct 2024
- 2024Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotions25 Sep 2024
- 2024Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settings19 Jul 2024
- 2024Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech17 Jul 2024
- 2024DEX-TTS: Diffusion-based EXpressive Text-to-Speech with Style Modeling on Time Variability27 Jun 2024
- 2024Exploring speech style spaces with language models: Emotional TTS without emotion labels18 May 2024
- 2024UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal Prompts29 Apr 2024
- 2024Humane Speech Synthesis through Zero-Shot Emotion and Disfluency Generation31 Mar 2024
- 2024Daisy-TTS: Simulating Wider Spectrum of Emotions via Prosody Embedding Decomposition22 Feb 2024
- 2023EmoSpeech: Guiding FastSpeech2 Towards Emotional Text to Speech28 Jun 2023
12 newest of 29 All 29 (JSON)