Exploring Transfer Learning for Low Resource Emotional TTS
Not on the map. Why?
Abstract (arXiv)
During the last few years, spoken language technologies have known a big improvement thanks to Deep Learning. However Deep Learning-based algorithms require amounts of data that are often difficult and costly to gather. Particularly, modeling the variability in speech of different speakers, different styles or different emotions with few data remains challenging. In this paper, we investigate how to leverage fine-tuning on a pre-trained Deep Learning-based TTS model to synthesize speech with a small dataset of another speaker. Then we investigate the possibility to adapt this model to have emotional TTS by fine-tuning the neutral TTS model with a small emotional dataset.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 6; 2023: 5; 2024: 5; 2025: 1; 2026: 1.
21 papers.
Sort:
By area:
- 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 113
- 2022Speech Synthesis with Mixed Emotionscited by 28
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speechcited by 14
- 2021Machine learning on small size samples: A synthetic knowledge synthesiscited by 11
- 2022Cross-Speaker Emotion Transfer for Low-Resource Text-to-Speech Using Non-Parallel Voice Conversion with Pitch-Shift Data Augmentationcited by 8
- 2024Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotionscited by 8
- 2024A Review of Human Emotion Synthesis Based on Generative Technologycited by 7
- 2024A multilingual training strategy for low resource Text to Speechcited by 3
- 2022Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representationscited by 2
- 2022Low-Resource End-to-end Sanskrit TTS using Tacotron2, WaveGlow and Transfer Learningcited by 2
- 2023Flowchase: a Mobile Application for Pronunciation Trainingcited by 2
9 more
- 2025Integrating Feedback Loss from Bi-modal Sarcasm Detector for Sarcastic Speech Synthesiscited by 2
- 2022Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethicscited by 1
- 2023DurIAN-E: Duration Informed Attention Network For Expressive Text-to-Speech Synthesiscited by 1
- 2023Comparative Analysis of Transfer Learning in Deep Learning Text-to-Speech Models on a Few-Shot, Low-Resource, Customized Datasetcited by 1
- 2023MUST&P-SRL: Multi-lingual and Unified Syllabification in Text and Phonetic Domains for Speech Representation Learningcited by 1
- 2023Expressive TTS Driven by Natural Language Prompts Using Few Human Annotationscited by 1
- 2024Text2Data: Low-Resource Data Generation with Textual Controlcited by 1
- 2024TIPAA-SSL: Text Independent Phone-to-Audio Alignment based on Self-Supervised Learning and Knowledge Transfercited by 0
- 2026LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgishcited by 0
- 2026LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish30 Jun 2026
- 2025Integrating Feedback Loss from Bi-modal Sarcasm Detector for Sarcastic Speech Synthesis18 Aug 2025
- 2024A Review of Human Emotion Synthesis Based on Generative Technology10 Dec 2024
- 2024Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotions25 Sep 2024
- 2024A multilingual training strategy for low resource Text to Speech2 Sep 2024
- 2024TIPAA-SSL: Text Independent Phone-to-Audio Alignment based on Self-Supervised Learning and Knowledge Transfer3 May 2024
- 2024Text2Data: Low-Resource Data Generation with Textual Control8 Feb 2024
- 2023Expressive TTS Driven by Natural Language Prompts Using Few Human Annotations2 Nov 2023
- 2023MUST&P-SRL: Multi-lingual and Unified Syllabification in Text and Phonetic Domains for Speech Representation Learning17 Oct 2023
- 2023Comparative Analysis of Transfer Learning in Deep Learning Text-to-Speech Models on a Few-Shot, Low-Resource, Customized Dataset8 Oct 2023
- 2023DurIAN-E: Duration Informed Attention Network For Expressive Text-to-Speech Synthesis22 Sep 2023
- 2023Flowchase: a Mobile Application for Pronunciation Training5 Jul 2023
9 more
- 2022Low-Resource End-to-end Sanskrit TTS using Tacotron2, WaveGlow and Transfer Learning7 Dec 2022
- 2022Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representations11 Nov 2022
- 2022Speech Synthesis with Mixed Emotions11 Aug 2022
- 2022Controllable Data Generation by Deep Learning: A Review19 Jul 2022
- 2022Cross-Speaker Emotion Transfer for Low-Resource Text-to-Speech Using Non-Parallel Voice Conversion with Pitch-Shift Data Augmentation21 Apr 2022
- 2022Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethics17 Mar 2022
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speech24 Jun 2021
- 2021Emotional Voice Conversion: Theory, Databases and ESD31 May 2021
- 2021Machine learning on small size samples: A synthetic knowledge synthesis1 Mar 2021
- 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 113
- 2022Speech Synthesis with Mixed Emotionscited by 28
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speechcited by 14
- 2021Machine learning on small size samples: A synthetic knowledge synthesiscited by 11
- 2022Cross-Speaker Emotion Transfer for Low-Resource Text-to-Speech Using Non-Parallel Voice Conversion with Pitch-Shift Data Augmentationcited by 8
- 2024Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotionscited by 8
- 2024A Review of Human Emotion Synthesis Based on Generative Technologycited by 7
- 2024A multilingual training strategy for low resource Text to Speechcited by 3
- 2022Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representationscited by 2
- 2022Low-Resource End-to-end Sanskrit TTS using Tacotron2, WaveGlow and Transfer Learningcited by 2
- 2023Flowchase: a Mobile Application for Pronunciation Trainingcited by 2
12 most cited of 20 All 20 (JSON)
- 2026LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish30 Jun 2026
- 2025Integrating Feedback Loss from Bi-modal Sarcasm Detector for Sarcastic Speech Synthesis18 Aug 2025
- 2024A Review of Human Emotion Synthesis Based on Generative Technology10 Dec 2024
- 2024Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotions25 Sep 2024
- 2024A multilingual training strategy for low resource Text to Speech2 Sep 2024
- 2024TIPAA-SSL: Text Independent Phone-to-Audio Alignment based on Self-Supervised Learning and Knowledge Transfer3 May 2024
- 2024Text2Data: Low-Resource Data Generation with Textual Control8 Feb 2024
- 2023Expressive TTS Driven by Natural Language Prompts Using Few Human Annotations2 Nov 2023
- 2023MUST&P-SRL: Multi-lingual and Unified Syllabification in Text and Phonetic Domains for Speech Representation Learning17 Oct 2023
- 2023Comparative Analysis of Transfer Learning in Deep Learning Text-to-Speech Models on a Few-Shot, Low-Resource, Customized Dataset8 Oct 2023
- 2023Flowchase: a Mobile Application for Pronunciation Training5 Jul 2023
- 2022Low-Resource End-to-end Sanskrit TTS using Tacotron2, WaveGlow and Transfer Learning7 Dec 2022
12 newest of 20 All 20 (JSON)