End-to-end Text-to-speech for Low-resource Languages by Cross-Lingual Transfer Learning
Not on the map. Why?
Abstract (arXiv)
End-to-end text-to-speech (TTS) has shown great success on large quantities of paired text plus speech data. However, laborious data collection remains difficult for at least 95% of the languages over the world, which hinders the development of TTS in different languages. In this paper, we aim to build TTS systems for such low-resource (target) languages where only very limited paired data are available. We show such TTS can be effectively constructed by transferring knowledge from a high-resource (source) language. Since the model trained on source language cannot be directly applied to target language due to input space mismatch, we propose a method to learn a mapping between source and target linguistic symbols. Benefiting from this learned mapping, pronunciation information can be preserved throughout the transferring procedure. Preliminary experiments show that we only need around 15 minutes of paired data to obtain a relatively good TTS system. Furthermore, analytic studies demonstrated that the automatically discovered mapping correlate well with the phonetic expertise.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 4; 2024: 6; 2025: 2; 2026: 1.
30 papers.
Sort:
By area:
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2022Towards Building Text-To-Speech Systems for the Next Billion Userscited by 27
- 2022Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Featurescited by 20
- 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTScited by 15
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speechcited by 14
- 2021Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesiscited by 13
- 2021KazakhTTS: An Open-Source Kazakh Text-to-Speech Synthesis Datasetcited by 13
- 2022KazakhTTS2: Extending the Open-Source Kazakh TTS Corpus With More Data, Speakers, and Topicscited by 10
- 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languagescited by 9
- 2022Voice Filter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing modulecited by 8
- 2022Improved Meta Learning for Low Resource Speech Recognitioncited by 7
- 2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
18 more
- 2022Distribution augmentation for low-resource expressive text-to-speechcited by 5
- 2022Unify and Conquer: How Phonetic Feature Representation Affects Polyglot Text-To-Speech (TTS)cited by 5
- 2023Unsupervised Data Selection for TTS: Using Arabic Broadcast News as a Case Studycited by 4
- 2024Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuningcited by 3
- 2024A multilingual training strategy for low resource Text to Speechcited by 3
- 2025Zero-Shot Text-to-Speech for Vietnamesecited by 3
- 2021Towards Lifelong Learning of Multilingual Text-To-Speech Synthesiscited by 2
- 2022MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied Baselinecited by 2
- 2023Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliterationcited by 2
- 2023Strategies in Transfer Learning for Low-Resource Speech Synthesis: Phone Mapping, Features Input, and Source Language Selectioncited by 2
- 2022Few-Shot Cross-Lingual TTS Using Transferable Phoneme Embeddingcited by 1
- 2022Towards High-Quality Neural TTS for Low-Resource Languages by Learning Compact Speech Representationscited by 1
- 2024Text2Data: Low-Resource Data Generation with Textual Controlcited by 1
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimizationcited by 1
- 2023The Effects of Input Type and Pronunciation Dictionary Usage in Transfer Learning for Low-Resource Text-to-Speechcited by 0
- 2024Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initializationcited by 0
- 2024LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Modelscited by 0
- 2026LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgishcited by 0
- 2026LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish30 Jun 2026
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimization26 Sep 2025
- 2025Zero-Shot Text-to-Speech for Vietnamese2 Jun 2025
- 2024LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models20 Nov 2024
- 2024A multilingual training strategy for low resource Text to Speech2 Sep 2024
- 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languages10 Jun 2024
- 2024Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuning11 Mar 2024
- 2024Text2Data: Low-Resource Data Generation with Textual Control8 Feb 2024
- 2024Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization23 Jan 2024
- 2023Strategies in Transfer Learning for Low-Resource Speech Synthesis: Phone Mapping, Features Input, and Source Language Selection21 Jun 2023
- 2023The Effects of Input Type and Pronunciation Dictionary Usage in Transfer Learning for Low-Resource Text-to-Speech1 Jun 2023
- 2023Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliteration25 May 2023
18 more
- 2023Unsupervised Data Selection for TTS: Using Arabic Broadcast News as a Case Study22 Jan 2023
- 2022Towards Building Text-To-Speech Systems for the Next Billion Users17 Nov 2022
- 2022Towards High-Quality Neural TTS for Low-Resource Languages by Learning Compact Speech Representations27 Oct 2022
- 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTS21 Oct 2022
- 2022MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied Baseline22 Sep 2022
- 2022Unify and Conquer: How Phonetic Feature Representation Affects Polyglot Text-To-Speech (TTS)4 Jul 2022
- 2022Few-Shot Cross-Lingual TTS Using Transferable Phoneme Embedding27 Jun 2022
- 2022Improved Meta Learning for Low Resource Speech Recognition11 May 2022
- 2022Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Features7 Mar 2022
- 2022Voice Filter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing module16 Feb 2022
- 2022Distribution augmentation for low-resource expressive text-to-speech13 Feb 2022
- 2022KazakhTTS2: Extending the Open-Source Kazakh TTS Corpus With More Data, Speakers, and Topics15 Jan 2022
- 2021Towards Lifelong Learning of Multilingual Text-To-Speech Synthesis9 Oct 2021
- 2021A Survey on Neural Speech Synthesis29 Jun 2021
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speech24 Jun 2021
- 2021Review of end-to-end speech synthesis technology based on deep learning20 Apr 2021
- 2021KazakhTTS: An Open-Source Kazakh Text-to-Speech Synthesis Dataset17 Apr 2021
- 2021Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesis5 Mar 2021
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2022Towards Building Text-To-Speech Systems for the Next Billion Userscited by 27
- 2022Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Featurescited by 20
- 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTScited by 15
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speechcited by 14
- 2021Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesiscited by 13
- 2021KazakhTTS: An Open-Source Kazakh Text-to-Speech Synthesis Datasetcited by 13
- 2022KazakhTTS2: Extending the Open-Source Kazakh TTS Corpus With More Data, Speakers, and Topicscited by 10
- 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languagescited by 9
- 2022Voice Filter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing modulecited by 8
- 2022Improved Meta Learning for Low Resource Speech Recognitioncited by 7
- 2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
12 most cited of 29 All 29 (JSON)
- 2026LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish30 Jun 2026
- 2025Zero-Shot Text-to-Speech for Vietnamese2 Jun 2025
- 2024LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models20 Nov 2024
- 2024A multilingual training strategy for low resource Text to Speech2 Sep 2024
- 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languages10 Jun 2024
- 2024Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuning11 Mar 2024
- 2024Text2Data: Low-Resource Data Generation with Textual Control8 Feb 2024
- 2024Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization23 Jan 2024
- 2023Strategies in Transfer Learning for Low-Resource Speech Synthesis: Phone Mapping, Features Input, and Source Language Selection21 Jun 2023
- 2023The Effects of Input Type and Pronunciation Dictionary Usage in Transfer Learning for Low-Resource Text-to-Speech1 Jun 2023
- 2023Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliteration25 May 2023
- 2023Unsupervised Data Selection for TTS: Using Arabic Broadcast News as a Case Study22 Jan 2023
12 newest of 29 All 29 (JSON)