Unsupervised Polyglot Text To Speech
Not on the map. Why?
Abstract (arXiv)
We present a TTS neural network that is able to produce speech in multiple languages. The proposed network is able to transfer a voice, which was presented as a sample in a source language, into one of several target languages. Training is done without using matching or parallel data, i.e., without samples of the same speaker in multiple languages, making the method much more applicable. The conversion is based on learning a polyglot network that has multiple per-language sub-networks and adding loss terms that preserve the speaker's identity in multiple languages. We evaluate the proposed polyglot neural network for three languages with a total of more than 400 speakers and demonstrate convincing conversion capabilities.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 3; 2024: 0; 2025: 1.
10 papers.
- 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
- 2021Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesiscited by 13
- 2022Cross-Lingual Text-to-Speech Using Multi-Task Learning and Speaker Classifier Joint Trainingcited by 7
- 2022Unify and Conquer: How Phonetic Feature Representation Affects Polyglot Text-To-Speech (TTS)cited by 5
- 2022Mix and Match: An Empirical Study on Training Corpus Composition for Polyglot Text-To-Speech (TTS)cited by 4
- 2023Multilingual Multiaccented Multispeaker TTS with RADTTScited by 2
- 2022Improve Bilingual TTS Using Dynamic Language and Phonology Embeddingcited by 1
- 2022Data-augmented cross-lingual synthesis in a teacher-student frameworkcited by 0
- 2023Cross-lingual Knowledge Distillation via Flow-based Voice Conversion for Robust Polyglot Text-To-Speechcited by 0
- 2025Unseen Speaker and Language Adaptation for Lightweight Text-To-Speech with Adapterscited by 0
- 2025Unseen Speaker and Language Adaptation for Lightweight Text-To-Speech with Adapters25 Aug 2025
- 2023Cross-lingual Knowledge Distillation via Flow-based Voice Conversion for Robust Polyglot Text-To-Speech15 Sep 2023
- 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling7 Mar 2023
- 2023Multilingual Multiaccented Multispeaker TTS with RADTTS24 Jan 2023
- 2022Improve Bilingual TTS Using Dynamic Language and Phonology Embedding7 Dec 2022
- 2022Unify and Conquer: How Phonetic Feature Representation Affects Polyglot Text-To-Speech (TTS)4 Jul 2022
- 2022Mix and Match: An Empirical Study on Training Corpus Composition for Polyglot Text-To-Speech (TTS)4 Jul 2022
- 2022Data-augmented cross-lingual synthesis in a teacher-student framework31 Mar 2022
- 2022Cross-Lingual Text-to-Speech Using Multi-Task Learning and Speaker Classifier Joint Training20 Jan 2022
- 2021Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesis5 Mar 2021