mlsanityData to 7 Oct 2026

Revisiting IPA-based Cross-lingual Text-to-speech

arXiv 2110.07187 ↗First posted 14 Oct 2021cs.CL cs.SD eess.AScited by 4

Not on the map. Why?

Abstract (arXiv)

International Phonetic Alphabet (IPA) has been widely used in cross-lingual text-to-speech (TTS) to achieve cross-lingual voice cloning (CL VC). However, IPA itself has been understudied in cross-lingual TTS. In this paper, we report some empirical findings of building a cross-lingual TTS model using IPA as inputs. Experiments show that the way to process the IPA and suprasegmental sequence has a negligible impact on the CL VC performance. Furthermore, we find that using a dataset including one speaker per language to build an IPA-based TTS system would fail CL VC since the language-unique IPA and tone/stress symbols could leak the speaker information. In addition, we experiment with different combinations of speakers in the training dataset to further investigate the effect of the number of speakers on the CL VC performance.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 14 Oct 2021.

Builds on

13 of 28 references.

References · 13

  1. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  2. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  3. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  4. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  5. 2017Generalized End-to-End Loss for Speaker Verificationcited by 290
  6. 2018Efficient Neural Audio Synthesiscited by 218
  7. 2017Parallel WaveNet: Fast High-Fidelity Speech Synthesiscited by 214
  8. 2019Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloningcited by 66
  9. 2021Hi-Fi Multi-Speaker English TTS Datasetcited by 60
  10. 2018Bytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytescited by 54
  11. 2020One Model, Many Languages: Meta-learning for Multilingual Text-to-Speechcited by 28
  12. 2020Phonological Features for 0-shot Multilingual Speech Synthesiscited by 20
1 more
  1. 2019Building a mixed-lingual neural TTS system with only monolingual datacited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 0; 2024: 0; 2025: 1; 2026: 2.

4 papers.

  1. 2022Unify and Conquer: How Phonetic Feature Representation Affects Polyglot Text-To-Speech (TTS)cited by 5
  2. 2026X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloningcited by 4
  3. 2025Generalized Multilingual Text-to-Speech Generation with Language-Aware Style Adaptationcited by 3
  4. 2026BanglaIPA: Towards Robust Text-to-IPA Transcription with Contextual Rewriting in Bengalicited by 2