mlsanityData to 14 Oct 2026

Empowering Global Voices: A Data-Efficient, Phoneme-Tone Adaptive Approach to High-Fidelity Speech Synthesis

arXiv 2504.07858 ↗First posted 10 Apr 2025cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-speech (TTS) technology has achieved impressive results for widely spoken languages, yet many under-resourced languages remain challenged by limited data and linguistic complexities. In this paper, we present a novel methodology that integrates a data-optimized framework with an advanced acoustic model to build high-quality TTS systems for low-resource scenarios. We demonstrate the effectiveness of our approach using Thai as an illustrative case, where intricate phonetic rules and sparse resources are effectively addressed. Our method enables zero-shot voice cloning and improved performance across diverse client applications, ranging from finance to healthcare, education, and law. Extensive evaluations - both subjective and objective - confirm that our model meets state-of-the-art standards, offering a scalable solution for TTS production in data-limited settings, with significant implications for broader industry adoption and multilingual accessibility.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 10 Apr 2025.

Builds on

23 of 41 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
  4. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  5. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  6. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  7. 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
  8. 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
  9. 2024BASE TTS: Lessons from building a billion-parameter Text-to-Speech model on 100K hours of datacited by 75
  10. 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 60
  11. 2020LRSpeech: Extremely Low-Resource Speech Synthesis and Recognitioncited by 43
  12. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
11 more
  1. 2023PyThaiNLP: Thai Natural Language Processing in Pythoncited by 28
  2. 2021WangchanBERTa: Pretraining transformer-based Thai Language Modelscited by 26
  3. 2024Unraveling the Mystery of Scaling Laws: Part Icited by 24
  4. 2023Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictionscited by 23
  5. 2019JVS corpus: free Japanese multi-speaker voice corpuscited by 22
  6. 2022Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Surveycited by 14
  7. 2022MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languagescited by 13
  8. 2024Typhoon 2: A Family of Open Text and Multimodal Thai Large Language Modelscited by 12
  9. 2023xPQA: Cross-Lingual Product Question Answering across 12 Languagescited by 10
  10. 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languagescited by 9
  11. 2021RNNoise-Ex: Hybrid Speech Enhancement System based on RNN and Spectral Featurescited by 1

Built on by

Not cited yet.