mlsanityData to 7 Oct 2026

Bahasa Harmony: A Comprehensive Dataset for Bahasa Text-to-Speech Synthesis with Discrete Codec Modeling of EnGen-TTS

arXiv 2410.06608 ↗First posted 9 Oct 2024cs.SD cs.AI eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

This research introduces a comprehensive Bahasa text-to-speech (TTS) dataset and a novel TTS model, EnGen-TTS, designed to enhance the quality and versatility of synthetic speech in the Bahasa language. The dataset, spanning textasciitilde55.0 hours and 52K audio recordings, integrates diverse textual sources, ensuring linguistic richness. A meticulous recording setup captures the nuances of Bahasa phonetics, employing professional equipment to ensure high-fidelity audio samples. Statistical analysis reveals the dataset's scale and diversity, laying the foundation for model training and evaluation. The proposed EnGen-TTS model performs better than established baselines, achieving a Mean Opinion Score (MOS) of 4.45 ± 0.13. Additionally, our investigation on real-time factor and model size highlights EnGen-TTS as a compelling choice, with efficient performance. This research marks a significant advancement in Bahasa TTS technology, with implications for diverse language applications. Link to Generated Samples: urlhttps://bahasa-harmony-comp.vercel.app/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 9 Oct 2024.

Builds on

20 of 28 references.

References · 20

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  2. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  3. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  4. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  5. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  6. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  7. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
  8. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
  9. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
  10. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
  11. 2017Generalized End-to-End Loss for Speaker Verificationcited by 290
  12. 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 269
8 more
  1. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
  2. 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
  3. 2022NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Qualitycited by 151
  4. 2020FastPitch: Parallel Text-to-speech with Pitch Predictioncited by 150
  5. 2021UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generationcited by 71
  6. 2024CLaM-TTS: Improving Neural Codec Language Model for Zero-Shot Text-to-Speechcited by 37
  7. 2022Towards Building Text-To-Speech Systems for the Next Billion Userscited by 27
  8. 2021VAENAR-TTS: Variational Auto-Encoder based Non-AutoRegressive Text-to-Speech Synthesiscited by 7

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidancecited by 26