LLM-to-Speech: A Synthetic Data Pipeline for Training Dialectal Text-to-Speech Models
On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation
Abstract (arXiv)
Despite the advances in neural text to speech (TTS), many Arabic dialectal varieties remain marginally addressed, with most resources concentrated on Modern Spoken Arabic (MSA) and Gulf dialects, leaving Egyptian Arabic -- the most widely understood Arabic dialect -- severely under-resourced. We address this gap by introducing NileTTS: 38 hours of transcribed speech from two speakers across diverse domains including medical, sales, and general conversations. We construct this dataset using a novel synthetic pipeline: large language models (LLM) generate Egyptian Arabic content, which is then converted to natural speech using audio synthesis tools, followed by automatic transcription and speaker diarization with manual quality verification. We fine-tune XTTS v2, a state-of-the-art multilingual TTS model, on our dataset and evaluate against the baseline model trained on other Arabic dialects. Our contributions include: (1) the first publicly available Egyptian Arabic TTS dataset, (2) a reproducible synthetic data generation pipeline for dialectal TTS, and (3) an open-source fine-tuned model. All resources are released to advance Egyptian Arabic speech synthesis research.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 7 of its 12 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
7 of 12 references.
References · 7
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
- 2021SynthASR: Unlocking Synthetic Data for Speech Recognitioncited by 34
- 2024Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challengescited by 30
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Nile-Chat: Egyptian Language Models for Arabic and Latin Scripts
- 2025NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communities
- 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Models
- 2025Advancing Dialectal Arabic to Modern Standard Arabic Machine Translation
- 2025UI-Level Evaluation of ALLaM 34B: Measuring an Arabic-Centric LLM via HUMAIN Chat
- 2026Dziri Voicebot: An End-to-End Low-Resource Speech-to-Speech Conversational System for Algerian Dialect
- 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues
- 2025Mind the Gap: A Review of Arabic Post-Training Datasets and Their Limitations