mlsanityData to 14 Oct 2026

Closing the Quality Gap in Low-Resource Text-to-Speech: LoRA Fine-Tuning of VoxCPM2 for Khmer and Korean

arXiv 2606.26618 ↗First posted 25 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large pretrained text-to-speech (TTS) models sound almost human for well-resourced languages, but much worse for languages that are rare in their training data. We study this quality gap for Khmer and Korean using VoxCPM2, a 2.4B parameter, tokenizer-free TTS model that joins a MiniCPM-4 language-model backbone with a flow-matching diffusion decoder. We build one shared, language-tagged corpus of 25.5 hours after cleaning and adapt VoxCPM2 with a single Low-Rank Adaptation (LoRA) adapter, trained on both languages at once and added to both the language model and the decoder. The adapter is zero-initialized, so training starts exactly at the original zero-shot model. In native-speaker listening tests, the Khmer Mean Opinion Score (MOS) rises from 3.85 to 4.23 with the best adapter, rank 64. This gain is highly significant under a paired Wilcoxon test with p < 0.001, and it is achieved while training only 0.19 to 3.03 percent of the parameters. Two findings stand out. First, the training loss and human ratings disagree on the best rank. The loss is lowest at rank 128, but MOS peaks at rank 64. Second, the same adapter gives no significant gain for Korean, which the base model already covers well, and a high rank even hurts quality. This shows that adaptation helps mainly where the base model is truly weak.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 21 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

20 of 21 references.

References · 20

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  5. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 804
  6. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  7. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
  8. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
  9. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  10. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  11. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  12. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
8 more
  1. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
  2. 2018Neural Voice Cloning with a Few Samplescited by 100
  3. 2021AdaSpeech: Adaptive Text to Speech for Custom Voicecited by 98
  4. 2025MiniCPM4: Ultra-Efficient LLMs on End Devicescited by 52
  5. 2025VoxCPM: Tokenizer-Free TTS for Context-Aware Speech Generation and True-to-Life Voice Cloningcited by 42
  6. 2022Exploring Efficient-tuning Methods in Self-supervised Speech Modelscited by 26
  7. 2026VoxCPM2 Technical Reportcited by 17
  8. 2021Joint Khmer Word Segmentation and Part-of-Speech Tagging Using Deep Learningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs
  2. 2024ELAICHI: Enhancing Low-resource TTS by Addressing Infrequent and Low-frequency Character Bigrams
  3. 2026Benchmarking Linguistic Adaptation in Comparable-Sized LLMs: A Study of Llama-3.1-8B, Mistral-7B-v0.1, and Qwen3-8B on Romanized Nepali
  4. 2026When Fine-Tuning Fails and when it Generalises: Role of Data Diversity and Mixed Training in LLM-based TTS
  5. 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimization
  6. 2026Raon-OpenTTS: Open Models and Data for Robust Text-to-Speech ↗
  7. 2026Efficiently Adapting Spoken Language Models for the Singaporean Context
  8. 2025Vox-Evaluator: Enhancing Stability and Fidelity for Zero-shot TTS with A Multi-Level Evaluator