mlsanityData to 14 Oct 2026

Structure Before Sampling: Community-Aware Core-Set Selection for Data-Efficient Text-to-Speech

arXiv 2609.24275 ↗First posted 21 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-speech (TTS) corpora are costly to record, yet many utterances add little new phonetic information. Core-set selection reduces this cost by choosing a small training subset under a fixed audio-duration budget. We represent a corpus as a phonotactic graph that links each utterance to its most phonemically similar ones, and we first test whether this graph has structure. In Bangla and English corpora, its clustering is 199 and 56 times that of a size-matched random graph, and its modularity is more than twice that of a degree-preserving random graph. We then propose Community Representative, a selector that samples across graph communities and spreads its choices within each one, starting from utterances rich in rare phonemes. At every budget and in both languages, it covers more rare phoneme bigrams than random and entropy-based selection, and this lead holds on held-out utterances. TTS models trained on its 20% core-sets have a significantly lower character error rate (CER) than models trained on equal-duration random or entropy-based subsets in both languages. When all models train for the same number of epochs, the Bangla core-set model also outperforms full-corpus training (3.93% vs. 4.47% CER) with 4.5x less training time.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

10 of 26 references.

References · 10

  1. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  2. 2021Deduplicating Training Data Makes Language Models Bettercited by 714
  3. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  4. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  5. 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
  6. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
  7. 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 303
  8. 2022Coverage-centric Coreset Selection for High Pruning Ratescited by 117
  9. 2023D2 Pruning: Message Passing for Balancing Diversity and Difficulty in Data Pruningcited by 69
  10. 2023Diversity-based core-set selection for text-to-speech with linguistic and acoustic featurescited by 4

Built on by

Not cited yet.