mlsanityData to 7 Oct 2026

The Zero Resource Speech Challenge 2019: TTS without T

arXiv 1904.11469 ↗First posted 25 Apr 2019cs.CL cs.SD eess.AScited by 38

Not on the map. Why?

Abstract (arXiv)

We present the Zero Resource Speech Challenge 2019, which proposes to build a speech synthesizer without any text or phonetic labels: hence, TTS without T (text-to-speech without text). We provide raw audio for a target voice in an unknown language (the Voice dataset), but no alignment, text or labels. Participants must discover subword units in an unsupervised way (using the Unit Discovery dataset) and align them to the voice recordings in a way that works best for the purpose of synthesizing novel utterances from novel speakers, similar to the target speaker's voice. We describe the metrics used for evaluation, a baseline system consisting of unsupervised subword unit discovery plus a standard TTS system, and a topline TTS using gold phoneme transcriptions. We present an overview of the 19 submitted systems from 10 teams and discuss the main results.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 14; 2022: 12; 2023: 4; 2024: 2; 2025: 4; 2026: 2.

38 papers.

Sort:

  1. 2021Generative Spoken Language Modeling from Raw Audiocited by 336
  2. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
  3. 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
  4. 2024Recent Advances in Speech Language Models: A Surveycited by 85
  5. 2022SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantizationcited by 68
  6. 2021The Zero Resource Speech Challenge 2021: Spoken language modellingcited by 47
  7. 2022Self-supervised language learning from raw audio: Lessons from the Zero Resource Speech Challengecited by 34
  8. 2021Visually grounded models of spoken language: A survey of datasets, architectures and evaluation techniquescited by 32
  9. 2021Segmental Contrastive Predictive Coding for Unsupervised Word Segmentationcited by 32
  10. 2022textless-lib: a Library for Textless Spoken Language Processingcited by 28
  11. 2022Word Segmentation on Discovered Phone Units with Dynamic Programming and Self-Supervised Scoringcited by 24
  12. 2021Acoustic word embeddings for zero-resource languages using self-supervised contrastive learning and multilingual adaptationcited by 19
26 more
  1. 2023Generative Spoken Language Model based on continuous word-sized audio tokenscited by 19
  2. 2023DUB: Discrete Unit Back-translation for Speech Translationcited by 18
  3. 2022KazakhTTS2: Extending the Open-Source Kazakh TTS Corpus With More Data, Speakers, and Topicscited by 10
  4. 2022A Brief Overview of Unsupervised Neural Speech Representation Learningcited by 9
  5. 2025fastabx: A library for efficient computation of ABX discriminabilitycited by 7
  6. 2025Low-Resource Domain Adaptation for Speech LLMs via Text-Only Fine-Tuningcited by 7
  7. 2021ZR-2021VG: Zero-Resource Speech Challenge, Visually-Grounded Language Modelling track, 2021 editioncited by 6
  8. 2021Protecting gender and identity with disentangled speech representationscited by 5
  9. 2021Unsupervised Automatic Speech Recognition: A Reviewcited by 5
  10. 2022Self-supervised speech unit discovery from articulatory and acoustic features using VQ-VAEcited by 5
  11. 2026An Empirical Recipe for Universal Phone Recognitioncited by 5
  12. 2023Exploring How Generative Adversarial Networks Learn Phonological Representationscited by 4
  13. 2025Should Top-Down Clustering Affect Boundaries in Unsupervised Word Discovery?cited by 4
  14. 2021Discrete representations in neural models of spoken languagecited by 3
  15. 2022Repeat after me: Self-supervised learning of acoustic-to-articulatory mapping by vocal imitationcited by 3
  16. 2024A multilingual training strategy for low resource Text to Speechcited by 3
  17. 2025Breaking the Transcription Bottleneck: Fine-tuning ASR Models for Extremely Low-Resource Fieldwork Languagescited by 3
  18. 2021Unsupervised Acoustic Unit Discovery by Leveraging a Language-Independent Subword Discriminative Feature Representationcited by 2
  19. 2021Unsupervised Word Segmentation from Discrete Speech Units in Low-Resource Settingscited by 2
  20. 2022Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddingscited by 2
  21. 2022A Temporal Extension of Latent Dirichlet Allocation for Unsupervised Acoustic Unit Discoverycited by 1
  22. 2022Learning Phone Recognition from Unpaired Audio and Phone Sequences Based on Generative Adversarial Networkcited by 1
  23. 2021Voice Conversion Based Speaker Normalization for Acoustic Unit Discoverycited by 0
  24. 2021Preliminary study on using vector quantization latent spaces for TTS/VC systems with consistent performancecited by 0
  25. 2023Progressive distillation diffusion for raw music generationcited by 0
  26. 2026On the Effect of Segmentation Width and Cluster Size on Speech Resynthesis and Continuation in Generative Spoken Language Modelscited by 0