mlsanityData to 14 Oct 2026

The Zero Resource Speech Challenge 2020: Discovering discrete subword and word units

arXiv 2010.05967 ↗First posted 12 Oct 2020cs.CL cs.AIcited by 39

Not on the map. Why?

Abstract (arXiv)

We present the Zero Resource Speech Challenge 2020, which aims at learning speech representations from raw audio signals without any labels. It combines the data sets and metrics from two previous benchmarks (2017 and 2019) and features two tasks which tap into two levels of speech representation. The first task is to discover low bit-rate subword representations that optimize the quality of speech synthesis; the second one is to discover word-like units from unsegmented raw speech. We present the results of the twenty submitted models and discuss the implications of the main findings for unsupervised speech learning.

Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 12; 2022: 12; 2023: 4; 2024: 5; 2025: 3; 2026: 3.

39 papers.

Sort:

  1. 2021Generative Spoken Language Modeling from Raw Audiocited by 340
  2. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
  3. 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
  4. 2023What Do Self-Supervised Speech Models Know About Words?cited by 64
  5. 2021The Zero Resource Speech Challenge 2021: Spoken language modellingcited by 47
  6. 2025Recent Advances in Discrete Speech Tokens: A Reviewcited by 43
  7. 2024A Large-Scale Evaluation of Speech Foundation Modelscited by 40
  8. 2022Self-supervised language learning from raw audio: Lessons from the Zero Resource Speech Challengecited by 34
  9. 2022textless-lib: a Library for Textless Spoken Language Processingcited by 28
  10. 2022SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learningcited by 26
  11. 2022Word Segmentation on Discovered Phone Units with Dynamic Programming and Self-Supervised Scoringcited by 24
  12. 2022DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexiconcited by 12
27 more
  1. 2021A Masked Segmental Language Model for Unsupervised Natural Language Segmentationcited by 9
  2. 2022A Brief Overview of Unsupervised Neural Speech Representation Learningcited by 9
  3. 2021Double Articulation Analyzer with Prosody for Unsupervised Word and Phoneme Discoverycited by 7
  4. 2022Speech Sequence Embeddings using Nearest Neighbors Contrastive Learningcited by 7
  5. 2024Unsupervised Word Discovery: Boundary Detection with Clustering vs. Dynamic Programmingcited by 7
  6. 2021Interpreting intermediate convolutional layers of generative CNNs trained on waveformscited by 6
  7. 2021A phonetic model of non-native spoken word processingcited by 5
  8. 2021Unsupervised Automatic Speech Recognition: A Reviewcited by 5
  9. 2023Exploring How Generative Adversarial Networks Learn Phonological Representationscited by 4
  10. 2025Should Top-Down Clustering Affect Boundaries in Unsupervised Word Discovery?cited by 4
  11. 2021Discrete representations in neural models of spoken languagecited by 3
  12. 2022VQ-T: RNN Transducers using Vector-Quantized Prediction Network Statescited by 3
  13. 2024Revisiting speech segmentation and lexicon learning with better featurescited by 3
  14. 2024Do Discrete Self-Supervised Representations of Speech Capture Tone Distinctions?cited by 3
  15. 2021Unsupervised Acoustic Unit Discovery by Leveraging a Language-Independent Subword Discriminative Feature Representationcited by 2
  16. 2021Unsupervised Word Segmentation from Discrete Speech Units in Low-Resource Settingscited by 2
  17. 2022Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddingscited by 2
  18. 2023ZRIGF: An Innovative Multimodal Framework for Zero-Resource Image-Grounded Dialogue Generationcited by 2
  19. 2021Shennong: a Python toolbox for audio speech features extractioncited by 1
  20. 2022A Temporal Extension of Latent Dirichlet Allocation for Unsupervised Acoustic Unit Discoverycited by 1
  21. 2022Learning Phone Recognition from Unpaired Audio and Phone Sequences Based on Generative Adversarial Networkcited by 1
  22. 2023Representation Learning With Hidden Unit Clustering For Low Resource Speech Applicationscited by 1
  23. 2024Analytic Study of Text-Free Speech Synthesis for Raw Audio using a Self-Supervised Learning Modelcited by 1
  24. 2025Pitch Accent Detection improves Pretrained Automatic Speech Recognitioncited by 1
  25. 2026Revisiting Lexicon Evaluation in Unsupervised Word Discoverycited by 1
  26. 2026Recovering the Zipfian Distribution in Unsupervised Term Discoverycited by 0
  27. 2026Benchmarking_Fast_Domain_Adaptation_for_Unsupervised_Speech_Unitscited by 0