mlsanityData to 7 Oct 2026

textless-lib: a Library for Textless Spoken Language Processing

arXiv 2202.07359 ↗First posted 15 Feb 2022cs.CL cs.LG cs.SDcited by 28

Not on the map. Why?

Abstract (arXiv)

Textless spoken language processing research aims to extend the applicability of standard NLP toolset onto spoken language and languages with few or no textual resources. In this paper, we introduce textless-lib, a PyTorch-based library aimed to facilitate research in this research area. We describe the building blocks that the library provides and demonstrate its usability by discuss three different use-case examples: (i) speaker probing, (ii) speech resynthesis and compression, and (iii) speech continuation. We believe that textless-lib substantially simplifies research the textless setting and will be handful not only for speech researchers but also for the NLP community at large. The code, documentation, and pre-trained models are available at https://github.com/facebookresearch/textlesslib/ .

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 15 Feb 2022.

Builds on

39 of 52 references.

References · 39

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  7. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  8. 2018Deep contextualized word representationscited by 2,285
  9. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  10. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  11. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  12. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
27 more
  1. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  2. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  3. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  4. 2018What you can cram into a single vector: Probing sentence embeddings for linguistic propertiescited by 452
  5. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
  6. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 340
  7. 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
  8. 2021Generative Spoken Language Modeling from Raw Audiocited by 336
  9. 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 308
  10. 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
  11. 2016Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Taskscited by 216
  12. 2021SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processingcited by 177
  13. 2021Direct speech-to-speech translation with discrete unitscited by 148
  14. 2021Textless Speech-to-Speech Translation on Real Datacited by 121
  15. 2021Text-Free Prosody-Aware Generative Spoken Language Modelingcited by 119
  16. 2018CREPE: A Convolutional Representation for Pitch Estimationcited by 109
  17. 2020The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modelingcited by 100
  18. 2021UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Datacited by 76
  19. 2020Data Augmenting Contrastive Learning of Speech Representations in the Time Domaincited by 63
  20. 2020The Zero Resource Speech Challenge 2020: Discovering discrete subword and word unitscited by 39
  21. 2019The Zero Resource Speech Challenge 2019: TTS without Tcited by 38
  22. 2021Chunked Autoregressive GAN for Conditional Waveform Synthesiscited by 38
  23. 2021Analyzing Speaker Information in Self-Supervised Models to Improve Zero-Resource Speech Processingcited by 26
  24. 2021Aligned Contrastive Predictive Codingcited by 15
  25. 2021Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problemcited by 11
  26. 2018To Reverse the Gradient or Not: An Empirical Comparison of Adversarial and Multi-task Learning in Speech Recognitioncited by 10
  27. 2021Discrete representations in neural models of spoken languagecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 8; 2024: 7; 2025: 5; 2026: 1.

28 papers.

Sort:

By area:

  1. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  2. 2022AudioGen: Textually Guided Audio Generationcited by 292
  3. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
  4. 2025On The Landscape of Spoken Language Models: A Comprehensive Surveycited by 116
  5. 2023Textually Pretrained Speech Language Modelscited by 99
  6. 2023EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesiscited by 93
  7. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
  8. 2024A Comprehensive Review of Multimodal Large Language Models: Performance and Challenges Across Different Taskscited by 57
  9. 2023Analysing Discrete Self Supervised Speech Representation for Spoken Language Modelingcited by 47
  10. 2023Make-A-Voice: Unified Voice Synthesis With Discrete Representationcited by 27
  11. 2022Are discrete units necessary for Spoken Language Modeling?cited by 24
  12. 2022Augmentation Invariant Discrete Representation for Generative Spoken Language Modelingcited by 17
16 more
  1. 2023UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Datacited by 15
  2. 2024SpeechPrompt: Prompting Speech Language Models for Speech Processing Taskscited by 12
  3. 2024LAST: Language Model Aware Speech Tokenizationcited by 9
  4. 2022Disentangling Prosody Representations with Unsupervised Speech Reconstructioncited by 8
  5. 2023Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Targetcited by 6
  6. 2022A Textless Metric for Speech-to-Speech Comparisoncited by 4
  7. 2022A unified one-shot prosody and speaker conversion system with self-supervised discrete speech unitscited by 3
  8. 2025Speech-to-Text Translation with Phoneme-Augmented CoT: Enhancing Cross-Lingual Transfer in Low-Resource Scenarioscited by 3
  9. 2024Whisper-GPT -- Continuous Discrete Hybrid Representation Language Models For Speech And Musiccited by 2
  10. 2024Direct Punjabi to English speech translation using discrete unitscited by 1
  11. 2025Unsupervised Speech Segmentation: A General Approach Using Speech Language Modelscited by 1
  12. 2026MIXAR: Scaling Autoregressive Pixel-based Language Models to Multiple Languages and Scriptscited by 1
  13. 2023Speech Corpora Divergence Based Unsupervised Data Selection for ASRcited by 0
  14. 2024Learning Semantic Information from Raw Audio Signal Using Both Contextual and Phonetic Representationscited by 0
  15. 2025MahaTTS: A Unified Framework for Multilingual Text-to-Speech Synthesiscited by 0
  16. 2025GmSLM : Generative Marmoset Spoken Language Modelingcited by 0