mlsanityData to 14 Oct 2026

Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context

arXiv 2309.08105 ↗First posted 15 Sep 2023eess.AS cs.SDcited by 85

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce Libriheavy, a large-scale ASR corpus consisting of 50,000 hours of read English speech derived from LibriVox. To the best of our knowledge, Libriheavy is the largest freely-available corpus of speech with supervisions. Different from other open-sourced datasets that only provide normalized transcriptions, Libriheavy contains richer information such as punctuation, casing and text context, which brings more flexibility for system building. Specifically, we propose a general and efficient pipeline to locate, align and segment the audios in previously published Librilight to its corresponding texts. The same as Librilight, Libriheavy also has three training subsets small, medium, large of the sizes 500h, 5000h, 50000h respectively. We also extract the dev and test evaluation sets from the aligned audios and guarantee there is no overlapping speakers and books in training sets. Baseline systems are built on the popular CTC-Attention and transducer models. Additionally, we open-source our dataset creatation pipeline which can also be used to other audio alignment tasks.

Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Sep 2023.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 20; 2025: 41; 2026: 24.

85 papers.

Sort:

By area:

  1. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
  2. 2025Kimi-Audio Technical Reportcited by 222
  3. 2024VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizerscited by 122
  4. 2024WavLLM: Towards Robust and Adaptive Speech Large Language Modelcited by 109
  5. 2024BASE TTS: Lessons from building a billion-parameter Text-to-Speech model on 100K hours of datacited by 75
  6. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 66
  7. 2024Autoregressive Speech Synthesis without Vector Quantizationcited by 65
  8. 2025MiMo-Audio: Audio Language Models are Few-Shot Learnerscited by 65
  9. 2026PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Modelscited by 63
  10. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
  11. 2024SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generationcited by 33
  12. 2025ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matchingcited by 30
38 more
  1. 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 29
  2. 2025SALMONN-omni: A Standalone Speech LLM without Codec Injection for Full-duplex Conversationcited by 27
  3. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  4. 2024MIO: A Foundation Model on Multimodal Tokenscited by 24
  5. 2025Emilia: A Large-Scale, Extensive, Multilingual, and Diverse Dataset for Speech Generationcited by 20
  6. 2025M2-omni: Advancing Omni-MLLM for Comprehensive Modality Support with Competitive Performancecited by 19
  7. 2024Fast and High-Quality Auto-Regressive Speech Synthesis via Speculative Decodingcited by 17
  8. 2025Closing the Gap Between Text and Speech Understanding in LLMscited by 17
  9. 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 17
  10. 2025CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matchingcited by 11
  11. 2024Accelerating Codec-based Speech Synthesis with Multi-Token Prediction and Speculative Decodingcited by 10
  12. 2025Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesiscited by 10
  13. 2025Loquacious Set: 25,000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Usecited by 9
  14. 2025OpusLM: A Family of Open Unified Speech Language Modelscited by 9
  15. 2024Why Do Speech Language Models Fail to Generate Semantically Coherent Outputs? A Modality Evolving Perspectivecited by 8
  16. 2025SpidR: Learning Fast and Stable Linguistic Units for Spoken Language Models Without Supervisioncited by 8
  17. 2026AudioSAE: Towards Understanding of Audio-Processing Models with Sparse AutoEncoderscited by 8
  18. 2024StyleTTS-ZS: Efficient High-Quality Zero-Shot Text-to-Speech Synthesis with Distilled Time-Varying Style Diffusioncited by 7
  19. 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matchingcited by 7
  20. 2025MGM-Omni: Scaling Omni LLMs to Personalized Long-Horizon Speechcited by 7
  21. 2026Stream-Voice-Anon: Enhancing Utility of Real-Time Speaker Anonymization via Neural Audio Codec and Language Modelscited by 7
  22. 2025Do Not Mimic My Voice: Speaker Identity Unlearning for Zero-Shot Text-to-Speechcited by 6
  23. 2024Revisiting ASR Error Correction with Specialized Modelscited by 5
  24. 2024DM-Codec: Distilling Multimodal Representations for Speech Tokenizationcited by 5
  25. 2024Get Large Language Models Ready to Speak: A Late-fusion Approach for Speech Generationcited by 5
  26. 2025Delayed Fusion: Integrating Large Language Models into First-Pass Decoding in End-to-end Speech Recognitioncited by 5
  27. 2025End-to-end Listen, Look, Speak and Actcited by 5
  28. 2024LibriheavyMix: A 20,000-Hour Dataset for Single-Channel Reverberant Multi-Talker Speech Separation, ASR and Speaker Diarizationcited by 4
  29. 2025Omni-Router: Sharing Routing Decisions in Sparse Mixture-of-Experts for Speech Recognitioncited by 4
  30. 2025EuroSpeech: A Multilingual Speech Corpuscited by 4
  31. 2025Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Modelscited by 3
  32. 2025StreamMel: Real-Time Zero-shot Text-to-Speech via Interleaved Continuous Autoregressive Modelingcited by 3
  33. 2026WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modelingcited by 3
  34. 2024Multi-modal Adversarial Training for Zero-Shot Voice Cloningcited by 2
  35. 2025UniTTS: An end-to-end TTS system without decoupling of acoustic and semantic informationcited by 2
  36. 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversioncited by 2
  37. 2025Principled Coarse-Grained Acceptance for Speculative Decoding in Speechcited by 2
  38. 2026MoST: Mixing Speech and Text with Modality-Aware Mixture of Expertscited by 2

50 most cited of 85 All 85 (JSON)