mlsanityData to 7 Oct 2026

HebDB: a Weakly Supervised Dataset for Hebrew Speech Processing

arXiv 2407.07566 ↗First posted 10 Jul 2024cs.CL cs.SD eess.AScited by 3

Not on the map. Why?

Abstract (arXiv)

We present HebDB, a weakly supervised dataset for spoken language processing in the Hebrew language. HebDB offers roughly 2500 hours of natural and spontaneous speech recordings in the Hebrew language, consisting of a large variety of speakers and topics. We provide raw recordings together with a pre-processed, weakly supervised, and filtered version. The goal of HebDB is to further enhance research and development of spoken language processing tools for the Hebrew language. Hence, we additionally provide two baseline systems for Automatic Speech Recognition (ASR): (i) a self-supervised model; and (ii) a fully supervised model. We present the performance of these two methods optimized on HebDB and compare them to current multi-lingual ASR alternatives. Results suggest the proposed method reaches better results than the evaluated baselines considering similar model sizes. Dataset, code, and models are publicly available under https://pages.cs.huji.ac.il/adiyoss-lab/HebDB/.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

24 of 35 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  5. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  6. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  7. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  8. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  9. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  10. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  11. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  12. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
12 more
  1. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
  2. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 333
  3. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  4. 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 207
  5. 2020Real Time Speech Enhancement in the Waveform Domaincited by 183
  6. 2021UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Datacited by 76
  7. 2020Rethinking Evaluation in ASR: Are Our Models Robust Enough?cited by 72
  8. 2020ICASSP 2021 Deep Noise Suppression Challengecited by 27
  9. 2022A Survey of Multilingual Models for Automatic Speech Recognitioncited by 21
  10. 2020A review of on-device fully neural end-to-end automatic speech recognition algorithmscited by 11
  11. 2023ivrit.ai: A Comprehensive Dataset of Hebrew Speech for AI Research and Developmentcited by 4
  12. 2022Self-supervised Speaker Diarizationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.

  1. 2024A Language Modeling Approach to Diacritic-Free Hebrew TTScited by 2
  2. 2026VoxKnesset: A Large-Scale Longitudinal Hebrew Speech Dataset for Aging Speaker Modelingcited by 1
  3. 2025Phonikud: Overcoming Phonetic Underspecification for Hebrew Text-To-Speechcited by 0