mlsanityData to 7 Oct 2026

2M-BELEBELE: Highly Multilingual Speech and American Sign Language Comprehension Dataset

arXiv 2412.08274 ↗First posted 11 Dec 2024cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

We introduce the first highly multilingual speech and American Sign Language (ASL) comprehension dataset by extending BELEBELE. Our dataset covers 74 spoken languages at the intersection of BELEBELE and FLEURS, and one sign language (ASL). We evaluate 2M-BELEBELE dataset for both 5-shot and zero-shot settings and across languages, the speech comprehension accuracy is ~ 2-3% average lower compared to reading comprehension.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 11 Dec 2024.

Builds on

21 of 36 references.

References · 21

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  3. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  4. 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 486
  5. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  6. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  7. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  8. 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 339
  9. 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 330
  10. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
  11. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 190
  12. 2020WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarizationcited by 154
9 more
  1. 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 123
  2. 2023Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLMcited by 92
  3. 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpuscited by 74
  4. 2022Open-Domain Sign Language Translation Learned from Online Videocited by 72
  5. 2021Including Signed Languages in Natural Language Processingcited by 67
  6. 2021Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoningcited by 64
  7. 2024Towards Privacy-Aware Sign Language Translation at Scalecited by 42
  8. 2023Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discoursecited by 15
  9. 2024FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

  1. 2025BOUQuET: dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translationcited by 21
  2. 2025Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translationcited by 12
  3. 2026Beyond In-Domain Detection: SpikeScore for Cross-Domain Hallucination Detectioncited by 1