mlsanityData to 14 Oct 2026

BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data

arXiv 2510.10159 ↗First posted 11 Oct 2025cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

We present BabyBabelLM, a multilingual collection of datasets modeling the language a person observes from birth until they acquire a native language. We curate developmentally plausible pretraining data aiming to cover the equivalent of 100M English words of content in each of 45 languages. We compile evaluation suites and train baseline models in each language. BabyBabelLM aims to facilitate multilingual pretraining and cognitive modeling.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 58 of its 130 references that are in the map. First posted on arXiv 11 Oct 2025.

Builds on

58 of 130 references.

References · 58

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  3. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  6. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  7. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
  8. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  9. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 564
  10. 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 333
  11. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
  12. 2021Few-shot Learning with Multilingual Language Modelscited by 278
38 more
  1. 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 191
  2. 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 181
  3. 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
  4. 2023Cross-Lingual Consistency of Factual Knowledge in Multilingual Language Modelscited by 118
  5. 2025Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corporacited by 88
  6. 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledgecited by 86
  7. 2025Dynamic Chunking for End-to-End Hierarchical Sequence Modelingcited by 72
  8. 2025MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairscited by 71
  9. 2022NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languagescited by 68
  10. 2023Contrasting Linguistic Patterns in Human and LLM-Generated News Textcited by 62
  11. 2020Cross-Linguistic Syntactic Evaluation of Word Prediction Modelscited by 55
  12. 2024Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Modelscited by 55
  13. 2023AfroBench: How Good are Large Language Models on African Languages?cited by 43
  14. 2024SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languagescited by 43
  15. 2023GlotLID: Language Identification for Low-Resource Languagescited by 39
  16. 2022NusaCrowd: Open Source Initiative for Indonesian NLP Resourcescited by 38
  17. 2021NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversationcited by 35
  18. 2025Enhancing Multilingual LLM Pretraining with Model-Based Data Selectioncited by 35
  19. 2024A Hitchhiker's Guide to Scaling Law Estimationcited by 27
  20. 2024GPT or BERT: why not both?cited by 27
  21. 2024A Bit of a Problem: Measurement Disparities in Dataset Sizes Across Languagescited by 25
  22. 2024Is Child-Directed Speech Effective Training Data for Language Models?cited by 24
  23. 2023Not all layers are equally as important: Every Layer Counts BERTcited by 21
  24. 2024Meltemi: The first open Large Language Model for Greekcited by 17
  25. 2021On the Limits of Minimal Pairs in Contrastive Evaluationcited by 15
  26. 2023SLABERT Talk Pretty One Day: Modeling Second Language Acquisition with BERTcited by 15
  27. 2020A Sentence Cloze Dataset for Chinese Machine Reading Comprehensioncited by 14
  28. 2025Krikri: Advancing Open Large Language Models for Greekcited by 14
  29. 2022FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correctioncited by 13
  30. 2024Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic Dialectcited by 13
  31. 2016Consensus Attention-based Neural Networks for Chinese Reading Comprehensioncited by 12
  32. 2023Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corporacited by 12
  33. 2025XCOMPS: A Multilingual Benchmark of Conceptual Minimal Pairscited by 12
  34. 2025Do Construction Distributions Shape Formal Language Learning In German BabyLMs?cited by 11
  35. 2024Controlled Evaluation of Syntactic Knowledge in Multilingual Language Modelscited by 10
  36. 2025Child-Directed Language Does Not Consistently Boost Syntax Learning in Language Modelscited by 9
  37. 2025TurBLiMP: A Turkish Benchmark of Linguistic Minimal Pairscited by 9
  38. 2024NLP for The Greek Language: A Longer Surveycited by 8

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

  1. 2026Bringing Up a Bilingual BabyLM: Investigating Multilingual Language Acquisition Using Small-Scale Modelscited by 5
  2. 2026A Unified Assessment of the Poverty of the Stimulus Argument for Neural Language Modelscited by 1
  3. 2026Structural priors for data-efficient language learningcited by 1
  4. 2026Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoderscited by 0
  5. 2026Child-directed speech facilitates production, not comprehension, in BabyLMscited by 0
  6. 2026The First ChineseBabyLM Challenge: training data-efficient and cognitively plausible language models for Chinesecited by 0
  7. 2026A retrospective analysis on the use of LLMs to study infant syntax learningcited by 0
  8. 2026Feeding BabyLMs Macaroni: Code-Switching Curricula Cause Cross-Lingual Convergencecited by 0
  9. 2026Cross-Linguistic Effects in Bilingual Phoneme BabyLMscited by 0
  10. 2026Introducing Code-Switched Contexts to Cognitively-Inspired Bilingual Model Trainingcited by 0