mlsanityData to 7 Oct 2026

BabyLM Turns 3: Call for papers for the 2025 BabyLM workshop

arXiv 2502.10645 ↗First posted 15 Feb 2025cs.CLcited by 24

Not on the map. Why?

Abstract (arXiv)

BabyLM aims to dissolve the boundaries between cognitive modeling and language modeling. We call for both workshop papers and for researchers to join the 3rd BabyLM competition. As in previous years, we call for participants in the data-efficient pretraining challenge in the general track. This year, we also offer a new track: INTERACTION. This new track encourages interactive behavior, learning from a teacher, and adapting the teaching material to the student. We also call for papers outside the competition in any relevant areas. These include training efficiency, cognitively plausible research, weak model evaluation, and more.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 10 of its 23 references that are in the map. First posted on arXiv 15 Feb 2025.

Builds on

10 of 23 references.

References · 10

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  3. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  4. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
  5. 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 536
  6. 2019Connecting Vision and Language with Localized Narrativescited by 225
  7. 2018A standardized Project Gutenberg corpus for statistical analysis of natural language and quantitative linguisticscited by 64
  8. 2024[Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpuscited by 26
  9. 2024GPT or BERT: why not both?cited by 26
  10. 2024Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrationscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 19; 2026: 5.

24 papers.

Sort:

By area:

  1. 2025Do Construction Distributions Shape Formal Language Learning In German BabyLMs?cited by 11
  2. 2025Once Upon a Time: Interactive Learning for Storytelling with Small Language Modelscited by 11
  3. 2025Dialogue Is Not Enough to Make a Communicative BabyLM (But Neither Is Developmentally Inspired Reinforcement Learning)cited by 10
  4. 2025Minimal Pair-Based Evaluation of Code-Switchingcited by 6
  5. 2025On the robustness of modeling grounded word learning through a child's egocentric inputcited by 4
  6. 2025UD-English-CHILDES: A Collected Resource of Gold and Silver Universal Dependencies Trees for Child Language Interactionscited by 3
  7. 2025LongTail-Swap: benchmarking language models' abilities on rare wordscited by 3
  8. 2025Playpen: An Environment for Exploring Learning Through Conversational Interactioncited by 2
  9. 2025Influence-driven Curriculum Learning for Pre-training on Limited Datacited by 2
  10. 2025Masked Diffusion Language Models with Frequency-Informed Trainingcited by 2
  11. 2025Rethinking the Role of Text Complexity in Language Model Pretrainingcited by 2
  12. 2025What is the Best Sequence Length for BABYLM?cited by 2
12 more
  1. 2025Mask and You Shall Receive: Optimizing Masked Language Modeling For Pretraining BabyLMscited by 2
  2. 2025Model Merging to Maintain Language-Only Performance in Developmentally Plausible Multimodal Modelscited by 1
  3. 2026A Unified Assessment of the Poverty of the Stimulus Argument for Neural Language Modelscited by 1
  4. 2026Structural priors for data-efficient language learningcited by 1
  5. 2025BabyLM's First Constructions: Causal probing provides a signal of learningcited by 0
  6. 2025Beyond Repetition: Text Simplification and Curriculum Learning for Data-Constrained Pretrainingcited by 0
  7. 2025Contrastive Decoding for Synthetic Data Generation in Low-Resource Language Modelingcited by 0
  8. 2025BitMar: Low-Bit Multimodal Fusion with Episodic Memory for Edge Devicescited by 0
  9. 2025Do Syntactic Categories Help in Developmentally Motivated Curriculum Learning for Language Models?cited by 0
  10. 2026CxMP: A Linguistic Minimal-Pair Benchmark for Evaluating Constructional Understanding in Language Modelscited by 0
  11. 2026Augustinian BabyLM: What Ostensive Definition Can and Cannot Teach a Small Language Modelcited by 0
  12. 2026A retrospective analysis on the use of LLMs to study infant syntax learningcited by 0