mlsanityData to 7 Oct 2026

Computational modeling of early language learning from acoustic speech and audiovisual input without linguistic priors

arXiv 2603.08359 ↗First posted 9 Mar 2026cs.CL cs.AI eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

Learning to understand speech appears almost effortless for typically developing infants, yet from an information-processing perspective, acquiring a language from acoustic speech is an enormous challenge. This chapter reviews recent developments in using computational models to understand early language acquisition from speech and audiovisual input. The focus is on self-supervised and visually grounded models of perceptual learning. We show how these models are becoming increasingly powerful in learning various aspects of speech without strong linguistic priors, and how many features of early language development can be explained through a shared set of learning principles-principles broadly compatible with multiple theories of language acquisition and human cognition. We also discuss how modern learning simulations are gradually becoming more realistic, both in terms of input data and in linking model behavior to empirical findings on infant language development.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 119 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

32 of 119 references.

References · 32

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  4. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
  5. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 553
  6. 2019An Unsupervised Autoregressive Model for Speech Representation Learningcited by 185
  7. 2025Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corporacited by 86
  8. 2016Cognitive Science in the era of Artificial Intelligence: A roadmap for reverse-engineering the infant language-learnercited by 68
  9. 2017Representations of language in a model of visually grounded speech signalcited by 37
  10. 2022Word Discovery in Visually Grounded, Self-Supervised Speech Modelscited by 37
  11. 2022Self-supervised language learning from raw audio: Lessons from the Zero Resource Speech Challengecited by 34
  12. 2021Visually grounded models of spoken language: A survey of datasets, architectures and evaluation techniquescited by 32
20 more
  1. 2023BabySLM: language-acquisition-friendly benchmark of self-supervised spoken language modelscited by 29
  2. 2017Encoding of phonology in a recurrent neural model of grounded speechcited by 27
  3. 2022Self-Supervised Representation Learning for Speech Using Visual Grounding and Masked Language Modelingcited by 25
  4. 2019Language learning using Speech to Image retrievalcited by 21
  5. 2017Semantic speech retrieval with a visually grounded model of untranscribed speechcited by 20
  6. 2023Self-supervised Predictive Coding Models Encode Speaker and Phonetic Information in Orthogonal Subspacescited by 19
  7. 2019Models of Visually Grounded Speech Signal Pay Attention To Nouns: a Bilingual Experiment on English and Japanesecited by 13
  8. 2019Word Recognition, Competition, and Activation in a Model of Visually Grounded Speechcited by 13
  9. 2024DevBench: A multimodal developmental benchmark for language learningcited by 13
  10. 2021Can phones, syllables, and words emerge as side-products of cross-situational audiovisual learning? -- A computational investigationcited by 12
  11. 2023Syllable Discovery and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Modelcited by 11
  12. 2019A computational model of early language acquisition from audiovisual experiences of young infantscited by 10
  13. 2016Blind phoneme segmentation with temporal prediction errorscited by 9
  14. 2016Unsupervised word segmentation and lexicon discovery using acoustic word embeddingscited by 8
  15. 2022Learning English with Peppa Pigcited by 8
  16. 2020Evaluating computational models of infant phonetic learning across languagescited by 6
  17. 2019Computational and Robotic Models of Early Language Development: A Reviewcited by 3
  18. 2020Analysis of Predictive Coding Models for Phonemic Representation Learning in Small Datasetscited by 3
  19. 2024A model of early word acquisition based on realistic-scale audiovisual naming eventscited by 3
  20. 2024A predictive learning model can simulate temporal dynamics and context effects found in neural representations of continuous speechcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.