Zero-shot World Models Are Developmentally Efficient Learners
On the map: World models → World models for language agents
Abstract (arXiv)
Young children demonstrate early abilities to understand their physical world, estimating depth, motion, object coherence, interactions, and many other aspects of physical scene understanding. Children are both data-efficient and flexible cognitive systems, creating competence despite extremely limited training data, while generalizing to myriad untrained tasks -- a major challenge even for today's best AI systems. Here we introduce a novel computational hypothesis for these abilities, the Zero-shot World Model (ZWM). ZWM is based on three principles: a sparse temporally-factored predictor that decouples appearance from dynamics; zero-shot estimation through approximate causal inference; and composition of inferences to build more complex abilities. We show that ZWM can be learned from the first-person experience of a single child, rapidly generating competence across multiple physical understanding benchmarks. It also shows progressive, staged emergence of capacities during learning and builds brain-like internal representations. Our work presents a blueprint for efficient and flexible learning from human-scale data, advancing both a computational account of children's early physical understanding and a path toward data-efficient AI systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 38 of its 103 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
38 of 103 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
26 more
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2019Model-Based Reinforcement Learning for Ataricited by 502
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2019Local Aggregation for Unsupervised Learning of Visual Embeddingscited by 204
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2022Deep Hierarchical Planning from Pixelscited by 101
- 2014Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Brain's Ventral Visual Pathwaycited by 94
- 2022High-Quality Entity Segmentationcited by 93
- 2025Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corporacited by 88
- 2023Call for Papers -- The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpuscited by 62
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2023Unifying (Machine) Vision via Counterfactual World Modelingcited by 19
- 2021Explanatory models in neuroscience: Part 1 -- taking mechanistic abstraction seriouslycited by 18
- 2024The BabyView dataset: High-resolution egocentric videos of infants' and young children's everyday experiencescited by 17
- 2024Towards Foundation Models for 3D Vision: How Close Are We?cited by 13
- 2023ENTL: Embodied Navigation Trajectory Learnercited by 11
- 2025World Modeling with Probabilistic Structure Integrationcited by 7
- 2024Self-supervised learning of video representations from a child's perspectivecited by 6
- 2025Taming generative video models for zero-shot optical flow extractioncited by 4
- 2025Assessing the alignment between infants' visual and linguistic experience using multimodal language modelscited by 3
- 2025Discovering and using Spelke segmentscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Concepts Learned Visually by Infants Can Contribute to Visual Learning and Understanding in AI Models
- 2026WorldString: Actionable World Representation
- 2025From Masks to Worlds: A Hitchhiker's Guide to World Models
- 2025World Models in Artificial Intelligence: Sensing, Learning, and Reasoning Like a Child
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning
- 2020A Model of Fast Concept Inference with Object-Factorized Cognitive Programs
- 2026Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models
- 2026Think Like a World Model, Act Like a VLA: Distilling World-Model Representations into Compact Robot Policies