mlsanityData to 14 Oct 2026

Zero-shot World Models Are Developmentally Efficient Learners

arXiv 2604.10333 ↗First posted 11 Apr 2026cs.AI cs.CVcited by 2

On the map: World models → World models for language agents

Abstract (arXiv)

Young children demonstrate early abilities to understand their physical world, estimating depth, motion, object coherence, interactions, and many other aspects of physical scene understanding. Children are both data-efficient and flexible cognitive systems, creating competence despite extremely limited training data, while generalizing to myriad untrained tasks -- a major challenge even for today's best AI systems. Here we introduce a novel computational hypothesis for these abilities, the Zero-shot World Model (ZWM). ZWM is based on three principles: a sparse temporally-factored predictor that decouples appearance from dynamics; zero-shot estimation through approximate causal inference; and composition of inferences to build more complex abilities. We show that ZWM can be learned from the first-person experience of a single child, rapidly generating competence across multiple physical understanding benchmarks. It also shows progressive, staged emergence of capacities during learning and builds brain-like internal representations. Our work presents a blueprint for efficient and flexible learning from human-scale data, advancing both a computational account of children's early physical understanding and a path toward data-efficient AI systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 38 of its 103 references that are in the map. First posted on arXiv 11 Apr 2026.

Builds on

38 of 103 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  9. 2018World Modelscited by 1,513
  10. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  11. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  12. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
26 more
  1. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  2. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  3. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  4. 2023CoTracker: It is Better to Track Togethercited by 522
  5. 2019Model-Based Reinforcement Learning for Ataricited by 502
  6. 2022DayDreamer: World Models for Physical Robot Learningcited by 400
  7. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
  8. 2019Local Aggregation for Unsupervised Learning of Visual Embeddingscited by 204
  9. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
  10. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
  11. 2022Deep Hierarchical Planning from Pixelscited by 101
  12. 2014Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Brain's Ventral Visual Pathwaycited by 94
  13. 2022High-Quality Entity Segmentationcited by 93
  14. 2025Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corporacited by 88
  15. 2023Call for Papers -- The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpuscited by 62
  16. 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
  17. 2023Unifying (Machine) Vision via Counterfactual World Modelingcited by 19
  18. 2021Explanatory models in neuroscience: Part 1 -- taking mechanistic abstraction seriouslycited by 18
  19. 2024The BabyView dataset: High-resolution egocentric videos of infants' and young children's everyday experiencescited by 17
  20. 2024Towards Foundation Models for 3D Vision: How Close Are We?cited by 13
  21. 2023ENTL: Embodied Navigation Trajectory Learnercited by 11
  22. 2025World Modeling with Probabilistic Structure Integrationcited by 7
  23. 2024Self-supervised learning of video representations from a child's perspectivecited by 6
  24. 2025Taming generative video models for zero-shot optical flow extractioncited by 4
  25. 2025Assessing the alignment between infants' visual and linguistic experience using multimodal language modelscited by 3
  26. 2025Discovering and using Spelke segmentscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Concepts Learned Visually by Infants Can Contribute to Visual Learning and Understanding in AI Models
  2. 2026WorldString: Actionable World Representation
  3. 2025From Masks to Worlds: A Hitchhiker's Guide to World Models
  4. 2025World Models in Artificial Intelligence: Sensing, Learning, and Reasoning Like a Child
  5. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning
  6. 2020A Model of Fast Concept Inference with Object-Factorized Cognitive Programs
  7. 2026Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models
  8. 2026Think Like a World Model, Act Like a VLA: Distilling World-Model Representations into Compact Robot Policies