mlsanityData to 14 Oct 2026

Training Object Permanence in World Models

arXiv 2609.28654 ↗First posted 23 Sep 2026cs.AI cs.CVcited by 0

On the map: World models → World models for language agents also fits: Latent predictive world models

Abstract (arXiv)

Object permanence and solidity are hallmarks of human cognitive priors. Recent studies show that video generation models, a paradigmatic class of current world models, have begun to show emerged reasoning abilities, making them ideal candidates for building human-like physical intelligence. Do video models have emerged object permanence in them? If not, could we train them with a core-cognition inspired dataset? We introduce WROP (World Reasoning with Object Permanence), a data infrastructure of 150 hand-designed cognitive science inspired tasks, divided into six cognitive categories. We build Blender generators that randomize speed, lighting, camera angle, and other nuisance parameters while preserving each task's cognitive structure, yielding 10,000+ samples per task. We release a 1.5M-sample training corpus and a 300-question exam. On this exam we evaluate 14 video models: 3 reference-to-video, 7 edit, and 4 continuation, among which PWM-WROP, our 16B world model. In a blind pairwise Elo study, PWM-WROP ranks first among continuation models and third overall, behind only a statistical tie between two reference-to-video models. We release the data, exam, model answers, scores, weights, and PWM, our native-PyTorch training stack on AWS Trainium2.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 21 of its 43 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

21 of 43 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Cosmos World Foundation Model Platform for Physical AI7 Jan

Other references · 20

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  6. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  7. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  8. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  9. 2025Video models are zero-shot learners and reasonerscited by 220
  10. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  11. 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmarkcited by 43
  12. 2024Core Knowledge Deficits in Multi-Modal Language Modelscited by 38
8 more
  1. 2026A Very Big Video Reasoning Suitecited by 34
  2. 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Taskscited by 22
  3. 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
  4. 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 13
  5. 2025Probing Perceptual Constancy in Large Vision-Language Modelscited by 7
  6. 2025The Philosophical Foundations of Growing AI Like A Childcited by 6
  7. 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 6
  8. 2026Vision Language Models Cannot Reason About Physical Transformationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Human Cognition in Machines: A Unified Perspective of World Models
  2. 2026World Reasoning Arena
  3. 2026Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models
  4. 2026Scaling Video Generation for Reasoning: At What Cost?
  5. 2025WorldModelBench: Judging Video Generation Models As World Models
  6. 2024EVA: An Embodied World Model for Future Video Anticipation
  7. 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces
  8. 2025Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Models