Do World Models Learn Global Understanding?
On the map: World models → World models for language agents
Abstract (arXiv)
AI systems often feel brittle and fragmented. A large language model (LLM) may correctly explain a concept but fail to apply it, or follow safety instructions in one context but not another. This behavior suggests a general failure to lift local information to a global understanding. To gain fundamental insight, we frame "understanding" as learning constraints and propagating their consequences. We construct learning tasks on monoid worlds, sets of states connected by action transitions, where observed training transitions and an unseen constraint jointly determine held-out transitions. Measuring generalization tests whether models can learn global constraints from local transitions and propagate their consequences. We consider inverse, commutativity, composition, and periodicity constraints relevant to spatial and semantic structure. Across attention, recurrent, and state-space architectures, next-state training fits the data but fails to propagate non-trivial constraints. Compositional training, which uses identical paths but hides intermediate states from the input, achieves 96% accuracy on inverse, commutativity, and composition constraints across architectures, yields corresponding improvements in geometric generalization of world models trained on embodied environments and relational generalization in Wikidata-finetuned LLMs. How far do models propagate constraints when inferring an unseen fact may depend on first inferring others? We define proof depth d of a held-out transition, measuring the minimum number of inference rounds to infer the transition, and find that model generalization decreases sharply with proof depth. Increasing compositional path length T improves generalization. These results provide a formal way to investigate global understanding in language and world models and demonstrate that compositional training promotes information propagation and integration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 3 of its 11 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
3 of 11 references.
References · 3
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 629
- 2024Lessons from Studying Two-Hop Latent Reasoningcited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Emergent Semantic Representations in World Models through Physical Interaction without Linguistic Supervision
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
- 2026Learning to Theorize the World from Observation
- 2024Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Models
- 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling
- 2025Beyond World Models: Rethinking Understanding in AI Models
- 2024Evaluating the World Model Implicit in a Generative Model
- 2026How do World Models and Policies Compose in LLM Agents? A Joint Spectral and Behavioral Account