What a World Model Represents Is Three Questions
On the map: World models → World models for language agents
Abstract (arXiv)
World models learn task-relevant information through many routes: observation reconstruction, recurrent state, temporal filtering, and explicit task supervision. Different routes can make different variables available. The same variable can also be available through several routes at once. When it is, looking at which route would increase the training loss most if removed does not tell you which route the model actually uses. The questions are reachability, whether a training signal can identify a task-relevant direction; admission, whether that direction is recoverable from the latent; and assignment, which eligible route carries it. We test them in environments with a known set of required coordinates. A direction cannot enter the latent unless some training signal can identify it. Reconstruction, recurrence, or filtering may already recover some of those coordinates; a reward or value head then has no residual direction to admit. For what remains, how many independent predictions the target supplies is how many coordinates install: one through four independent predictions admit one through four directions, including through the value head. Reachability is not admission: a temporal second-moment coefficient can remain absent under next-token prediction when accumulating it is a fraction of a percent of that loss, and a head that predicts the coefficient restores it. Assignment is a different test. Two routes that each carry the same variable when trained alone do not swap the carrier when we reverse which is more costly to remove. A recurrent model trained on a transformer's recorded sequences shows the same pattern. Near the point where the competing route is beginning to clear the probe threshold, independent training runs disagree. What a world model represents is therefore three questions: what information is reachable, what supervision admits, and which competing route carries it.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 42 of its 59 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
42 of 59 references.
Closest ancestors · 2
Same direction, newest first
- 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling5 Jul
- 2026Latent State Design for World Models under Sufficiency Constraints3 May
Other references · 40
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2013Exact solutions to the nonlinear dynamics of learning in deep linear neural networkscited by 763
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
- 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 436
- 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 404
- 2020The Pitfalls of Simplicity Bias in Neural Networkscited by 351
- 2016Successor Features for Transfer in Reinforcement Learningcited by 340
- 2021Modern Koopman Theory for Dynamical Systemscited by 276
- 2020Gradient Starvation: A Learning Proclivity in Neural Networkscited by 267
28 more
- 2020FLAMBE: Structural Complexity and Representation Learning of Low Rank MDPscited by 233
- 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 215
- 2020Implicit Under-Parameterization Inhibits Data-Efficient Deep Reinforcement Learningcited by 134
- 2020What shapes feature representations? Exploring datasets, architectures, and trainingcited by 126
- 2020Objective Mismatch in Model-based Reinforcement Learningcited by 96
- 2020The Value Equivalence Principle for Model-Based Reinforcement Learningcited by 94
- 2013Hidden Parameter Markov Decision Processes: A Semiparametric Regression Approach for Discovering Latent Task Parametrizationscited by 70
- 2020Approximate information state for approximate planning and reinforcement learning in partially observed systemscited by 70
- 2022Denoised MDPs: Learning World Models Better Than the World Itselfcited by 68
- 2021DR3: Value-Based Deep Reinforcement Learning Requires Explicit Regularizationcited by 66
- 2023On the Foundations of Shortcut Learningcited by 65
- 2021Learning Task Informed Abstractionscited by 58
- 2021On The Effect of Auxiliary Tasks on Representation Dynamicscited by 57
- 2024Bridging State and History Representations: Understanding Self-Predictive RLcited by 54
- 2022Guaranteed Discovery of Control-Endogenous Latent States with Multi-Step Inverse Modelscited by 45
- 2021Proper Value Equivalencecited by 33
- 2022Value Gradient weighted Model-Based Reinforcement Learningcited by 32
- 2021Action-Sufficient State Representation Learning for Control with Structural Constraintscited by 31
- 2021Which Mutual-Information Representation Learning Objectives are Sufficient for Control?cited by 29
- 2022An Empirical Study of Implicit Regularization in Deep Offline RLcited by 24
- 2020Policy-Aware Model Learning for Policy Gradient Methodscited by 23
- 2024When does Self-Prediction help? Understanding Auxiliary Tasks in Reinforcement Learningcited by 14
- 2024Multistep Inverse Is Not All You Needcited by 11
- 2026The Observer Effect in World Models: Invasive Adaptation Corrupts Latent Physicscited by 3
- 2026Contrast encodes inductive bias: separating slow noise from dynamics in predictive representation learningcited by 2
- 2026Predicting Closed-Loop Performance of Latent World Models: Offline Checkpoint Selection for MPC and Model-Based RL Under Non-Markovian Rewards in LunarLandercited by 2
- 2026Operator-on-F complements value-equivalence: a planning-time diagnostic for latent world modelscited by 2
- 2026Task-Induced Representational Invariances Depend on Learning Objective in Deep RLcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025What Does it Mean for a Neural Network to Learn a "World Model"?
- 2026World Model Control by Trajectory Reachability Metrics
- 2026Does Learning to Predict the World Help Agents Act? Auditing World-Model Post-Training
- 2025Better World Models Can Lead to Better Post-Training Performance
- 2025When Do Neural Networks Learn World Models?
- 2026What Can Latent World Models Know? Physical Parameter Identifiability in Multimodal Predictive Representations
- 2026World Models Under Asynchronous Sensor Observations
- 2026Supervise What Decides Success: Criterion-Aligned Auxiliary Losses for Latent World-Model Planning