mlsanityData to 14 Oct 2026

What a World Model Represents Is Three Questions

arXiv 2607.06640 ↗First posted 7 Jul 2026cs.LG cs.AIcited by 0

On the map: World models → World models for language agents

Abstract (arXiv)

World models learn task-relevant information through many routes: observation reconstruction, recurrent state, temporal filtering, and explicit task supervision. Different routes can make different variables available. The same variable can also be available through several routes at once. When it is, looking at which route would increase the training loss most if removed does not tell you which route the model actually uses. The questions are reachability, whether a training signal can identify a task-relevant direction; admission, whether that direction is recoverable from the latent; and assignment, which eligible route carries it. We test them in environments with a known set of required coordinates. A direction cannot enter the latent unless some training signal can identify it. Reconstruction, recurrence, or filtering may already recover some of those coordinates; a reward or value head then has no residual direction to admit. For what remains, how many independent predictions the target supplies is how many coordinates install: one through four independent predictions admit one through four directions, including through the value head. Reachability is not admission: a temporal second-moment coefficient can remain absent under next-token prediction when accumulating it is a fraction of a percent of that loss, and a head that predicts the coefficient restores it. Assignment is a different test. Two routes that each carry the same variable when trained alone do not swap the carrier when we reverse which is more costly to remove. A recurrent model trained on a transformer's recorded sequences shows the same pattern. Near the point where the competing route is beginning to clear the probe threshold, independent training runs disagree. What a world model represents is therefore three questions: what information is reachable, what supervision admits, and which competing route carries it.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 42 of its 59 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

42 of 59 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling5 Jul
  2. 2026Latent State Design for World Models under Sufficiency Constraints3 May

Other references · 40

  1. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  2. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  3. 2023Mastering Diverse Domains through World Modelscited by 1,253
  4. 2020Mastering Atari with Discrete World Modelscited by 1,007
  5. 2013Exact solutions to the nonlinear dynamics of learning in deep linear neural networkscited by 763
  6. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
  7. 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 436
  8. 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 404
  9. 2020The Pitfalls of Simplicity Bias in Neural Networkscited by 351
  10. 2016Successor Features for Transfer in Reinforcement Learningcited by 340
  11. 2021Modern Koopman Theory for Dynamical Systemscited by 276
  12. 2020Gradient Starvation: A Learning Proclivity in Neural Networkscited by 267
28 more
  1. 2020FLAMBE: Structural Complexity and Representation Learning of Low Rank MDPscited by 233
  2. 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 215
  3. 2020Implicit Under-Parameterization Inhibits Data-Efficient Deep Reinforcement Learningcited by 134
  4. 2020What shapes feature representations? Exploring datasets, architectures, and trainingcited by 126
  5. 2020Objective Mismatch in Model-based Reinforcement Learningcited by 96
  6. 2020The Value Equivalence Principle for Model-Based Reinforcement Learningcited by 94
  7. 2013Hidden Parameter Markov Decision Processes: A Semiparametric Regression Approach for Discovering Latent Task Parametrizationscited by 70
  8. 2020Approximate information state for approximate planning and reinforcement learning in partially observed systemscited by 70
  9. 2022Denoised MDPs: Learning World Models Better Than the World Itselfcited by 68
  10. 2021DR3: Value-Based Deep Reinforcement Learning Requires Explicit Regularizationcited by 66
  11. 2023On the Foundations of Shortcut Learningcited by 65
  12. 2021Learning Task Informed Abstractionscited by 58
  13. 2021On The Effect of Auxiliary Tasks on Representation Dynamicscited by 57
  14. 2024Bridging State and History Representations: Understanding Self-Predictive RLcited by 54
  15. 2022Guaranteed Discovery of Control-Endogenous Latent States with Multi-Step Inverse Modelscited by 45
  16. 2021Proper Value Equivalencecited by 33
  17. 2022Value Gradient weighted Model-Based Reinforcement Learningcited by 32
  18. 2021Action-Sufficient State Representation Learning for Control with Structural Constraintscited by 31
  19. 2021Which Mutual-Information Representation Learning Objectives are Sufficient for Control?cited by 29
  20. 2022An Empirical Study of Implicit Regularization in Deep Offline RLcited by 24
  21. 2020Policy-Aware Model Learning for Policy Gradient Methodscited by 23
  22. 2024When does Self-Prediction help? Understanding Auxiliary Tasks in Reinforcement Learningcited by 14
  23. 2024Multistep Inverse Is Not All You Needcited by 11
  24. 2026The Observer Effect in World Models: Invasive Adaptation Corrupts Latent Physicscited by 3
  25. 2026Contrast encodes inductive bias: separating slow noise from dynamics in predictive representation learningcited by 2
  26. 2026Predicting Closed-Loop Performance of Latent World Models: Offline Checkpoint Selection for MPC and Model-Based RL Under Non-Markovian Rewards in LunarLandercited by 2
  27. 2026Operator-on-F complements value-equivalence: a planning-time diagnostic for latent world modelscited by 2
  28. 2026Task-Induced Representational Invariances Depend on Learning Objective in Deep RLcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025What Does it Mean for a Neural Network to Learn a "World Model"?
  2. 2026World Model Control by Trajectory Reachability Metrics
  3. 2026Does Learning to Predict the World Help Agents Act? Auditing World-Model Post-Training
  4. 2025Better World Models Can Lead to Better Post-Training Performance
  5. 2025When Do Neural Networks Learn World Models?
  6. 2026What Can Latent World Models Know? Physical Parameter Identifiability in Multimodal Predictive Representations
  7. 2026World Models Under Asynchronous Sensor Observations
  8. 2026Supervise What Decides Success: Criterion-Aligned Auxiliary Losses for Latent World-Model Planning