mlsanityData to 14 Oct 2026

The Intervention Gap in Latent World Models

arXiv 2608.29998 ↗First posted 30 Aug 2026cs.LGcited by 3

On the map: World models → Latent predictive world models

Abstract (arXiv)

Planning-time intervention fidelity is a distinct, measurable property of a learned world model: whether the model's own open-loop transitions move task variables the way matched environment interventions do. In the settings we test, it is neither revealed by reward fit nor ensured by task-anchored training. Across released TD-MPC2 checkpoint sizes, episode return falls as an operator-error diagnostic on task observables grows, while reward-prediction error stays small and nearly flat, and a self-supervised world model trained without task signal preserves the same operator substantially better than a task-anchored model on the shared task. A capture-gated matched-intervention audit then localizes what fails. On Cheetah, three LeWorldModel checkpoints capture the current task query and support decodable real intervention effects; however, their imagined five-step effects are worse than predicting no effect and worse than an environment-endpoint oracle. The failure is task-direction rotation with excess gain, not feature collapse. This severe pattern is conditional: five PreJEPA seeds retain an oracle-relative deficit without it, Finger Spin experiments extend the deficit beyond locomotion with heterogeneous severity across seeds, and shared-bank effect geometry is both candidate- and support-dependent. We also test practice-side questions. In DreamerV3 the posterior distribution, not its sample, carries the current query; ensemble disagreement ranks error only near training support; and a frozen support-aware score degrades held-out error ranking in both tested transfer directions while native disagreement remains informative in both. We conclude that intervention fidelity must be audited directly, capture-first, on the model's native interface.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 39 of its 51 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

39 of 51 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
  2. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
  3. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture19 Jan
  4. 2022Temporal Difference Learning for Model Predictive Control9 Mar
  5. 2018Learning Latent Dynamics for Planning from Pixels12 Nov

Other references · 34

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  4. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  5. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  6. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  7. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
  8. 2023Mastering Diverse Domains through World Modelscited by 1,253
  9. 2020Mastering Atari with Discrete World Modelscited by 1,007
  10. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  11. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  12. 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
22 more
  1. 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 773
  2. 2024Genie: Generative Interactive Environmentscited by 747
  3. 2019Designing and Interpreting Probes with Control Taskscited by 640
  4. 2020MOPO: Model-based Offline Policy Optimizationcited by 636
  5. 2020MOReL : Model-Based Offline Reinforcement Learningcited by 590
  6. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
  7. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  8. 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
  9. 2021Modern Koopman Theory for Dynamical Systemscited by 276
  10. 2018Model-Ensemble Trust-Region Policy Optimizationcited by 219
  11. 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 140
  12. 2024Evaluating the World Model Implicit in a Generative Modelcited by 113
  13. 2020Objective Mismatch in Model-based Reinforcement Learningcited by 96
  14. 2020The Value Equivalence Principle for Model-Based Reinforcement Learningcited by 94
  15. 2016The Predictron: End-To-End Learning and Planningcited by 93
  16. 2021Revisiting Design Choices in Offline Model-Based Reinforcement Learningcited by 50
  17. 2016Self-Correcting Models for Model-Based Reinforcement Learningcited by 43
  18. 2021Proper Value Equivalencecited by 33
  19. 2024ACT-Bench: Towards Action Controllable World Models for Autonomous Drivingcited by 14
  20. 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Positioncited by 10
  21. 2026What Do World Models Learn in RL? Probing Latent Representations in Learned Environment Simulatorscited by 5
  22. 2026Biased Dreams: Limitations to Epistemic Uncertainty Quantification in Latent Dynamics Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Action-Consequence Alignment for Reliable Planning and Self-Improving in Latent World Models
  2. 2026Compact but Moving: Intervention-Relevant Geometry in Recurrent World Models
  3. 2026One-Step Prediction Fidelity Is a Poor Proxy for Planning Performance in JEPA World Models
  4. 2026verdi: retrieval is not transfer for continual world model optimization
  5. 2026Beyond Task Success: Stage-Wise Reliability of World Model Planning under Sensing Degradation
  6. 2026Building Comparative Motivation Profiles with Instrumental Interventions
  7. 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable
  8. 2026Predicting Consequences and Reinforcing Navigation Policies with Latent World Models