The Objective Is the Bottleneck: Latent World Models Encode What Their Planners Cannot Use
On the map: World models → Latent predictive world models
Abstract (arXiv)
Latent world models are judged by how well they predict, so when planning fails at long horizons the natural reading is that the predictor degrades. On a reproduction of LeWorldModel on TwoRoom we show the binding constraint is the planner's objective instead. The predictor is not the limit: its imagined state seventy-five environment steps ahead is still only 0.189 as wrong as assuming the world froze, while the planner never imagines beyond twenty-five. The objective is. Cross-entropy-method planning minimises squared latent distance, which tracks true distance at r = 0.426, saturates by about eighty arena units and decreases beyond a hundred and twenty, so moving away from the goal can lower the cost. The information is present throughout: a ridge probe recovers position from the frozen embedding at R^2 0.9922. The pathology is the method's, not one reimplementation's. It is present in the authors' released weights, and across four checkpoints long-horizon success rank-orders exactly with metric quality and inversely with prediction accuracy. Replacing only the objective, with nothing retrained and no GPU, lifts goals reached at offset 100 from 26.0% to 98.0%, equals the 98.0% at offset 25, and reaches 92.0% under a third of the budget: planning stops depending on the horizon. The best cost is not the most accurate. A head learned from frame separation alone predicts spatial distance worse than a position probe (r = 0.819 against 0.9897) yet plans better, charging 24% more to cross the environment's dividing wall where squared latent distance charges 4% less. It has learned reachability, not proximity.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 1 of its 7 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
1 of 7 references.
Closest ancestors · 1
Same direction, newest first
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026A Control Theory of Predictability in Latent World Models
- 2026How Long, Not How Close: A Learned Temporal Metric for Planning in Latent World Models
- 2026Order-Consistent Latent Geometry for Reliable Short-Horizon Planning in World Models
- 2026ATLAS: Aligned Transport of Latent Structure for Reliable World Model Planning
- 2026Latent State Design for World Models under Sufficiency Constraints
- 2026Latent Geometry Beyond Search: Amortizing Planning in World Models
- 2026One-Step Prediction Fidelity Is a Poor Proxy for Planning Performance in JEPA World Models
- 2026Predictive but Not Plannable: RC-aux for Latent World Models