mlsanityData to 14 Oct 2026

Decision-Metric Alignment in Latent World Models: Diagnostics and Action-Conditioned Objectives for MPC Planning

arXiv 2608.18746 ↗First posted 19 Aug 2026cs.LG cs.CVcited by 7

On the map: World models → Latent predictive world models

Abstract (arXiv)

JEPA-style latent world models can use Euclidean distance to a goal latent as the cost for model-predictive control (MPC). Strong decoding of task variables, however, does not guarantee that this particular cost ranks candidate action sequences by real task progress. We call the latter property decision-metric alignment. We introduce Plan-Real Spearman, which measures latent--real rank agreement on random plans, and CEM-stage Spearman, which measures the same agreement as cross-entropy-method (CEM) search concentrates its proposal. We analyze sufficient conditions under which latent distance preserves real-cost rankings, identifying encoder distortion, terminal rollout error, and candidate margins as the controlling quantities. Guided by the observed empirical alignment gap, DA-LeWM augments LeWM with inverse-dynamics and demonstration-conditioned goal-action heads. Across all our experiments, DA-LeWM accelerates convergence and achieves higher online success than LeWM, while probe scores remain similar. These results show that action-conditioned objectives improve the geometry used by Euclidean-cost, CEM-based latent MPC.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 20 of its 29 references that are in the map. First posted on arXiv 19 Aug 2026.

Builds on

20 of 29 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
  2. 2018Learning Latent Dynamics for Planning from Pixels12 Nov

Other references · 18

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  4. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  5. 2023Mastering Diverse Domains through World Modelscited by 1,253
  6. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
  7. 2017Hindsight Experience Replaycited by 1,136
  8. 2020Mastering Atari with Discrete World Modelscited by 1,007
  9. 2018DeepMind Control Suitecited by 956
  10. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  11. 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
  12. 2020CURL: Contrastive Unsupervised Representations for Reinforcement Learningcited by 760
6 more
  1. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
  2. 2022DayDreamer: World Models for Physical Robot Learningcited by 400
  3. 2020Data-Efficient Reinforcement Learning with Self-Predictive Representationscited by 318
  4. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  5. 2024OGBench: Benchmarking Offline Goal-Conditioned RLcited by 238
  6. 2019DeepMDP: Learning Continuous Latent Space Models for Representation Learningcited by 207

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026D-JEPA: A Decision-Aligned Latent World Model
  2. 2026ATLAS: Aligned Transport of Latent Structure for Reliable World Model Planning
  3. 2026Latent Geometry Beyond Search: Amortizing Planning in World Models
  4. 2026How Long, Not How Close: A Learned Temporal Metric for Planning in Latent World Models
  5. 2026AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control
  6. 2026One-Step Prediction Fidelity Is a Poor Proxy for Planning Performance in JEPA World Models
  7. 2026Latent Energy Action Planning with World Models
  8. 2026Action-Consequence Alignment for Reliable Planning and Self-Improving in Latent World Models