mlsanityData to 7 Oct 2026

Multi-Horizon Consistency as Geometry: When Latent Dynamics Contract, and When They Do Not

arXiv 2607.21645 ↗First posted 21 Jul 2026cs.LG cs.AIcited by 0

On the map: World models → Latent predictive world models

Abstract (arXiv)

Multi-horizon latent consistency is a common training knob in video predictors and world models, but practitioners rarely know what it does to transition geometry. We treat lambda, the weight on multi-step latent agreement, as a diagnostic control and measure an empirical expansion proxy L20,q95 together with horizon-20 prediction error E20. On Moving-MNIST (n=6 seeds at the critical pair), raising lambda from 0 to 0.8 cuts L20 from 4.96 +/- 2.01 to 1.01 +/- 0.06 (paired t p=0.005, Wilcoxon p=0.031) and halves E20 (0.365 to 0.177, paired t p=1.1e-13). Four of six seeds cross L<1 at lambda=0.8. The same loss does not produce population L<1 on action-conditioned Pendulum-v1 or CartPole-v1, nor on KTH Actions video, even when E20 improves. An associational mediation analysis on MMNIST gives r-hat=0.94 (95% CI [0.88, 1.00], n=27, B=2000); lambda was not randomized. Defensive checks (architectural baselines, exogenous stress, WorldTest, MPC, scaling) mostly support a narrow claim: soft consistency can push passive video toward a near-contractive band, and that band is domain-limited. A stochastic-forcing law L20 ~ 1.23 + 1.82 eta at lambda=0.8 (bootstrap slope CI [1.73, 1.92], R^2=0.96) unifies control domains on the same curve via calibrated eta_eff. Complete joint slices at lambda in {0.4, 1.2} (30/30 cells, 5 eta x 3 seeds) show comparable linear L20(eta) slopes (~1.69 and ~2.00); we do not fit a continuous (lambda, eta) surface. We do not report DreamerV3 or TD-MPC2 returns.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 12 of its 30 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

12 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning19 Jun
  2. 2026ATM: Action-Consistency Transfer Matrix for Diagnosing and Improving Latent World Models8 Jun

Other references · 10

  1. 2023Mastering Diverse Domains through World Modelscited by 1,193
  2. 2018DeepMind Control Suitecited by 935
  3. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  4. 2018Stable Recurrent Modelscited by 65
  5. 2025Training Transformers with Enforced Lipschitz Constantscited by 18
  6. 2026Is the Future Compatible? Diagnosing Dynamic Consistency in World Action Modelscited by 10
  7. 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AIcited by 8
  8. 2025Benchmarking World-Model Learning with Environment-Level Queriescited by 7
  9. 2026Toward Consistent World Models with Multi-Token Prediction and Latent Semantic Enhancementcited by 3
  10. 2026Predictive Objectives Discard Exogenous Control-Relevant Features: A Controlled Mechanistic Studycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning How the World Evolves: Extrapolative Video World Models via Latent Dynamics Reasoning
  2. 2026Identifying Latent Actions and Dynamics from Offline Data via Demonstrator Diversity
  3. 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations
  4. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
  5. 2026Platonic Representation Hypothesis on World Models
  6. 2026OneWorld: Learning Consistent Physics Across Actions in World Models
  7. 2026Counterfactual Action Evaluation, Observation Bottlenecks, and Representation Geometry in Joint-Embedding Predictive World Models
  8. 2026World Models' Last Exam in Physics