mlsanityData to 7 Oct 2026

Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning

arXiv 2606.21775 ↗First posted 19 Jun 2026cs.LG cs.AIcited by 7

On the map: World models → Latent predictive world models

Abstract (arXiv)

Recently, world models have emerged as a promising paradigm for building intelligent agents by learning predictive models that estimate future environment states conditioned on observations and actions. In particular, JEPA-style latent world models provide an efficient alternative to pixel space prediction by learning action-conditioned dynamics in compact representation spaces. However, existing latent world models typically rely on one-step prediction and must be recursively rolled out for long-horizon planning, which leads to compounding errors and a mismatch between training objectives and downstream planning tasks. To address this limitation, we propose Variable-length Latent World Models (VLWMs), a framework that learns to predict future latent states conditioned on action sequences of variable lengths. Instead of training only on one-step transitions, VLWMs directly model temporally extended dynamics, allowing the same predictor to evaluate action plans over different horizons. We further introduce a curriculum training strategy that progressively expands the action horizon, stabilizing optimization from short-range dynamics to long-range prediction. At test time, we design planning methods tailored to VLWMs to better exploit their variable-length predictive capabilities. Experiments on long-horizon control tasks show that VLWMs significantly improve latent space world models, achieving 13% average improvement over the state-of-the-art LeWM across different datasets, with especially large gains on tasks requiring extended planning. These results suggest that VLWM provides a simple yet effective paradigm for improving long-horizon prediction and planning in latent world models.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 17 of its 21 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

17 of 21 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Hierarchical Planning with Latent World Models3 Apr
  2. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
  3. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
  4. 2024Revisiting Feature Prediction for Learning Visual Representations from Video15 Feb

Other references · 13

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  3. 2018World Modelscited by 1,444
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  5. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  6. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  7. 2024OGBench: Benchmarking Offline Goal-Conditioned RLcited by 216
  8. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
  9. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  10. 2017Learning to Generate Long-term Future via Hierarchical Predictioncited by 88
  11. 2025LongCat-Video Technical Reportcited by 73
  12. 2021VA-RED2: Video Adaptive Redundancy Reductioncited by 15
1 more
  1. 2026ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Modelcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Planning Limits of Latent World Models
  2. 2026How Long, Not How Close: A Learned Temporal Metric for Planning in Latent World Models
  3. 2026JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts
  4. 2026FF-JEPA: Long-Horizon Planning in World Models with Latent Planners
  5. 2024Simplifying Latent Dynamics with Softly State-Invariant World Models
  6. 2018Learning Latent Dynamics for Planning from Pixels
  7. 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations
  8. 2026Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control