Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning
On the map: World models → Latent predictive world models
Abstract (arXiv)
Recently, world models have emerged as a promising paradigm for building intelligent agents by learning predictive models that estimate future environment states conditioned on observations and actions. In particular, JEPA-style latent world models provide an efficient alternative to pixel space prediction by learning action-conditioned dynamics in compact representation spaces. However, existing latent world models typically rely on one-step prediction and must be recursively rolled out for long-horizon planning, which leads to compounding errors and a mismatch between training objectives and downstream planning tasks. To address this limitation, we propose Variable-length Latent World Models (VLWMs), a framework that learns to predict future latent states conditioned on action sequences of variable lengths. Instead of training only on one-step transitions, VLWMs directly model temporally extended dynamics, allowing the same predictor to evaluate action plans over different horizons. We further introduce a curriculum training strategy that progressively expands the action horizon, stabilizing optimization from short-range dynamics to long-range prediction. At test time, we design planning methods tailored to VLWMs to better exploit their variable-length predictive capabilities. Experiments on long-horizon control tasks show that VLWMs significantly improve latent space world models, achieving 13% average improvement over the state-of-the-art LeWM across different datasets, with especially large gains on tasks requiring extended planning. These results suggest that VLWM provides a simple yet effective paradigm for improving long-horizon prediction and planning in latent world models.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 17 of its 21 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
17 of 21 references.
Closest ancestors · 4
Same direction, newest first
- 2026Hierarchical Planning with Latent World Models3 Apr
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
- 2024Revisiting Feature Prediction for Learning Visual Representations from Video15 Feb
Other references · 13
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2024OGBench: Benchmarking Offline Goal-Conditioned RLcited by 216
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
- 2017Learning to Generate Long-term Future via Hierarchical Predictioncited by 88
- 2025LongCat-Video Technical Reportcited by 73
- 2021VA-RED2: Video Adaptive Redundancy Reductioncited by 15
1 more
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026SAGE: Subgoal-Conditioned Action Generation for Latent World Model Planningcited by 5
- 2026DWM: Separating World Effects from Actions in Latent World Modelscited by 2
- 2026Action from Adjacent Set in Physical Space Outperforms the Best Prediction in World Modelscited by 1
- 2026ActSWM: Action-Sensitive World Models for Long-Horizon Planning in Open-World Gamescited by 1
- 2026Multi-Horizon Consistency as Geometry: When Latent Dynamics Contract, and When They Do Notcited by 0
- 2026FlexiWorld: Learning and Planning via Flexible Action Chunks Across Multiple Time Scalescited by 0
- 2026Beyond a single latent space: a dual-latent world model for long-horizon planningcited by 0
- 2026Beyond a single latent space: a dual-latent world model for long-horizon planning29 Sep 2026
- 2026FlexiWorld: Learning and Planning via Flexible Action Chunks Across Multiple Time Scales28 Sep 2026
- 2026ActSWM: Action-Sensitive World Models for Long-Horizon Planning in Open-World Games29 Jul 2026
- 2026Action from Adjacent Set in Physical Space Outperforms the Best Prediction in World Models26 Jul 2026
- 2026Multi-Horizon Consistency as Geometry: When Latent Dynamics Contract, and When They Do Not21 Jul 2026
- 2026DWM: Separating World Effects from Actions in Latent World Models21 Jul 2026
- 2026SAGE: Subgoal-Conditioned Action Generation for Latent World Model Planning20 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Planning Limits of Latent World Models
- 2026How Long, Not How Close: A Learned Temporal Metric for Planning in Latent World Models
- 2026JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts
- 2026FF-JEPA: Long-Horizon Planning in World Models with Latent Planners
- 2024Simplifying Latent Dynamics with Softly State-Invariant World Models
- 2018Learning Latent Dynamics for Planning from Pixels
- 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations
- 2026Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control