Fast LeWorldModel
On the map: World models → Latent predictive world models
Abstract (arXiv)
Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models. For visual planning, however, LeWM evaluates candidate action sequences by repeatedly applying a local one-step latent transition model. This autoregressive rollout makes planning computationally expensive and exposes the predicted trajectory to accumulated latent errors as the horizon grows. We propose Fast LeWorldModel (Fast-LeWM), a fast latent world model that replaces repeated local rollout with action-prefix prediction. Given the current latent and a candidate action sequence, Fast-LeWM encodes its prefixes and predicts the future latents reached after executing those prefixes in parallel. By making action prefixes the basic prediction unit, Fast-LeWM directly models action effects accumulated to different extents over multiple horizons. This prefix-level supervision forces the model to learn how states continuously evolve under different action prefixes, rather than only fitting one-step state transitions. During planning, the predictor can use the prefix token from the encoded action sequence to evaluate the corresponding future latent without explicitly rolling through each intermediate imagined state. Across multiple tasks, Fast-LeWM improves average success over LeWM while substantially reducing planning time, achieving lower open-loop latent loss whose growth becomes significantly slower as the rollout horizon increases.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 25 of its 28 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
25 of 28 references.
Closest ancestors · 10
Same direction, newest first
- 2026Subspace-Decomposed JEPAs: Disentangling Progression and Content in Latent World Models29 May
- 2026Sub-JEPA: Subspace Gaussian Regularization for Stable End-to-End World Models10 May
- 2026Hierarchical Planning with Latent World Models3 Apr
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
- 2024Revisiting Feature Prediction for Learning Visual Representations from Video15 Feb
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture19 Jan
- 2022Joint Embedding Predictive Architectures Focus on Slow Features20 Nov
- 2022Temporal Difference Learning for Model Predictive Control9 Mar
- 2018Learning Latent Dynamics for Planning from Pixels12 Nov
Other references · 15
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2018DeepMind Control Suitecited by 935
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 227
- 2024OGBench: Benchmarking Offline Goal-Conditioned RLcited by 216
- 2025Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Modelscited by 77
3 more
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026DWM: Separating World Effects from Actions in Latent World Modelscited by 2
- 2026Spectral-Target Physical Latent Structuring for JEPA-Style World Modelscited by 0
- 2026FIRM-WM: State-factorized factual-interventional recurrent modeling for reward-free visual planningcited by 0
- 2026D-JEPA: A Decision-Aligned Latent World Modelcited by 0
- 2026Representation World Model: Learning States, Transition and Executable Plans in Representationcited by 0
- 2026AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Controlcited by 0
- 2026Think Fast, Plan Selectively: Adaptive Deliberation for Efficient Data-Driven MPCcited by 0
- 2026FlexiWorld: Learning and Planning via Flexible Action Chunks Across Multiple Time Scalescited by 0
- 2026ATLAS: Aligned Transport of Latent Structure for Reliable World Model Planningcited by 0
- 2026Anisotropic Representations Improve Planning in JEPA World Modelscited by 0
- 2026Beyond a single latent space: a dual-latent world model for long-horizon planningcited by 0
- 2026Learning to Plan from Random Explorationcited by 0
- 2026Learning to Plan from Random Exploration29 Sep 2026
- 2026Beyond a single latent space: a dual-latent world model for long-horizon planning29 Sep 2026
- 2026Anisotropic Representations Improve Planning in JEPA World Models29 Sep 2026
- 2026ATLAS: Aligned Transport of Latent Structure for Reliable World Model Planning28 Sep 2026
- 2026FlexiWorld: Learning and Planning via Flexible Action Chunks Across Multiple Time Scales28 Sep 2026
- 2026Think Fast, Plan Selectively: Adaptive Deliberation for Efficient Data-Driven MPC26 Sep 2026
- 2026AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control24 Sep 2026
- 2026Representation World Model: Learning States, Transition and Executable Plans in Representation24 Sep 2026
- 2026D-JEPA: A Decision-Aligned Latent World Model21 Sep 2026
- 2026FIRM-WM: State-factorized factual-interventional recurrent modeling for reward-free visual planning19 Sep 2026
- 2026Spectral-Target Physical Latent Structuring for JEPA-Style World Models2 Sep 2026
- 2026DWM: Separating World Effects from Actions in Latent World Models21 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Traj-LeWM: Path-Aware World-Model Planning via Latent Trajectory Cost
- 2026No Gaussian Required: Contrastive Inverse Dynamics for JEPA World Models
- 2026Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding
- 2026Adaptive Latent Capacity for World Models
- 2026Learning Visual Feature-Based World Models via Residual Latent Action
- 2026Latent evolving World Action Model
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents
- 2026Frozen in a Frame: The Velocity Blind Spot in JEPA World Models