Latent World Models with Monotone Planning Costs for Image-Goal Navigation
On the map: World models → World models for navigation
Abstract (arXiv)
Image-goal navigation with latent world models requires not only accurate future prediction, but also a planning cost that reliably ranks candidate action sequences. We define the cost as the cosine distance between the predicted future embedding and the goal embedding, and show that poor cost ordering can mislead sampling-based planners such as Cross-Entropy Method (CEM). To address this, we propose a latent world model built on a frozen DINO-family encoder and train it with two complementary objectives. An autoregressive rollout loss reduces the gap between training and multi-step planning rollouts, while a Monotone Cost Ranking (MCR) loss directly encourages increasingly perturbed action sequences to receive higher planning costs. We also study InfoNCE-based action-contrastive training and find that temporal permutation negatives distort the latent geometry and degrade planning performance. On the GNM navigation dataset, our method outperforms Navigation World Models (NWM), DINO-WM, OmniVLA, and NoMaD, achieving state-of-the-art image-goal navigation performance while reducing orientation error by 2.7× over the same-encoder DINO WM baseline. We also deploy the model zero-shot on a physical robot, where it follows goal-directed paths in unseen indoor and outdoor environments.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 15 of its 36 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
15 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2024Navigation World Models4 Dec
- 2024X-MOBILITY: End-To-End Generalizable Navigation via World Modeling23 Oct
Other references · 13
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
- 2025Back to the Features: DINO as a Foundation for Video World Modelscited by 56
- 2026Learning Latent Action World Models In The Wildcited by 42
- 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?cited by 37
- 2025OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigationcited by 34
- 2026Hierarchical Planning with Latent World Modelscited by 34
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026FIRM-WM: State-factorized factual-interventional recurrent modeling for reward-free visual planningcited by 0
- 2026Visual Representation and History Modeling for Navigation World Modelscited by 0
- 2026Aim Short to Reach Far: Your Frozen World Model Can Plan Better Than You Thinkcited by 0
- 2026In CEM, a World Model Is Also a Proposal Mechanismcited by 0
- 2026In CEM, a World Model Is Also a Proposal Mechanism1 Oct 2026
- 2026Aim Short to Reach Far: Your Frozen World Model Can Plan Better Than You Think24 Sep 2026
- 2026FIRM-WM: State-factorized factual-interventional recurrent modeling for reward-free visual planning19 Sep 2026
- 2026Visual Representation and History Modeling for Navigation World Models26 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025Efficient Image-Goal Navigation with Representative Latent World Model
- 2026MWM: Mobile World Models for Action-Conditioned Consistent Prediction
- 2026Policy-Guided World Model Planning for Language-Conditioned Visual Navigation
- 2026How Long, Not How Close: A Learned Temporal Metric for Planning in Latent World Models
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation
- 2026WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation
- 2026EpicWorldModel: Exploration-driven Planning with Latent World Models