RAE-NWM: Navigation World Model in Dense Visual Representation Space
On the map: World models → World models for navigation
also in 1 more
Abstract (arXiv)
Visual navigation requires agents to reach goals in complex environments through perception and planning. World models address this task by simulating action-conditioned state transitions to predict future observations. Current navigation world models typically learn state evolution under actions within the compressed latent space of a Variational Autoencoder, where spatial compression often discards fine-grained structural information and hinders precise control. To better understand the propagation characteristics of different representations, we conduct a linear dynamics probe and observe that dense DINOv2 features exhibit stronger linear predictability for action-conditioned transitions. Motivated by this observation, we propose the Representation Autoencoder-based Navigation World Model (RAE-NWM), which models navigation dynamics in a dense visual representation space. We employ a Conditional Diffusion Transformer with Decoupled Diffusion Transformer head (CDiT-DH) to model continuous transitions, and introduce a separate time-driven gating module for dynamics conditioning to regulate action injection strength during generation. Extensive evaluations show that modeling sequential rollouts in this space improves structural stability and action accuracy, benefiting downstream planning and navigation.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 49 of its 58 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
49 of 58 references.
Closest ancestors · 5
Same direction, newest first
- 2026An Efficient and Multi-Modal Navigation System with One-Step World Model18 Jan
- 2025Aerial World Model for Long-horizon Visual Generation and Navigation in 3D Space26 Dec
- 2025Efficient Image-Goal Navigation with Representative Latent World Model14 Nov
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct
- 2024Navigation World Models4 Dec
Other references · 44
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
32 more
- 2018World Modelscited by 1,444
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2025DDT: Decoupled Diffusion Transformercited by 100
- 2025Masked Autoencoders Are Effective Tokenizers for Diffusion Modelscited by 93
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 55
- 2025DC-AE 1.5: Accelerating Diffusion Model Convergence with Structured Latent Spacecited by 44
- 2025UniLiP: Adapting CLIP for Unified Multimodal Understanding, Generation and Editingcited by 43
- 2025OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigationcited by 34
- 2025Latent Denoising Makes Good Tokenizerscited by 18
- 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoEcited by 7
- 2025Cloning Deterministic Worlds: The Critical Role of Latent Geometry in Long-Horizon World Modelscited by 3
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Modelscited by 21
- 2026WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modelingcited by 3
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigationcited by 2
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigationcited by 2
- 2026Drift-Resistant Navigation World Model with Anchored Epipolar Guidancecited by 1
- 2026WAVE-Go: World-Model Navigation with Adaptive Execution for Wheel-Legged Robotscited by 0
- 2026Feeling Terrain Before Crossing: World Models for Off-Road Navigationcited by 0
- 2026Skytopia: Monocular Drone Navigation with Action-Conditioned Latent World Modelscited by 0
- 2026Visual Representation and History Modeling for Navigation World Modelscited by 0
- 2026Skytopia: Monocular Drone Navigation with Action-Conditioned Latent World Models22 Sep 2026
- 2026Feeling Terrain Before Crossing: World Models for Off-Road Navigation17 Sep 2026
- 2026WAVE-Go: World-Model Navigation with Adaptive Execution for Wheel-Legged Robots16 Sep 2026
- 2026Visual Representation and History Modeling for Navigation World Models26 Aug 2026
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigation6 Aug 2026
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation4 Aug 2026
- 2026Drift-Resistant Navigation World Model with Anchored Epipolar Guidance23 May 2026
- 2026WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modeling7 May 2026
- 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation
- 2026Pondering the Way: Spatial-perceiving World Action Model for Embodied Navigation
- 2025AstraNav-World: World Model for Foresight Control and Consistency
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation
- 2026Learning Invariant Visual Representations for Planning with Joint-Embedding Predictive World Models
- 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning