mlsanityData to 7 Oct 2026

RAE-NWM: Navigation World Model in Dense Visual Representation Space

arXiv 2603.09241 ↗First posted 10 Mar 2026cs.CV cs.ROcited by 9

On the map: World models → World models for navigation

also in 1 more
Abstract (arXiv)

Visual navigation requires agents to reach goals in complex environments through perception and planning. World models address this task by simulating action-conditioned state transitions to predict future observations. Current navigation world models typically learn state evolution under actions within the compressed latent space of a Variational Autoencoder, where spatial compression often discards fine-grained structural information and hinders precise control. To better understand the propagation characteristics of different representations, we conduct a linear dynamics probe and observe that dense DINOv2 features exhibit stronger linear predictability for action-conditioned transitions. Motivated by this observation, we propose the Representation Autoencoder-based Navigation World Model (RAE-NWM), which models navigation dynamics in a dense visual representation space. We employ a Conditional Diffusion Transformer with Decoupled Diffusion Transformer head (CDiT-DH) to model continuous transitions, and introduce a separate time-driven gating module for dynamics conditioning to regulate action injection strength during generation. Extensive evaluations show that modeling sequential rollouts in this space improves structural stability and action accuracy, benefiting downstream planning and navigation.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 49 of its 58 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

49 of 58 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026An Efficient and Multi-Modal Navigation System with One-Step World Model18 Jan
  2. 2025Aerial World Model for Long-horizon Visual Generation and Navigation in 3D Space26 Dec
  3. 2025Efficient Image-Goal Navigation with Representative Latent World Model14 Nov
  4. 2025A Comprehensive Survey on World Models for Embodied AI19 Oct
  5. 2024Navigation World Models4 Dec

Other references · 44

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
32 more
  1. 2018World Modelscited by 1,444
  2. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  3. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  4. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  5. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  6. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  7. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  8. 2018On Evaluation of Embodied Navigation Agentscited by 526
  9. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  10. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  11. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
  12. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  13. 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
  14. 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
  15. 2025Diffusion Transformers with Representation Autoencoderscited by 275
  16. 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
  17. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
  18. 2023ViNT: A Foundation Model for Visual Navigationcited by 210
  19. 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
  20. 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
  21. 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
  22. 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
  23. 2025DDT: Decoupled Diffusion Transformercited by 100
  24. 2025Masked Autoencoders Are Effective Tokenizers for Diffusion Modelscited by 93
  25. 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
  26. 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 55
  27. 2025DC-AE 1.5: Accelerating Diffusion Model Convergence with Structured Latent Spacecited by 44
  28. 2025UniLiP: Adapting CLIP for Unified Multimodal Understanding, Generation and Editingcited by 43
  29. 2025OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigationcited by 34
  30. 2025Latent Denoising Makes Good Tokenizerscited by 18
  31. 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoEcited by 7
  32. 2025Cloning Deterministic Worlds: The Critical Role of Latent Geometry in Long-Horizon World Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation
  2. 2026Pondering the Way: Spatial-perceiving World Action Model for Embodied Navigation
  3. 2025AstraNav-World: World Model for Foresight Control and Consistency
  4. 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
  5. 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation
  6. 2026Learning Invariant Visual Representations for Planning with Joint-Embedding Predictive World Models
  7. 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN
  8. 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning