mlsanityData to 14 Oct 2026

MUVLA: Learning to Explore Object Navigation via Map Understanding

arXiv 2509.25966 ↗First posted 30 Sep 2025cs.ROcited by 1

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

In this paper, we present MUVLA, a Map Understanding Vision-Language-Action model tailored for object navigation. It leverages semantic map abstractions to unify and structure historical information, encoding spatial context in a compact and consistent form. MUVLA takes the current and history observations, as well as the semantic map, as inputs and predicts the action sequence based on the description of goal object. Furthermore, it amplifies supervision through reward-guided return modeling based on dense short-horizon progress signals, enabling the model to develop a detailed understanding of action value for reward maximization. MUVLA employs a three-stage training pipeline: learning map-level spatial understanding, imitating behaviors from mixed-quality demonstrations, and reward amplification. This strategy allows MUVLA to unify diverse demonstrations into a robust spatial representation and generate more rational exploration strategies. Experiments on HM3D and Gibson benchmarks demonstrate that MUVLA achieves great generalization and learns effective exploration behaviors even from low-quality or partially successful trajectories.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 37 of its 46 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

37 of 46 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
  5. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  6. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  7. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
  8. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  9. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
  10. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  11. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  12. 2022Visual Language Maps for Robot Navigationcited by 365
25 more
  1. 2022Behavior Transformers: Cloning k modes with one stonecited by 304
  2. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  3. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
  4. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  5. 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
  6. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
  7. 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
  8. 2018Visual Semantic Navigation using Scene Priorscited by 128
  9. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
  10. 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
  11. 2022Navigating to Objects in the Real Worldcited by 106
  12. 2022Q-learning Decision Transformer: Leveraging Dynamic Programming for Conditional Sequence Modelling in Offline RLcited by 103
  13. 2025CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Modelscited by 96
  14. 2024Group Robust Preference Optimization in Reward-free RLHFcited by 95
  15. 2018Visual Representations for Semantic Target Driven Navigationcited by 89
  16. 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 89
  17. 2024Policy Agnostic RL: Offline RL and Online RL Fine-Tuning of Any Class and Backbonecited by 79
  18. 2023Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skillcited by 77
  19. 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 74
  20. 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 67
  21. 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
  22. 2020Semantic Visual Navigation by Watching YouTube Videoscited by 60
  23. 2025ReinboT: Amplifying Robot Visual-Language Manipulation with Reinforcement Learningcited by 47
  24. 2024TriHelper: Zero-Shot Object Navigation with Dynamic Assistancecited by 25
  25. 2024Reinformer: Max-Return Sequence Modeling for Offline RLcited by 25

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigation
  2. 2026Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation
  3. 2024Open-Vocabulary Object-Goal Navigation by Generalizing Semantic Mapping with Dense CLIP
  4. 2026IntentNav: Learning Spatial-Visual Object Navigation from Human Demonstrations ↗
  5. 2023Object Goal Navigation with Recursive Implicit Maps
  6. 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphs
  7. 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
  8. 2026Foresight: Iterative Reasoning About Clues that Matter for Navigation