PanoNav: Mapless Zero-Shot Object Navigation with Panoramic Scene Parsing and Dynamic Memory
Not on the map. Why?
Abstract (arXiv)
Zero-shot object navigation (ZSON) in unseen environments remains a challenging problem for household robots, requiring strong perceptual understanding and decision-making capabilities. While recent methods leverage metric maps and Large Language Models (LLMs), they often depend on depth sensors or prebuilt maps, limiting the spatial reasoning ability of Multimodal Large Language Models (MLLMs). Mapless ZSON approaches have emerged to address this, but they typically make short-sighted decisions, leading to local deadlocks due to a lack of historical context. We propose PanoNav, a fully RGB-only, mapless ZSON framework that integrates a Panoramic Scene Parsing module to unlock the spatial parsing potential of MLLMs from panoramic RGB inputs, and a Memory-guided Decision-Making mechanism enhanced by a Dynamic Bounded Memory Queue to incorporate exploration history and avoid local deadlocks. Experiments on the public navigation benchmark show that PanoNav significantly outperforms representative baselines in both SR and SPL metrics.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 26 of its 34 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
26 of 34 references.
References · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
14 more
- 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 109
- 2018Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learningcited by 93
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
- 2023Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skillcited by 77
- 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 74
- 2023Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigationcited by 74
- 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMscited by 62
- 2020Semantic Visual Navigation by Watching YouTube Videoscited by 60
- 2024Scaffolding Coordinates to Promote Vision-Language Coordination in Large Multi-Modal Modelscited by 57
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 54
- 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigationcited by 43
- 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
- 2022Zero-shot object goal visual navigationcited by 31
- 2018Frontier Based Exploration for Autonomous Robotcited by 9
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026EAGOR: Embodied Reasoning in Omni-directioncited by 3
- 2026What if? Emulative Simulation with World Models for Situated Reasoningcited by 2
- 2026ReMemNav: Memory-Based Decision Correction and Target Verification for Zero-Shot Object Navigationcited by 2
- 2026MVP-Nav: Multi-layer Value Map Planner Navigatorcited by 1
- 2026Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Methodcited by 1
- 2026REST: Receding Horizon Explorative Steiner Tree for Zero-Shot Object-Goal Navigationcited by 0
- 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routingcited by 0
- 2026UniTrackPLA: Unified Panorama-Language-Action Model for Instruction-Guided Navigation and Dynamic Person Trackingcited by 0
- 2026PreAct-Nav: Agentic Reasoning Before Action for Urban Navigationcited by 0
- 2026PreAct-Nav: Agentic Reasoning Before Action for Urban Navigation4 Oct 2026
- 2026UniTrackPLA: Unified Panorama-Language-Action Model for Instruction-Guided Navigation and Dynamic Person Tracking1 Oct 2026
- 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routing21 Sep 2026
- 2026Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method8 Sep 2026
- 2026EAGOR: Embodied Reasoning in Omni-direction7 Jul 2026
- 2026MVP-Nav: Multi-layer Value Map Planner Navigator30 Jun 2026
- 2026ReMemNav: Memory-Based Decision Correction and Target Verification for Zero-Shot Object Navigation25 Mar 2026
- 2026REST: Receding Horizon Explorative Steiner Tree for Zero-Shot Object-Goal Navigation19 Mar 2026
- 2026What if? Emulative Simulation with World Models for Situated Reasoning6 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Fast-SmartWay: Panoramic-Free End-to-End Zero-Shot Vision-and-Language Navigation
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models
- 2025DyNaVLM: Zero-Shot Vision-Language Navigation System with Dynamic Viewpoints and Self-Refining Graph Memory
- 2022CLIP-Nav: Using CLIP for Zero-Shot Vision-and-Language Navigation
- 2025ImagineNav++: Prompting Vision-Language Models as Embodied Navigator through Scene Imagination
- 2025BeliefMapNav: 3D Voxel-Based Belief Map for Zero-Shot Object Navigation
- 2026AgenticNav: Zero-Shot Vision-and-Language Navigation as a Tool-Calling Harness
- 2026SuperMap: A Spatio-Temporal SLAM System for Visual-Language Navigation ↗