SysNav: Multi-Level Systematic Cooperation Enables Real-World, Cross-Embodiment Object Navigation
Not on the map. Why?
Abstract (arXiv)
Object navigation (ObjectNav) in real-world environments is a complex problem that requires simultaneously addressing multiple challenges, including complex spatial structure, long-horizon planning and semantic understanding. Recent advances in Vision-Language Models (VLMs) offer promising capabilities for semantic understanding, yet effectively integrating them into real-world navigation systems remains a non-trivial challenge. In this work, we formulate real-world ObjectNav as a system-level problem and introduce SysNav, a three-level ObjectNav system designed for real-world crossembodiment deployment. SysNav decouples semantic reasoning, navigation planning and motion control to ensure robustness and generalizability. At the high-level, we summarize the environment into a structured scene representation and leverage VLMs to provide semantic-grounded navigation guidance. At the mid-level, we introduce a hierarchical room-based navigation strategy that reserves VLM guidance for room-level decisions, which effectively utilizes its reasoning ability while ensuring system efficiency. At the low-level, planned waypoints are executed through different embodiment-specific motion control modules. We deploy our system on three embodiments, a custom-built wheeled robot, the Unitree Go2 quadruped and the Unitree G1 humanoid, and conduct 190 real-world experiments. Our system achieves substantial improvements in both success rate and navigation efficiency. To the best of our knowledge, SysNav is the first system capable of reliably and efficiently completing building-scale long-range object navigation in complex real-world environments. Furthermore, extensive experiments on four simulation benchmarks demonstrate state-of-the-art performance. Project page is available at: https://cmu-vln.github.io/.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Mar 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Towards the Harness of Embodied Agentscited by 9
- 2026EA-Nav: Learning Safe Visual Navigation Policies with Embodiment Awarenesscited by 0
- 2026OpenBelief-Nav: Evidence-Preserving Object Memory for Open-Vocabulary Language-Guided Navigationcited by 0
- 2026AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigationcited by 0
- 2026AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation10 Sep 2026
- 2026OpenBelief-Nav: Evidence-Preserving Object Memory for Open-Vocabulary Language-Guided Navigation14 Aug 2026
- 2026Towards the Harness of Embodied Agents3 Aug 2026
- 2026EA-Nav: Learning Safe Visual Navigation Policies with Embodiment Awareness22 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025FiLM-Nav: Efficient and Generalizable Navigation via VLM Fine-tuning
- 2025STRIVE: Structured Representation Integrating VLM Reasoning for Efficient Object Navigation
- 20263DGSNav: Enhancing Vision-Language Model Reasoning for Object Navigation via Active 3D Gaussian Splatting
- 2025NavA3: Understanding Any Instruction, Navigating Anywhere, Finding Anything
- 2026CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigation
- 2026Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation
- 2026A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration ↗
- 2026OmniVLN: Omnidirectional 3D Perception and Token-Efficient LLM Reasoning for Visual-Language Navigation across Air and Ground Platforms