GN0: Toward a Unified Paradigm for Generation, Evaluation, and Policy Learning in Visual-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Embodied navigation connects intelligent agents with the physical world and is fundamental for general robotic intelligence. Limited availability and quality of navigation data have constrained Vision-and-Language Navigation (VLN) systems' generalization and long-horizon capabilities. To address this, we curate diverse 3D scenes and develop an automated pipeline for large-scale navigation data, resulting in the GN-Matrix dataset. Building on a 3D Gaussian Splatting (3DGS) engine, we introduce a high-fidelity simulation platform supporting interactive roaming and collision-aware navigation. We further propose GN-Bench, the first BEV-based benchmark incorporating dynamic 3DGS avatars for human-robot interaction evaluation. To leverage the simulator, we develop an RL-driven navigation foundation model, Break and Establish (BAE). After supervised learning, DAgger exposes the model to rollout-induced states, breaking narrow expert-centric distributions and enabling downstream RL exploration. This unified VLN paradigm integrates map-based and map-free tasks, including instruction following, human following, and goal navigation. GN-BAE formalizes high-fidelity 3DGS-rendered Bird's Eye View representations as compact memory, unlocking latent spatial reasoning in VLMs. Extensive evaluations on GN-Bench and VLN-CE show that GN0 outperforms state-of-the-art VLN methods. Overall, GN-Matrix offers a unified framework spanning data, simulation, and learning, advancing embodied navigation in research and industrial applications.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Jun 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation Systemcited by 11
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoningcited by 3
- 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLNcited by 2
- 2026RiverVLN: Phase-Grounded Temporal Vision--Language Navigation for Unmanned Surface Vehiclescited by 0
- 2026AVERT-VLN: Abstention-aware Visual Error Recovery and Training for Vision-and-Language Navigationcited by 0
- 2026SMART: Zero-Shot Sim-to-Real Articulated Object Manipulation via Large-Scale Synthetic Pretrainingcited by 0
- 2026SMART: Zero-Shot Sim-to-Real Articulated Object Manipulation via Large-Scale Synthetic Pretraining6 Oct 2026
- 2026AVERT-VLN: Abstention-aware Visual Error Recovery and Training for Vision-and-Language Navigation30 Sep 2026
- 2026RiverVLN: Phase-Grounded Temporal Vision--Language Navigation for Unmanned Surface Vehicles20 Sep 2026
- 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN7 Aug 2026
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System16 Jun 2026
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning8 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025VLNVerse: A Benchmark for Vision-Language Navigation with Versatile, Embodied, Realistic Simulation and Evaluation
- 2024Human-Aware Vision-and-Language Navigation: Bridging Simulation to Reality with Dynamic Human Interactions
- 2023Scaling Data Generation in Vision-and-Language Navigation
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
- 20263DGSNav: Enhancing Vision-Language Model Reasoning for Object Navigation via Active 3D Gaussian Splatting
- 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigation