GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Despite significant progress in Vision-Language Navigation (VLN), existing approaches still rely on dense RGB videos that produce excessive patch tokens and lack explicit spatial structure, resulting in substantial computational overhead and limited spatial reasoning. To address these issues, we introduce the Geometry-Aware BEV (GA-BEV) - a compact, 3D-grounded feature representation that integrates both explicit and implicit geometric cues into multimodal large language model (MLLM) - based navigation systems. We construct BEV spatial maps from RGB-D inputs by projecting visual features into 3D space and aggregating them into an agent-centric layout that preserves geometric consistency while reducing token redundancy. To further enrich geometric understanding, we incorporate features from a pretrained 3D foundation model into the BEV space, injecting structural priors learned from large-scale 3D reconstruction tasks. Together, these complementary cues - explicit depth-based projection and implicit learned priors - yield compact yet spatially expressive representations that substantially improve navigation efficiency and performance. Experiments show that our method achieves state-of-the-art results using only navigation data, without DAgger augmentation or mixed VQA training, demonstrating the robustness and data efficiency of the proposed GA-VLN framework.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 42 of its 49 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
42 of 49 references.
Closest ancestors · 2
Same direction, newest first
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation17 May
- 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models17 Jul
Other references · 40
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 340
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
28 more
- 2019Learning to Navigate Unseen Environments: Back Translation with Environmental Dropoutcited by 241
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
- 2023Towards Learning a Generalist Model for Embodied Navigationcited by 135
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 117
- 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 87
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
- 2025Embodied Navigation Foundation Modelcited by 65
- 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
- 2024Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environmentscited by 49
- 2021Hierarchical Object-to-Zone Graph for Object Navigationcited by 34
- 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 34
- 2025Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigationcited by 21
- 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 18
- 2024Bootstrapping Language-Guided Navigation Learning with Self-Refining Data Flywheelcited by 18
- 2025NavRAG: Generating User Demand Instructions for Embodied Navigation through Retrieval-Augmented LLMcited by 18
- 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 15
- 2025DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigationcited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AdaGeoVLN: Selective Geometry Across Representation Depth and Navigation Time for Vision-Language Navigation ↗
- 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation
- 2026FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigation
- 2024Navigation Instruction Generation with BEV Perception and Large Language Models
- 2026PROSPECT: Unified Streaming Vision-Language Navigation via Semantic--Spatial Fusion and Latent Predictive Representation
- 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN
- 2026Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation
- 2026SparseNav: Instruction-conditioned Sparse Semantic Perception for Training-Free Vision-Language Navigation ↗