mlsanityData to 7 Oct 2026

GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation

arXiv 2605.22036 ↗First posted 21 May 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Despite significant progress in Vision-Language Navigation (VLN), existing approaches still rely on dense RGB videos that produce excessive patch tokens and lack explicit spatial structure, resulting in substantial computational overhead and limited spatial reasoning. To address these issues, we introduce the Geometry-Aware BEV (GA-BEV) - a compact, 3D-grounded feature representation that integrates both explicit and implicit geometric cues into multimodal large language model (MLLM) - based navigation systems. We construct BEV spatial maps from RGB-D inputs by projecting visual features into 3D space and aggregating them into an agent-centric layout that preserves geometric consistency while reducing token redundancy. To further enrich geometric understanding, we incorporate features from a pretrained 3D foundation model into the BEV space, injecting structural priors learned from large-scale 3D reconstruction tasks. Together, these complementary cues - explicit depth-based projection and implicit learned priors - yield compact yet spatially expressive representations that substantially improve navigation efficiency and performance. Experiments show that our method achieves state-of-the-art results using only navigation data, without DAgger augmentation or mixed VQA training, demonstrating the robustness and data efficiency of the proposed GA-VLN framework.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 42 of its 49 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

42 of 49 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation17 May
  2. 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models17 Jul

Other references · 40

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  5. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  6. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  7. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  8. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
  9. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  10. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  11. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 340
  12. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
28 more
  1. 2019Learning to Navigate Unseen Environments: Back Translation with Environmental Dropoutcited by 241
  2. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
  3. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
  4. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
  5. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
  6. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
  7. 2023Towards Learning a Generalist Model for Embodied Navigationcited by 135
  8. 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
  9. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 117
  10. 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
  11. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
  12. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
  13. 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
  14. 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 87
  15. 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
  16. 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
  17. 2025Embodied Navigation Foundation Modelcited by 65
  18. 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
  19. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
  20. 2024Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environmentscited by 49
  21. 2021Hierarchical Object-to-Zone Graph for Object Navigationcited by 34
  22. 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 34
  23. 2025Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigationcited by 21
  24. 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 18
  25. 2024Bootstrapping Language-Guided Navigation Learning with Self-Refining Data Flywheelcited by 18
  26. 2025NavRAG: Generating User Demand Instructions for Embodied Navigation through Retrieval-Augmented LLMcited by 18
  27. 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 15
  28. 2025DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigationcited by 15

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AdaGeoVLN: Selective Geometry Across Representation Depth and Navigation Time for Vision-Language Navigation ↗
  2. 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation
  3. 2026FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigation
  4. 2024Navigation Instruction Generation with BEV Perception and Large Language Models
  5. 2026PROSPECT: Unified Streaming Vision-Language Navigation via Semantic--Spatial Fusion and Latent Predictive Representation
  6. 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN
  7. 2026Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation
  8. 2026SparseNav: Instruction-conditioned Sparse Semantic Perception for Training-Free Vision-Language Navigation ↗