Does Peer Observation Help? Vision-Sharing Collaboration for Vision-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Vision-Language Navigation (VLN) systems are fundamentally constrained by partial observability, as an agent can only accumulate knowledge from locations it has personally visited. As multiple robots increasingly coexist in shared environments, a natural question arises: can agents navigating the same space benefit from each other's observations? In this work, we introduce Co-VLN, a minimalist, model-agnostic framework for systematically investigating whether and how peer observations from concurrently navigating agents can benefit VLN. When independently navigating agents identify common traversed locations, they exchange structured perceptual memory, effectively expanding each agent's receptive field at no additional exploration cost. We validate our framework on the R2R benchmark under two representative paradigms (the learning-based DUET and the zero-shot MapGPT), and conduct extensive analytical experiments to systematically reveal the underlying dynamics of peer observation sharing in VLN. Results demonstrate that vision-sharing enabled model yields substantial performance improvements across both paradigms, establishing a strong foundation for future research in collaborative embodied navigation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 42 of its 47 references that are in the map. First posted on arXiv 21 Mar 2026.
Builds on
42 of 47 references.
References · 42
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
- 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 337
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 304
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 274
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
30 more
- 2024Navigation World Modelscited by 262
- 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 228
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
- 2020Improving Vision-and-Language Navigation with Image-Text Pairs from the Webcited by 177
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
- 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 108
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
- 2019The Regretful Agent: Heuristic-Aided Navigation through Progress Estimationcited by 104
- 2024MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigationcited by 85
- 2019Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigationcited by 81
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 80
- 2025Embodied Navigation Foundation Modelcited by 65
- 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
- 2022Target-Driven Structured Transformer Planner for Vision-Language Navigationcited by 58
- 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
- 2025SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigationcited by 29
- 2024MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chainscited by 25
- 2024Vision-Language Navigation with Energy-Based Policycited by 19
- 2021Collaborative Visual Navigationcited by 18
- 2024Enhancing Multi-Robot Semantic Navigation Through Multimodal Chain-of-Thought Score Collaborationcited by 14
- 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
- 2021Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledgecited by 10
- 2026SpatialNav: Leveraging Spatial Scene Graphs for Zero-Shot Vision-and-Language Navigationcited by 8
- 2025SayCoNav: Utilizing Large Language Models for Adaptive Collaboration in Decentralized Multi-Robot Navigationcited by 5
- 2026One Agent to Guide Them All: Empowering MLLMs for Vision-and-Language Navigation via Explicit World Representationcited by 5
- 2025MSNav: Zero-Shot Vision-and-Language Navigation with Dynamic Memory and LLM Spatial Reasoningcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.