mlsanityData to 7 Oct 2026

Does Peer Observation Help? Vision-Sharing Collaboration for Vision-Language Navigation

arXiv 2603.20804 ↗First posted 21 Mar 2026cs.CV cs.ROcited by 2

Not on the map. Why?

Abstract (arXiv)

Vision-Language Navigation (VLN) systems are fundamentally constrained by partial observability, as an agent can only accumulate knowledge from locations it has personally visited. As multiple robots increasingly coexist in shared environments, a natural question arises: can agents navigating the same space benefit from each other's observations? In this work, we introduce Co-VLN, a minimalist, model-agnostic framework for systematically investigating whether and how peer observations from concurrently navigating agents can benefit VLN. When independently navigating agents identify common traversed locations, they exchange structured perceptual memory, effectively expanding each agent's receptive field at no additional exploration cost. We validate our framework on the R2R benchmark under two representative paradigms (the learning-based DUET and the zero-shot MapGPT), and conduct extensive analytical experiments to systematically reveal the underlying dynamics of peer observation sharing in VLN. Results demonstrate that vision-sharing enabled model yields substantial performance improvements across both paradigms, establishing a strong foundation for future research in collaborative embodied navigation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 42 of its 47 references that are in the map. First posted on arXiv 21 Mar 2026.

Builds on

42 of 47 references.

References · 42

  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  5. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  6. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  7. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  8. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 337
  9. 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 304
  10. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
  11. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 274
  12. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
30 more
  1. 2024Navigation World Modelscited by 262
  2. 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 228
  3. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
  4. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
  5. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
  6. 2020Improving Vision-and-Language Navigation with Image-Text Pairs from the Webcited by 177
  7. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
  8. 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
  9. 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
  10. 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 108
  11. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
  12. 2019The Regretful Agent: Heuristic-Aided Navigation through Progress Estimationcited by 104
  13. 2024MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigationcited by 85
  14. 2019Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigationcited by 81
  15. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 80
  16. 2025Embodied Navigation Foundation Modelcited by 65
  17. 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
  18. 2022Target-Driven Structured Transformer Planner for Vision-Language Navigationcited by 58
  19. 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
  20. 2025SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigationcited by 29
  21. 2024MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chainscited by 25
  22. 2024Vision-Language Navigation with Energy-Based Policycited by 19
  23. 2021Collaborative Visual Navigationcited by 18
  24. 2024Enhancing Multi-Robot Semantic Navigation Through Multimodal Chain-of-Thought Score Collaborationcited by 14
  25. 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
  26. 2021Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledgecited by 10
  27. 2026SpatialNav: Leveraging Spatial Scene Graphs for Zero-Shot Vision-and-Language Navigationcited by 8
  28. 2025SayCoNav: Utilizing Large Language Models for Adaptive Collaboration in Decentralized Multi-Robot Navigationcited by 5
  29. 2026One Agent to Guide Them All: Empowering MLLMs for Vision-and-Language Navigation via Explicit World Representationcited by 5
  30. 2025MSNav: Zero-Shot Vision-and-Language Navigation with Dynamic Memory and LLM Spatial Reasoningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.