IG-MCTS: Human-in-the-Loop Cooperative Navigation under Incomplete Information
Not on the map. Why?
Abstract (arXiv)
Human-robot cooperative navigation is challenging under incomplete information. We introduce CoNav-Maze, a simulated environment where a robot navigates with local perception while a human operator provides guidance based on an inaccurate map. The robot can share its onboard camera views to help the operator refine their understanding of the environment. To enable efficient cooperation, we propose Information Gain Monte Carlo Tree Search (IG-MCTS), an online planning algorithm that jointly optimizes autonomous movement and informative communication. IG-MCTS leverages a learned Neural Human Perception Model (NHPM) -- trained on a crowdsourced mapping dataset -- to predict how the human's internal map evolves as new observations are shared. User studies show that IG-MCTS significantly reduces communication demands and yields eye-tracking metrics indicative of lower cognitive load, while maintaining task performance comparable to teleoperation and instruction-following baselines. Finally, we illustrate generalization beyond discrete mazes through a continuous-space waterway navigation setting, in which NHPM benefits from deeper encoder-decoder architectures and IG-MCTS leverages a dynamically constructed Voronoi-partitioned traversability graph.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 34 references that are in the map. First posted on arXiv 3 Feb 2025.
Builds on
11 of 34 references.
References · 11
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
- 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
- 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 308
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 305
- 2015Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Imagescited by 274
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
- 2014Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interactioncited by 43
- 2022Evaluating Long-Term Memory in 3D Mazescited by 43
- 2024Human-Agent Coordination in Games under Incomplete Information via Multi-Step Intentcited by 4
Built on by
Not cited yet.