CON: Continual Object Navigation via Data-Free Inter-Agent Knowledge Transfer in Unseen and Unfamiliar Places
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
This work explores the potential of brief inter-agent knowledge transfer (KT) to enhance the robotic object goal navigation (ON) in unseen and unfamiliar environments. Drawing on the analogy of human travelers acquiring local knowledge, we propose a framework in which a traveler robot (student) communicates with local robots (teachers) to obtain ON knowledge through minimal interactions. We frame this process as a data-free continual learning (CL) challenge, aiming to transfer knowledge from a black-box model (teacher) to a new model (student). In contrast to approaches like zero-shot ON using large language models (LLMs), which utilize inherently communication-friendly natural language for knowledge representation, the other two major ON approaches -- frontier-driven methods using object feature maps and learning-based ON using neural state-action maps -- present complex challenges where data-free KT remains largely uncharted. To address this gap, we propose a lightweight, plug-and-play KT module targeting non-cooperative black-box teachers in open-world settings. Using the universal assumption that every teacher robot has vision and mobility capabilities, we define state-action history as the primary knowledge base. Our formulation leads to the development of a query-based occupancy map that dynamically represents target object locations, serving as an effective and communication-friendly knowledge representation. We validate the effectiveness of our method through experiments conducted in the Habitat environment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 9 references that are in the map. First posted on arXiv 23 Sep 2024.
Builds on
6 of 9 references.
Closest ancestors · 1
Same direction, newest first
Other references · 5
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2018CPlaNet: Enhancing Image Geolocalization by Combinatorial Partitioning of Mapscited by 68
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 53
- 2023Active Robot Vision for Distant Object Change Detection: A Lightweight Training Simulator Inspired by Multi-Armed Banditscited by 1
- 2024Training Self-localization Models for Unseen Unfamiliar Places via Teacher-to-Student Data-Free Knowledge Transfercited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Lifelong Embodied Navigation Learning
- 2026HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigation
- 2025GET: Goal-directed Exploration and Targeting for Large-Scale Unknown Environments
- 2026SSMG-Nav: Enhancing Lifelong Object Navigation with Semantic Skeleton Memory Graph
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
- 2026GoalVLM: VLM-driven Object Goal Navigation for Multi-Agent System
- 2025Landmark-Guided Knowledge for Vision-and-Language Navigation
- 2023KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigation