mlsanityData to 14 Oct 2026

LMD-PGN: Cross-Modal Knowledge Distillation from First-Person-View Images to Third-Person-View BEV Maps for Universal Point Goal Navigation

arXiv 2412.17282 ↗First posted 23 Dec 2024cs.ROcited by 1

Not on the map. Why?

Abstract (arXiv)

Point goal navigation (PGN) is a mapless navigation approach that trains robots to visually navigate to goal points without relying on pre-built maps. Despite significant progress in handling complex environments using deep reinforcement learning, current PGN methods are designed for single-robot systems, limiting their generalizability to multi-robot scenarios with diverse platforms. This paper addresses this limitation by proposing a knowledge transfer framework for PGN, allowing a teacher robot to transfer its learned navigation model to student robots, including those with unknown or black-box platforms. We introduce a novel knowledge distillation (KD) framework that transfers first-person-view (FPV) representations (view images, turning/forward actions) to universally applicable third-person-view (TPV) representations (local maps, subgoals). The state is redefined as reconstructed local maps using SLAM, while actions are mapped to subgoals on a predefined grid. To enhance training efficiency, we propose a sampling-efficient KD approach that aligns training episodes via a noise-robust local map descriptor (LMD). Although validated on 2D wheeled robots, this method can be extended to 3D action spaces, such as drones. Experiments conducted in Habitat-Sim demonstrate the feasibility of the proposed framework, requiring minimal implementation effort. This study highlights the potential for scalable and cross-platform PGN solutions, expanding the applicability of embodied AI systems in multi-robot scenarios.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). First posted on arXiv 23 Dec 2024.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Transformers for Image-Goal Navigation
  2. 2024CON: Continual Object Navigation via Data-Free Inter-Agent Knowledge Transfer in Unseen and Unfamiliar Places
  3. 2023Robust Navigation with Cross-Modal Fusion and Knowledge Transfer
  4. 2026120 Minutes and a Laptop: Minimalist Image-goal Navigation via Unsupervised Exploration and Offline RL
  5. 2025VLD: Visual Language Goal Distance for Reinforcement Learning Navigation
  6. 2026Training Generalist Navigation Policies via Action Self-Distillation
  7. 2024MiniVLN: Efficient Vision-and-Language Navigation by Progressive Knowledge Distillation
  8. 2019Learning Your Way Without Map or Compass: Panoramic Target Driven Visual Navigation