Image-Goal Navigation Using Refined Feature Guidance and Scene Graph Enhancement
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce a novel image-goal navigation approach, named RFSG. Our focus lies in leveraging the fine-grained connections between goals, observations, and the environment within limited image data, all the while keeping the navigation architecture simple and lightweight. To this end, we propose the spatial-channel attention mechanism, enabling the network to learn the importance of multi-dimensional features to fuse the goal and observation features. In addition, a selfdistillation mechanism is incorporated to further enhance the feature representation capabilities. Given that the navigation task needs surrounding environmental information for more efficient navigation, we propose an image scene graph to establish feature associations at both the image and object levels, effectively encoding the surrounding scene information. Crossscene performance validation was conducted on the Gibson and HM3D datasets, and the proposed method achieved stateof-the-art results among mainstream methods, with a speed of up to 53.5 frames per second on an RTX3080. This contributes to the realization of end-to-end image-goal navigation in realworld scenarios. The implementation and model of our method have been released at: https://github.com/nubot-nudt/RFSG.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 14 Mar 2025.
Builds on
33 of 39 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 497
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 366
- 2020Learning to Explore using Active Neural SLAMcited by 316
21 more
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
- 2018Semi-parametric Topological Memory for Navigationcited by 209
- 2020Neural Topological SLAM for Visual Navigationcited by 195
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
- 2019Learning Lightweight Lane Detection CNNs by Self Attention Distillationcited by 162
- 2017Neural Map: Structured Memory for Deep Reinforcement Learningcited by 90
- 2022Offline Visual Representation Learning for Embodied Navigationcited by 75
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 70
- 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigationcited by 67
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigationcited by 66
- 2021No RL, No Simulation: Learning to Navigate without Navigatingcited by 65
- 2023Navigating to Objects Specified by Imagescited by 51
- 2023Learning Vision-and-Language Navigation from YouTube Videoscited by 47
- 2022Topological Semantic Graph Memory for Image-Goal Navigationcited by 45
- 2021Curious Representation Learning for Embodied Intelligencecited by 44
- 2024What is YOLOv5: A deep look into the internal features of the popular object detectorcited by 37
- 2023FGPrompt: Fine-grained Goal Prompting for Image-goal Navigationcited by 22
- 2018Active Neural Localizationcited by 18
- 2022Using Both Demonstrations and Language Instructions to Efficiently Learn Robotic Taskscited by 17
- 2019EMPNet: Neural Localisation and Mapping Using Embedded Memory Pointscited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.