mlsanityData to 14 Oct 2026

RSRNav: Reasoning Spatial Relationship for Image-Goal Navigation

arXiv 2504.17991 ↗First posted 25 Apr 2025cs.CV cs.ROcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent image-goal navigation (ImageNav) methods learn a perception-action policy by separately capturing semantic features of the goal and egocentric images, then passing them to a policy network. However, challenges remain: (1) Semantic features often fail to provide accurate directional information, leading to superfluous actions, and (2) performance drops significantly when viewpoint inconsistencies arise between training and application. To address these challenges, we propose RSRNav, a simple yet effective method that reasons spatial relationships between the goal and current observations as navigation guidance. Specifically, we model the spatial relationship by constructing correlations between the goal and current observations, which are then passed to the policy network for action prediction. These correlations are progressively refined using fine-grained cross-correlation and direction-aware correlation for more precise navigation. Extensive evaluation of RSRNav on three benchmark datasets demonstrates superior navigation performance, particularly in the "user-matched goal" setting, highlighting its potential for real-world applications.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 25 Apr 2025.

Builds on

34 of 52 references.

References · 34

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  5. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  6. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  7. 2018On Evaluation of Embodied Navigation Agentscited by 547
  8. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
  9. 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 366
  10. 2020Learning to Explore using Active Neural SLAMcited by 316
  11. 2020Neural Topological SLAM for Visual Navigationcited by 195
  12. 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
22 more
  1. 2019Goal-conditioned Imitation Learningcited by 162
  2. 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
  3. 2022Offline Visual Representation Learning for Embodied Navigationcited by 75
  4. 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 70
  5. 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigationcited by 67
  6. 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigationcited by 66
  7. 2021No RL, No Simulation: Learning to Navigate without Navigatingcited by 65
  8. 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
  9. 2022Instance-Specific Image Goal Navigation: Training Embodied Agents to Find Object Instancescited by 55
  10. 2023Navigating to Objects Specified by Imagescited by 51
  11. 2022Topological Semantic Graph Memory for Image-Goal Navigationcited by 45
  12. 2021Curious Representation Learning for Embodied Intelligencecited by 44
  13. 2022Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrievalcited by 34
  14. 2022Last-Mile Embodied Visual Navigationcited by 25
  15. 2024Towards Generalizable Multi-Object Trackingcited by 23
  16. 2022Cross-Lingual Cross-Modal Retrieval with Noise-Robust Learningcited by 22
  17. 2023FGPrompt: Fine-grained Goal Prompting for Image-goal Navigationcited by 22
  18. 2024MemoNav: Working Memory Model for Visual Navigationcited by 13
  19. 2023CL2CM: Improving Cross-Lingual Cross-Modal Retrieval via Cross-Lingual Knowledge Transfercited by 10
  20. 2023Dual-view Curricular Optimal Transport for Cross-lingual Cross-modal Retrievalcited by 9
  21. 2024Feudal Networks for Visual Navigationcited by 4
  22. 2025UP-Person: Unified Parameter-Efficient Transfer Learning for Text-based Person Retrievalcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.