A Behavioral Approach to Visual Navigation with Graph Localization Networks
Not on the map. Why?
Abstract (arXiv)
Inspired by research in psychology, we introduce a behavioral approach for visual navigation using topological maps. Our goal is to enable a robot to navigate from one location to another, relying only on its visual input and the topological map of the environment. We propose using graph neural networks for localizing the agent in the map, and decompose the action space into primitive behaviors implemented as convolutional or recurrent neural networks. Using the Gibson simulator, we verify that our approach outperforms relevant baselines and is able to navigate in both seen and unseen environments.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 13; 2023: 2; 2024: 4; 2025: 2; 2026: 3.
40 papers.
Sort:
By area:
- 2022Open-vocabulary Queryable Scene Representations for Real World Planningcited by 159
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
- 2021Capturing, Reconstructing, and Simulating: the UrbanScene3D Datasetcited by 117
- 2021Structured Scene Memory for Vision-Language Navigationcited by 95
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigationcited by 64
- 2021No RL, No Simulation: Learning to Navigate without Navigatingcited by 63
- 2021VTNet: Visual Transformer Network for Object Goal Navigationcited by 50
- 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networkscited by 50
- 2022Sound Adversarial Audio-Visual Navigationcited by 46
- 2021Catch Me If You Hear Me: Audio-Visual Navigation in Complex Unmapped Environments with Moving Soundscited by 40
- 2022Continuous Scene Representations for Embodied AIcited by 39
- 2021Predicting the Future from First Person (Egocentric) Vision: A Surveycited by 36
28 more
- 2021Hierarchical Object-to-Zone Graph for Object Navigationcited by 34
- 2022One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestonescited by 26
- 2024RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigationcited by 25
- 2022Learning Active Camera for Multi-Object Navigationcited by 20
- 2022Pay Self-Attention to Audio-Visual Navigationcited by 17
- 2022ExAug: Robot-Conditioned Navigation Policies via Geometric Experience Augmentationcited by 17
- 2021Agent-Centric Relation Graph for Object Visual Navigationcited by 10
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigationcited by 8
- 2021A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environmentcited by 6
- 2021Zero-Shot Reinforcement Learning on Graphs for Autonomous Exploration Under Uncertaintycited by 6
- 2022A Simple Approach for Visual Rearrangement: 3D Mapping and Semantic Searchcited by 6
- 2024Feudal Networks for Visual Navigationcited by 4
- 2021VGF-Net: Visual-Geometric Fusion Learning for Simultaneous Drone Navigation and Height Mappingcited by 3
- 2021Self-Supervised Domain Adaptation for Visual Navigation with Global Map Consistencycited by 3
- 2022MoDA: Map style transfer for self-supervised Domain Adaptation of embodied agentscited by 3
- 2022A General Purpose Supervisory Signal for Embodied Agentscited by 3
- 2021Deep Learning for Embodied Vision Navigation: A Surveycited by 2
- 2023Building Category Graphs Representation with Spatial and Temporal Attention for Visual Navigationcited by 2
- 2021Graph Convolutional Memory using Topological Priorscited by 1
- 2023Task-Driven Graph Attention for Hierarchical Relational Object Navigationcited by 1
- 2025Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigationcited by 1
- 2026Rectified Schr"odinger Bridge Matching for Few-Step Visual Navigationcited by 1
- 2022Dynamical Audio-Visual Navigation: Catching Unheard Moving Sound Sources in Unmapped 3D Environmentscited by 0
- 2022Predicting Topological Maps for Visual Navigation in Unexplored Environmentscited by 0
- 2024Semantic Environment Atlas for Object-Goal Navigationcited by 0
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environmentscited by 0
- 2026FeudalNav: A Simple Framework for Visual Navigationcited by 0
- 2026Scene Representation using 360deg Saliency Graph and its Application in Vision-based Indoor Navigationcited by 0
- 2026Rectified Schr"odinger Bridge Matching for Few-Step Visual Navigation7 Apr 2026
- 2026Scene Representation using 360deg Saliency Graph and its Application in Vision-based Indoor Navigation20 Mar 2026
- 2026FeudalNav: A Simple Framework for Visual Navigation15 Jan 2026
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environments30 Dec 2025
- 2025Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation24 Dec 2025
- 2024Semantic Environment Atlas for Object-Goal Navigation5 Oct 2024
- 2024RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigation9 May 2024
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigation1 Mar 2024
- 2024Feudal Networks for Visual Navigation19 Feb 2024
- 2023Building Category Graphs Representation with Spatial and Temporal Attention for Visual Navigation6 Dec 2023
- 2023Task-Driven Graph Attention for Hierarchical Relational Object Navigation23 Jun 2023
- 2022A General Purpose Supervisory Signal for Embodied Agents1 Dec 2022
28 more
- 2022MoDA: Map style transfer for self-supervised Domain Adaptation of embodied agents29 Nov 2022
- 2022Predicting Topological Maps for Visual Navigation in Unexplored Environments23 Nov 2022
- 2022Learning Active Camera for Multi-Object Navigation14 Oct 2022
- 2022ExAug: Robot-Conditioned Navigation Policies via Geometric Experience Augmentation14 Oct 2022
- 2022Pay Self-Attention to Audio-Visual Navigation4 Oct 2022
- 2022Open-vocabulary Queryable Scene Representations for Real World Planning20 Sep 2022
- 2022A Simple Approach for Visual Rearrangement: 3D Mapping and Semantic Search21 Jun 2022
- 2022Continuous Scene Representations for Embodied AI31 Mar 2022
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation5 Mar 2022
- 2022Sound Adversarial Audio-Visual Navigation22 Feb 2022
- 2022One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestones14 Feb 2022
- 2022Dynamical Audio-Visual Navigation: Catching Unheard Moving Sound Sources in Unmapped 3D Environments12 Jan 2022
- 2021Catch Me If You Hear Me: Audio-Visual Navigation in Complex Unmapped Environments with Moving Sounds29 Nov 2021
- 2021Agent-Centric Relation Graph for Object Visual Navigation29 Nov 2021
- 2021No RL, No Simulation: Learning to Navigate without Navigating18 Oct 2021
- 2021Self-Supervised Domain Adaptation for Visual Navigation with Global Map Consistency14 Oct 2021
- 2021Hierarchical Object-to-Zone Graph for Object Navigation5 Sep 2021
- 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks2 Aug 2021
- 2021Predicting the Future from First Person (Egocentric) Vision: A Survey28 Jul 2021
- 2021Capturing, Reconstructing, and Simulating: the UrbanScene3D Dataset9 Jul 2021
- 2021Deep Learning for Embodied Vision Navigation: A Survey7 Jul 2021
- 2021Graph Convolutional Memory using Topological Priors27 Jun 2021
- 2021VTNet: Visual Transformer Network for Object Goal Navigation20 May 2021
- 2021Zero-Shot Reinforcement Learning on Graphs for Autonomous Exploration Under Uncertainty11 May 2021
- 2021VGF-Net: Visual-Geometric Fusion Learning for Simultaneous Drone Navigation and Height Mapping7 Apr 2021
- 2021Structured Scene Memory for Vision-Language Navigation5 Mar 2021
- 2021A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environment19 Jan 2021
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigation13 Jan 2021
- 2022Open-vocabulary Queryable Scene Representations for Real World Planningcited by 159
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
- 2021Capturing, Reconstructing, and Simulating: the UrbanScene3D Datasetcited by 117
- 2021Structured Scene Memory for Vision-Language Navigationcited by 95
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigationcited by 64
- 2021No RL, No Simulation: Learning to Navigate without Navigatingcited by 63
- 2021VTNet: Visual Transformer Network for Object Goal Navigationcited by 50
- 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networkscited by 50
- 2022Sound Adversarial Audio-Visual Navigationcited by 46
- 2021Catch Me If You Hear Me: Audio-Visual Navigation in Complex Unmapped Environments with Moving Soundscited by 40
- 2022Continuous Scene Representations for Embodied AIcited by 39
- 2021Predicting the Future from First Person (Egocentric) Vision: A Surveycited by 36
12 most cited of 39 All 39 (JSON)
- 2026Scene Representation using 360deg Saliency Graph and its Application in Vision-based Indoor Navigation20 Mar 2026
- 2026FeudalNav: A Simple Framework for Visual Navigation15 Jan 2026
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environments30 Dec 2025
- 2025Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation24 Dec 2025
- 2024Semantic Environment Atlas for Object-Goal Navigation5 Oct 2024
- 2024RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigation9 May 2024
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigation1 Mar 2024
- 2024Feudal Networks for Visual Navigation19 Feb 2024
- 2023Building Category Graphs Representation with Spatial and Temporal Attention for Visual Navigation6 Dec 2023
- 2023Task-Driven Graph Attention for Hierarchical Relational Object Navigation23 Jun 2023
- 2022A General Purpose Supervisory Signal for Embodied Agents1 Dec 2022
- 2022MoDA: Map style transfer for self-supervised Domain Adaptation of embodied agents29 Nov 2022
12 newest of 39 All 39 (JSON)