Visual Memory for Robust Path Following
Not on the map. Why?
Abstract (arXiv)
Humans routinely retrace paths in a novel environment both forwards and backwards despite uncertainty in their motion. This paper presents an approach for doing so. Given a demonstration of a path, a first network generates a path abstraction. Equipped with this abstraction, a second network observes the world and decides how to act to retrace the path under noisy actuation and a changing environment. The two networks are optimized end-to-end at training time. We evaluate the method in two realistic simulators, performing path following and homing under actuation noise and environmental changes. Our experiments show that our approach outperforms classical approaches and other learning based baselines.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 4; 2023: 0; 2024: 5; 2025: 2; 2026: 2.
16 papers.
Sort:
By area:
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 66
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigationcited by 64
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 55
- 2024AffordanceLLM: Grounding Affordance from Vision Language Modelscited by 55
- 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 46
- 2022Phone2Proc: Bringing Robust Robots Into Our Chaotic Worldcited by 24
- 2021Learned Visual Navigation for Under-Canopy Agricultural Robotscited by 18
- 2025ObjectReact: Learning Object-Relative Control for Visual Navigationcited by 5
- 2024Feudal Networks for Visual Navigationcited by 4
- 2024PAVLM: Advancing Point Cloud based Affordance Understanding Via Vision-Language Modelcited by 4
- 2022Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigationcited by 2
- 2022MemoNav: Selecting Informative Memories for Visual Navigationcited by 1
4 more
- 2024Semantic Environment Atlas for Object-Goal Navigationcited by 0
- 2025TurnBack: A Geospatial Route Cognition Benchmark for Large Language Models through Reverse Routecited by 0
- 2026FeudalNav: A Simple Framework for Visual Navigationcited by 0
- 2026Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agentscited by 0
- 2026Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents28 Apr 2026
- 2026FeudalNav: A Simple Framework for Visual Navigation15 Jan 2026
- 2025TurnBack: A Geospatial Route Cognition Benchmark for Large Language Models through Reverse Route17 Sep 2025
- 2025ObjectReact: Learning Object-Relative Control for Visual Navigation11 Sep 2025
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Method12 Dec 2024
- 2024PAVLM: Advancing Point Cloud based Affordance Understanding Via Vision-Language Model15 Oct 2024
- 2024Semantic Environment Atlas for Object-Goal Navigation5 Oct 2024
- 2024Feudal Networks for Visual Navigation19 Feb 2024
- 2024AffordanceLLM: Grounding Affordance from Vision Language Models12 Jan 2024
- 2022Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation17 Dec 2022
- 2022Phone2Proc: Bringing Robust Robots Into Our Chaotic World8 Dec 2022
- 2022MemoNav: Selecting Informative Memories for Visual Navigation20 Aug 2022
4 more
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints23 Feb 2022
- 2021Coupling Vision and Proprioception for Navigation of Legged Robots3 Dec 2021
- 2021Learned Visual Navigation for Under-Canopy Agricultural Robots6 Jul 2021
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigation13 Jan 2021
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 66
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigationcited by 64
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 55
- 2021Coupling Vision and Proprioception for Navigation of Legged Robotscited by 46
- 2022Phone2Proc: Bringing Robust Robots Into Our Chaotic Worldcited by 24
- 2021Learned Visual Navigation for Under-Canopy Agricultural Robotscited by 18
- 2025ObjectReact: Learning Object-Relative Control for Visual Navigationcited by 5
- 2024Feudal Networks for Visual Navigationcited by 4
- 2022Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigationcited by 2
- 2022MemoNav: Selecting Informative Memories for Visual Navigationcited by 1
- 2024Semantic Environment Atlas for Object-Goal Navigationcited by 0
- 2025TurnBack: A Geospatial Route Cognition Benchmark for Large Language Models through Reverse Routecited by 0
12 most cited of 14 All 14 (JSON)
- 2026Where Did It Go Wrong? Capability-Oriented Failure Attribution for Vision-and-Language Navigation Agents28 Apr 2026
- 2026FeudalNav: A Simple Framework for Visual Navigation15 Jan 2026
- 2025TurnBack: A Geospatial Route Cognition Benchmark for Large Language Models through Reverse Route17 Sep 2025
- 2025ObjectReact: Learning Object-Relative Control for Visual Navigation11 Sep 2025
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Method12 Dec 2024
- 2024Semantic Environment Atlas for Object-Goal Navigation5 Oct 2024
- 2024Feudal Networks for Visual Navigation19 Feb 2024
- 2022Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation17 Dec 2022
- 2022Phone2Proc: Bringing Robust Robots Into Our Chaotic World8 Dec 2022
- 2022MemoNav: Selecting Informative Memories for Visual Navigation20 Aug 2022
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints23 Feb 2022
- 2021Coupling Vision and Proprioception for Navigation of Legged Robots3 Dec 2021
12 newest of 14 All 14 (JSON)