One-4-All: Neural Potential Fields for Embodied Navigation
Not on the map. Why?
Abstract (arXiv)
A fundamental task in robotics is to navigate between two locations. In particular, real-world navigation can require long-horizon planning using high-dimensional RGB images, which poses a substantial challenge for end-to-end learning-based approaches. Current semi-parametric methods instead achieve long-horizon navigation by combining learned modules with a topological memory of the environment, often represented as a graph over previously collected images. However, using these graphs in practice requires tuning a number of pruning heuristics. These heuristics are necessary to avoid spurious edges, limit runtime memory usage and maintain reasonably fast graph queries in large environments. In this work, we present One-4-All (O4A), a method leveraging self-supervised and manifold learning to obtain a graph-free, end-to-end navigation pipeline in which the goal is specified as an image. Navigation is achieved by greedily minimizing a potential function defined continuously over image embeddings. Our system is trained offline on non-expert exploration sequences of RGB data and controls, and does not require any depth or pose measurements. We show that O4A can reach long-range goals in 8 simulated Gibson indoor environments and that resulting embeddings are topologically similar to ground truth maps, even if no pose is observed. We further demonstrate successful real-world navigation using a Jackal UGV platform.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 7 Mar 2023.
Builds on
31 of 41 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017Hindsight Experience Replaycited by 1,136
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2017End-to-end Driving via Conditional Imitation Learningcited by 485
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2020Learning to Explore using Active Neural SLAMcited by 316
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
- 2018Semi-parametric Topological Memory for Navigationcited by 209
19 more
- 2020Neural Topological SLAM for Visual Navigationcited by 195
- 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 194
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 150
- 2018Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulationcited by 142
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 121
- 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 107
- 2020ViNG: Learning Open-World Navigation with Visual Goalscited by 80
- 2021No RL, No Simulation: Learning to Navigate without Navigatingcited by 65
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 58
- 2019Combining Optimal Control and Learning for Visual Navigation in Novel Environmentscited by 52
- 2021Learning to Map for Active Semantic Goal Navigationcited by 50
- 2022Topological Semantic Graph Memory for Image-Goal Navigationcited by 45
- 2019Scaling Local Control to Large-Scale Topological Navigationcited by 37
- 2020Sparse Graphical Memory for Robust Planningcited by 31
- 2022Offline Reinforcement Learning for Visual Navigationcited by 29
- 2020Plan2Vec: Unsupervised Representation Learning by Latent Planscited by 21
- 2020Visual Navigation in Real-World Indoor Environments Using End-to-End Deep Reinforcement Learningcited by 14
- 2022Learning Robotic Navigation from Experience: Principles, Methods, and Recent Resultscited by 13
- 2021Lifelong Topological Visual Navigationcited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 0; 2026: 2.
7 papers.
- 2024FlowNav: Combining Flow Matching and Depth Priors for Efficient Navigationcited by 12
- 2024Feudal Networks for Visual Navigationcited by 4
- 2024A Landmark-Aware Visual Navigation Datasetcited by 2
- 2024Causality-Aware Transformer Networks for Robotic Navigationcited by 2
- 2023Spectral Temporal Contrastive Learningcited by 0
- 2026FeudalNav: A Simple Framework for Visual Navigationcited by 0
- 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Drivingcited by 0
- 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving11 Sep 2026
- 2026FeudalNav: A Simple Framework for Visual Navigation15 Jan 2026
- 2024FlowNav: Combining Flow Matching and Depth Priors for Efficient Navigation14 Nov 2024
- 2024Causality-Aware Transformer Networks for Robotic Navigation4 Sep 2024
- 2024A Landmark-Aware Visual Navigation Dataset22 Feb 2024
- 2024Feudal Networks for Visual Navigation19 Feb 2024
- 2023Spectral Temporal Contrastive Learning1 Dec 2023