mlsanityData to 14 Oct 2026

One-4-All: Neural Potential Fields for Embodied Navigation

arXiv 2303.04011 ↗First posted 7 Mar 2023cs.RO cs.CV cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

A fundamental task in robotics is to navigate between two locations. In particular, real-world navigation can require long-horizon planning using high-dimensional RGB images, which poses a substantial challenge for end-to-end learning-based approaches. Current semi-parametric methods instead achieve long-horizon navigation by combining learned modules with a topological memory of the environment, often represented as a graph over previously collected images. However, using these graphs in practice requires tuning a number of pruning heuristics. These heuristics are necessary to avoid spurious edges, limit runtime memory usage and maintain reasonably fast graph queries in large environments. In this work, we present One-4-All (O4A), a method leveraging self-supervised and manifold learning to obtain a graph-free, end-to-end navigation pipeline in which the goal is specified as an image. Navigation is achieved by greedily minimizing a potential function defined continuously over image embeddings. Our system is trained offline on non-expert exploration sequences of RGB data and controls, and does not require any depth or pose measurements. We show that O4A can reach long-range goals in 8 simulated Gibson indoor environments and that resulting embeddings are topologically similar to ground truth maps, even if no pose is observed. We further demonstrate successful real-world navigation using a Jackal UGV platform.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 7 Mar 2023.

Builds on

31 of 41 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  4. 2017Hindsight Experience Replaycited by 1,136
  5. 2018On Evaluation of Embodied Navigation Agentscited by 547
  6. 2017End-to-end Driving via Conditional Imitation Learningcited by 485
  7. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
  8. 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
  9. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
  10. 2020Learning to Explore using Active Neural SLAMcited by 316
  11. 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
  12. 2018Semi-parametric Topological Memory for Navigationcited by 209
19 more
  1. 2020Neural Topological SLAM for Visual Navigationcited by 195
  2. 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 194
  3. 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 150
  4. 2018Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulationcited by 142
  5. 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 121
  6. 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 107
  7. 2020ViNG: Learning Open-World Navigation with Visual Goalscited by 80
  8. 2021No RL, No Simulation: Learning to Navigate without Navigatingcited by 65
  9. 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 58
  10. 2019Combining Optimal Control and Learning for Visual Navigation in Novel Environmentscited by 52
  11. 2021Learning to Map for Active Semantic Goal Navigationcited by 50
  12. 2022Topological Semantic Graph Memory for Image-Goal Navigationcited by 45
  13. 2019Scaling Local Control to Large-Scale Topological Navigationcited by 37
  14. 2020Sparse Graphical Memory for Robust Planningcited by 31
  15. 2022Offline Reinforcement Learning for Visual Navigationcited by 29
  16. 2020Plan2Vec: Unsupervised Representation Learning by Latent Planscited by 21
  17. 2020Visual Navigation in Real-World Indoor Environments Using End-to-End Deep Reinforcement Learningcited by 14
  18. 2022Learning Robotic Navigation from Experience: Principles, Methods, and Recent Resultscited by 13
  19. 2021Lifelong Topological Visual Navigationcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 4; 2025: 0; 2026: 2.

7 papers.