Grid Cell-Inspired Fragmentation and Recall for Efficient Map Building
Not on the map. Why?
Abstract (arXiv)
Animals and robots navigate through environments by building and refining maps of space. These maps enable functions including navigation back to home, planning, search and foraging. Here, we use observations from neuroscience, specifically the observed fragmentation of grid cell map in compartmentalized spaces, to propose and apply the concept of Fragmentation-and-Recall (FARMap) in the mapping of large spaces. Agents solve the mapping problem by building local maps via a surprisal-based clustering of space, which they use to set subgoals for spatial exploration. Agents build and use a local map to predict their observations; high surprisal leads to a "fragmentation event" that truncates the local map. At these events, the recent local map is placed into long-term memory (LTM) and a different local map is initialized. If observations at a fracture point match observations in one of the stored local maps, that map is recalled (and thus reused) from LTM. The fragmentation points induce a natural online clustering of the larger space, forming a set of intrinsic potential subgoals that are stored in LTM as a topological graph. Agents choose their next subgoal from the set of near and far potential subgoals from within the current local map or LTM, respectively. Thus, local maps guide exploration locally, while LTM promotes global exploration. We demonstrate that FARMap replicates the fragmentation points observed in animal studies. We evaluate FARMap on complex procedurally-generated spatial environments and realistic simulations to demonstrate that this mapping strategy much more rapidly covers the environment (number of agent steps and wall clock time) and is more efficient in active memory usage, without loss of performance. https://jd730.github.io/projects/FARMap/
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 18 of its 70 references that are in the map. First posted on arXiv 11 Jul 2023.
Builds on
18 of 70 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Exploration by Random Network Distillationcited by 966
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2020Learning to Explore using Active Neural SLAMcited by 308
- 2020Never Give Up: Learning Directed Exploration Strategiescited by 210
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 190
- 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
- 2017Neural Episodic Controlcited by 148
- 2018Optimizing Agent Behavior over Long Time Scales by Transporting Valuecited by 57
- 2021Towards mental time travel: a hierarchical memory for reinforcement learning agentscited by 38
- 2019Generalization of Reinforcement Learners with Working and Episodic Memorycited by 35
6 more
- 2018Been There, Done That: Meta-Learning with Episodic Recallcited by 25
- 2020Fast Frontier-based Information-driven Autonomous Exploration with an MAVcited by 23
- 2021Autonomous Teamed Exploration of Subterranean Environments using Legged and Aerial Robotscited by 5
- 2021Graph-Based Topological Exploration Planning in Large-Scale 3D Environmentscited by 4
- 2021iRotate: Active Visual SLAM for Omnidirectional Robotscited by 3
- 2022ExplORB-SLAM: Active Visual SLAM Exploiting the Pose-graph Topologycited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.