Building spatial world models from sparse transitional episodic memories
On the map: World models → World models for navigation
Abstract (arXiv)
Many animals possess a remarkable capacity to rapidly construct flexible cognitive maps of their environments. These maps are crucial for ethologically relevant behaviors such as navigation, exploration, and planning. Existing computational models typically require long sequential trajectories to build accurate maps, but neuroscience evidence suggests maps can also arise from integrating disjoint experiences governed by consistent spatial rules. We introduce the Episodic Spatial World Model (ESWM), a novel framework that constructs spatial maps from sparse, disjoint episodic memories. Across environments of varying complexity, ESWM predicts unobserved transitions from minimal experience, and the geometry of its latent space aligns with that of the environment. Because it operates on episodic memories that can be independently stored and updated, ESWM is inherently adaptive, enabling rapid adjustment to environmental changes. Furthermore, we demonstrate that ESWM readily enables near-optimal strategies for exploring novel environments and navigating between arbitrary points, all without the need for additional training. Our work demonstrates how neuroscience-inspired principles of episodic memory can advance the development of more flexible and generalizable world models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 32 of its 70 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
32 of 70 references.
Closest ancestors · 1
Same direction, newest first
- 2024Navigation World Models4 Dec
Other references · 31
- 2017Attention Is All You Needcited by 60,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2018IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architecturescited by 883
- 2022A Generalist Agentcited by 808
19 more
- 2019Model-Based Reinforcement Learning for Ataricited by 502
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2022Transformers are Sample-Efficient World Modelscited by 328
- 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 327
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2015Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Imagescited by 274
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
- 2023ViNT: A Foundation Model for Visual Navigationcited by 222
- 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
- 2023Transformer-based World Models Are Happy With 100k Interactionscited by 139
- 2022MaskViT: Masked Visual Pre-Training for Video Predictioncited by 114
- 2023STORM: Efficient Stochastic Transformer based World Models for Reinforcement Learningcited by 89
- 2021Relating transformers to models and neural representations of the hippocampal formationcited by 62
- 2018Emergence of grid-like representations by training recurrent neural networks to perform spatial localizationcited by 52
- 2023Emergence of Maps in the Memories of Blind Navigation Agentscited by 33
- 2020Rapid Task-Solving in Novel Environmentscited by 23
- 2017Memory Augmented Control Networkscited by 13
- 2018Generative Temporal Models with Spatial Memory for Partially Observed Environmentscited by 10
- 2024Binding in hippocampal-entorhinal circuits enables compositionality in cognitive mapscited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Embodied World Models Emerge from Navigational Task in Open-Ended Environments
- 2025From reactive to cognitive: brain-inspired spatial intelligence for embodied agents
- 2025Cognitive Maps in Language Models: A Mechanistic Analysis of Spatial Planning
- 2024Does Spatial Cognition Emerge in Frontier Models?
- 2025Video World Models with Long-term Spatial Memory
- 2026A Reinforcement Learning-Based Model for Mapping and Goal-Directed Navigation Using Multiscale Place Fields
- 2025Learning 3D Persistent Embodied World Models
- 2025Thinking on Maps: How Foundation Model Agents Explore, Remember, and Reason Map Environments