Structure Abstraction and Generalization in a Hippocampal-Entorhinal Inspired World Model
On the map: World models → World models for navigation
Abstract (arXiv)
Humans abstract experiences into structured representations to facilitate pattern inference and knowledge transfer. While the hippocampal-entorhinal (HPC-MEC) circuit is known to represent both spatial and conceptual spaces, the mechanisms for concurrently extracting abstract structures from continuous, high-dimensional dynamics remain poorly understood. We propose a brain-inspired hierarchical model that simultaneously infers latent transitions and constructs a predictive visual world model. Our architecture employs an inverse model for structural extraction alongside an HPC-MEC coupling model that dissociates relational structures (MEC) from integrated episodic scenes (HPC). Using primitive transformation dynamics as a benchmark, we demonstrate the model's capacity for structural abstraction. By leveraging velocity-driven path integration, the framework enables robust prediction and structural reuse across diverse contexts, thereby achieving structural generalization. This work provides a novel computational framework for understanding how brain-inspired, self-supervised learning of world models facilitates the acquisition of reusable abstract knowledge.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 17 of its 50 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
17 of 50 references.
References · 17
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2018World Modelscited by 1,444
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2021Implicit Behavioral Cloningcited by 442
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2019Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learningcited by 380
5 more
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2024Latent Action Pretraining from Videoscited by 302
- 2023Learning to Act without Actionscited by 116
- 2025AdaWorld: Learning Adaptable World Models with Latent Actionscited by 108
- 2024IGOR: Image-GOal Representations are the Atomic Control Units for Foundation Models in Embodied AIcited by 68
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Emergence and Function of Abstract Representations in Self-Supervised Transformers
- 2026Abstract representational geometry supports inference in large language models
- 2025Building spatial world models from sparse transitional episodic memories
- 2026Path Integration and Object-Location Binding Emerge in an Action-Conditioned Predictive Sequence Network
- 2025A Grid Cell-Inspired Structured Vector Algebra for Cognitive Maps
- 2024Binding in hippocampal-entorhinal circuits enables compositionality in cognitive maps
- 2021A brain basis of dynamical intelligence for AI and computational neuroscience
- 2025Lessons from Neuroscience for AI: How integrating Actions, Compositional Structure and Episodic Memory could enable Safe, Interpretable and Human-Like AI