Enhancing Latent World Models with Associative Memory
On the map: World models → Latent predictive world models
Abstract (arXiv)
World models trained via latent dynamics offer a scalable path for embodied planning, yet existing methods suffer from representational collapse, computational overhead, and limited long-horizon capability. We introduce a memory-enhanced latent world model that augments JEPA-style prediction with a content-addressable memory bank. Our approach learns high-level representations directly from observations, operating at multiple temporal scales within a shared latent space, and conditions predictions via adaptive layer normalization. To prevent collapse and ensure effective memory usage, we design two complementary losses that encourage slot diversity and balanced temporal utilization. Experiments on PushT, Tworoom, Reacher, and OGBCube demonstrate that our method achieves state-of-the-art performance with a lightweight architecture, outperforming conventional latent world models on long-horizon planning tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 13 of its 15 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
13 of 15 references.
Closest ancestors · 5
Same direction, newest first
- 2026Hierarchical Planning with Latent World Models3 Apr
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture19 Jan
- 2018Learning Latent Dynamics for Planning from Pixels12 Nov
Other references · 8
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2025Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Modelscited by 89
- 2025VL-JEPA: Joint Embedding Predictive Architecture for Vision-languagecited by 68
- 2024Denoising with a Joint-Embedding Predictive Architecturecited by 14
- 2026ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Modelcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning
- 2026JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts
- 2026Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control
- 2026HaM-World: Soft-Hamiltonian World Models with Selective Memory for Planning
- 2026LRC-JEPA: Disentangling Dynamics and Residual Context for Efficient World Models
- 2026Beyond a single latent space: a dual-latent world model for long-horizon planning
- 2026H-JEPA: End-to-End Learning of Hierarchical World Models for Visual Planning
- 2026FF-JEPA: Long-Horizon Planning in World Models with Latent Planners