mlsanityData to 7 Oct 2026

Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory

arXiv 2610.02521 ↗First posted 1 Oct 2026cs.CVcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Long-video generation and world models have shown strong potential for interactive entertainment and embodied simulation by predicting future observations conditioned on user actions and historical memory. However, as memory sequences grow longer and their structures become increasingly complex, managing long-range spatial context becomes increasingly challenging, calling for a more intelligent and systematic memory-management strategy. Building on the advancing spatial reasoning capabilities of multimodal large language models (MLLMs) and the broader vision of unified models, we propose Spatial Memory Intelligence (SMI), the first framework to systematically employ an understanding model for spatial-memory management in long-video world models. SMI introduces four coordinated atomic operations: spatial clustering, within-cluster sparsification, action-aware retrieval, and reliability-aware filtering. Extensive experiments across multiple baselines, benchmarks, and world-model backbones demonstrate the effectiveness and generalizability of SMI, achieving comprehensive improvements in memory sparsity, generation stability, and spatial consistency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. First posted on arXiv 1 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Video World Models with Long-term Spatial Memory
  2. 2026LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video
  3. 2025Long-Context State-Space Video World Models
  4. 20253DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Model
  5. 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments
  6. 2025Cambrian-S: Towards Spatial Supersensing in Video
  7. 2025SIMS-V: Simulated Instruction-Tuning for Spatial Video Understanding
  8. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces