mlsanityData to 14 Oct 2026

HiMem-WAM: Hierarchical Memory-Gated World Action Models for Robotic Manipulation

arXiv 2606.10363 ↗First posted 9 Jun 2026cs.ROcited by 8

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World Action Models (WAMs) have emerged as a new powerful paradigm for embodied intelligence, learning action-relevant visual dynamics that significantly enhance generalization and robustness. However, existing WAMs still struggle with task-relevant memory in long-horizon robotic manipulation. To address this, we present HiMem-WAM, a Hierarchical Memory-Gated WAM that integrates motion-centric latent actions, high-level skill latents, and boundary-triggered memory updates. Specifically, we develop a hierarchical latent action framework that jointly learns low-level motion and high-level skill latents, providing structured temporal abstraction. Meanwhile, a boundary-aware memory gate writes compact task states at predicted skill transitions, enabling causal inference without test-time generation of future video or optical flow estimation. Evaluated on LIBERO, LIBERO-PLUS, RMBench and real-world tasks, HiMem-WAM shows that hierarchical latents improve robustness under deployment perturbations, and the memory module substantially benefits memory-dependent long-horizon manipulation.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 23 of its 32 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

23 of 32 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026When to Trust Imagination: Adaptive Action Execution for World Action Models7 May
  2. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  3. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  4. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar
  5. 2026Causal World Modeling for Robot Control29 Jan
  6. 2025Motus: A Unified Latent Action World Model15 Dec
  7. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  8. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr

Other references · 15

  1. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  2. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  3. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  4. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  5. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  6. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  7. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  8. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  9. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
  10. 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 67
  11. 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 62
  12. 2025SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulationcited by 61
3 more
  1. 2026RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Designcited by 45
  2. 2025CronusVLA: Towards Efficient and Robust Manipulation via Multi-Frame Vision-Language-Action Modelingcited by 25
  3. 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baselinecited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026RM-WAM: Reliable Memory-Augmented World Action Models for Long-Horizon Robot Manipulation
  2. 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory
  3. 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memory
  4. 2026Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulation
  5. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
  6. 2026WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning
  7. 2026MV-WAM: Manifold-Aware World Action Model with Value Augmentation
  8. 2026WAM-TTT: Steering World-Action Models by Watching Human Play at Test Time