WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World Action Models (WAMs) offer a promising paradigm for robotic manipulation by jointly modeling visual state transitions and robot actions. However, existing WAMs are constrained by limited temporal context, coarse episode-level language supervision, and predominantly text-only conditioning, which hinder task-progress tracking and fine-grained language-video-action grounding while limiting visual-context reasoning and cross-embodiment transfer. In this paper, we introduce WorldScape Policy 2.0, a controllable WAM with reasoning-augmented long short-term memory. Its causal short-term visual memory supplies recent observations as DiT prefill to preserve local interaction dynamics, while its long short-term event memory organizes historical VLM outputs into global-history, local-active, and event-boundary representations for progress-aware retrieval. The retrieved history augments perception and autoregressively generated planning tokens, yielding an implicit subgoal condition for autonomous planning; semantic forcing further transfers event-level instruction semantics into this latent planning pathway. To establish fine-grained multimodal controllability, we construct ManipEvent-5M, an event-grounded embodied pretraining dataset containing nearly 5 million event segments with aligned action trajectories, episode-level task instructions, segment-level subtask captions, goal images, and video demonstrations. These designs provide a unified interface for autonomous planning from high-level instructions and controllable execution from fine-grained text, goal-image, or video-context prompts. Experiments in both simulation and real-world platforms demonstrate superior capabilities in long-horizon autonomous planning, fine-grained instruction following and in-context adaptation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 31 of its 62 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
31 of 62 references.
Closest ancestors · 10
Same direction, newest first
- 2026DSWAM: A Dual-System World Action Foundation Model for Fine-Grained Robot Manipulation6 Jul
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model1 Jul
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory18 Jun
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
Other references · 21
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2026A Pragmatic VLA Foundation Modelcited by 97
- 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
- 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 58
- 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Modelscited by 55
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 42
- 2026Native Video-Action Pretraining for Generalizable Robot Controlcited by 30
- 2026HoloBrain-0 Technical Reportcited by 20
- 2026DriveMamba: Task-Centric Scalable State Space Model for Efficient End-to-End Autonomous Drivingcited by 9
9 more
- 2026Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflectioncited by 9
- 2026Long-Horizon Manipulation via Trace-Conditioned VLA Planningcited by 9
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulationcited by 8
- 2026NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planningcited by 7
- 2022Discovering A Variety of Objects in Spatio-Temporal Human-Object Interactionscited by 6
- 2026FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policiescited by 5
- 2020Collaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognitioncited by 4
- 2025Learning Generalizable Robot Policy with Human Demonstration Video as a Promptcited by 3
- 2021TSI: Temporal Saliency Integration for Video Action Recognitioncited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Trainingcited by 1
- 2026Long-WAM: Scaling the Context of World-Action Modelscited by 1
- 2026CAER: Causal Action Effect Reweighting for World Model Trainingcited by 0
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfacescited by 0
- 2026Long-WAM: Scaling the Context of World-Action Models7 Oct 2026
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfaces29 Sep 2026
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training31 Aug 2026
- 2026CAER: Causal Action Effect Reweighting for World Model Training31 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Memory as Plans: World-Action Modeling with Memory-Grounded Planning
- 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memory
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
- 2026SG-WAM: Text-Grounded and Spatial-aware Semantic Guidance for World-Action Models