AIM: Intent-Aware Unified world action Modeling with Spatial Value Maps
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Pretrained video generation models provide strong priors for robot control, but existing unified world action models still struggle to decode reliable actions without substantial robot-specific training. We attribute this limitation to a structural mismatch: while video models capture how scenes evolve, action generation requires explicit reasoning about where to interact and the underlying manipulation intent. We introduce AIM, an intent-aware unified world action model that bridges this gap via an explicit spatial interface. Instead of decoding actions directly from future visual representations, AIM predicts an aligned spatial value map that encodes task-relevant interaction structure, enabling a control-oriented abstraction of future dynamics. Built on a pretrained video generation model, AIM jointly models future observations and value maps within a shared mixture-of-transformers architecture. It employs intent-causal attention to route future information to the action branch exclusively through the value representation. We further propose a self-distillation reinforcement learning stage that freezes the video and value branches and optimizes only the action head using dense rewards derived from projected value-map responses together with sparse task-level signals. To support training and evaluation, we construct a simulation dataset of 30K manipulation trajectories with synchronized multi-view observations, actions, and value-map annotations. Experiments on RoboTwin 2.0 benchmark show that AIM achieves a 94.0% average success rate, significantly outperforming prior unified world action baselines. Notably, the improvement is more pronounced in long-horizon and contact-sensitive manipulation tasks, demonstrating the effectiveness of explicit spatial-intent modeling as a bridge between visual world modeling and robot control.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 26 of its 27 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
26 of 27 references.
Closest ancestors · 7
Same direction, newest first
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
Other references · 19
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
7 more
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2025Video Generators are Robot Policiescited by 92
- 2025Towards Physically Executable 3D Gaussian for Embodied Navigationcited by 17
- 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baselinecited by 9
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 38
- 2026World Action Models: A Surveycited by 12
- 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shiftscited by 11
- 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Actioncited by 8
- 2026Point Tracking Improves World Action Modelscited by 7
- 2026DeVA: Decoupled Video-Action Model with physical guidance for robot policy learningcited by 4
- 2026World Pilot: Steering Vision-Language-Action Models with World-Action Priorscited by 3
- 2026From Imagined Futures to Executable Actions: Mixture of Latent Actions for Robot Manipulationcited by 2
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigationcited by 2
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Modelscited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models24 Aug 2026
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation4 Aug 2026
- 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts31 Jul 2026
- 2026DeVA: Decoupled Video-Action Model with physical guidance for robot policy learning27 Jul 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun 2026
- 2026World Pilot: Steering Vision-Language-Action Models with World-Action Priors10 Jun 2026
- 2026Point Tracking Improves World Action Models22 May 2026
- 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action14 May 2026
- 2026From Imagined Futures to Executable Actions: Mixture of Latent Actions for Robot Manipulation12 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Models
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
- 2026World-Action Models for Robot Learning and Control: A Survey
- 2026Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation
- 2026Foresight Without Seeing: Latent Futures for World Action Models