mlsanityData to 14 Oct 2026

AIM: Intent-Aware Unified world action Modeling with Spatial Value Maps

arXiv 2604.11135 ↗First posted 13 Apr 2026cs.RO cs.LGcited by 12

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Pretrained video generation models provide strong priors for robot control, but existing unified world action models still struggle to decode reliable actions without substantial robot-specific training. We attribute this limitation to a structural mismatch: while video models capture how scenes evolve, action generation requires explicit reasoning about where to interact and the underlying manipulation intent. We introduce AIM, an intent-aware unified world action model that bridges this gap via an explicit spatial interface. Instead of decoding actions directly from future visual representations, AIM predicts an aligned spatial value map that encodes task-relevant interaction structure, enabling a control-oriented abstraction of future dynamics. Built on a pretrained video generation model, AIM jointly models future observations and value maps within a shared mixture-of-transformers architecture. It employs intent-causal attention to route future information to the action branch exclusively through the value representation. We further propose a self-distillation reinforcement learning stage that freezes the video and value branches and optimizes only the action head using dense rewards derived from projected value-map responses together with sparse task-level signals. To support training and evaluation, we construct a simulation dataset of 30K manipulation trajectories with synchronized multi-view observations, actions, and value-map annotations. Experiments on RoboTwin 2.0 benchmark show that AIM achieves a 94.0% average success rate, significantly outperforming prior unified world action baselines. Notably, the improvement is more pronounced in long-horizon and contact-sensitive manipulation tasks, demonstrating the effectiveness of explicit spatial-intent modeling as a bridge between visual world modeling and robot control.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 26 of its 27 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

26 of 27 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  2. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  3. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar
  4. 2026World Action Models are Zero-shot Policies17 Feb
  5. 2026Causal World Modeling for Robot Control29 Jan
  6. 2025Motus: A Unified Latent Action World Model15 Dec
  7. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr

Other references · 19

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  10. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  11. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
  12. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
7 more
  1. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  2. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  3. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  4. 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
  5. 2025Video Generators are Robot Policiescited by 92
  6. 2025Towards Physically Executable 3D Gaussian for Embodied Navigationcited by 17
  7. 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baselinecited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Models
  2. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  3. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  4. 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
  5. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
  6. 2026World-Action Models for Robot Learning and Control: A Survey
  7. 2026Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation
  8. 2026Foresight Without Seeing: Latent Futures for World Action Models