mlsanityData to 14 Oct 2026

MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models

arXiv 2606.13515 ↗First posted 11 Jun 2026cs.CV cs.LG cs.ROcited by 16

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World Action Models (WAMs) present a promising paradigm for robotic control via video prediction. However, current WAMs suffer from fundamental spatial bottlenecks: standard text inputs introduce referential ambiguity in cluttered scenes, while unstructured RGB predictions lack semantic grounding and remain biased by task-irrelevant backgrounds. To overcome these limitations, we introduce MaskWAM, an object-centric world-action model. By jointly integrating masks as both explicit inputs and predictions via a unified Mixture of Transformers (MoT), MaskWAM unlocks robust policy generalization. This design provides two key benefits: (1) predicting future masks yields object-centric semantic supervision that suppresses visual noise, significantly enhancing even standard text-conditioned WAMs; and (2) coupling this predictive supervision with first-frame visual prompts, such as target object masks, establishes a precise spatial anchor that substantially reduces language ambiguity. Crucially, as WAMs are inherently vision-driven architectures, direct mask conditioning yields substantially stronger guidance than text alone, establishing a precise and robust paradigm for manipulating unseen objects. Evaluations on LIBERO, RoboTwin, and real-world tasks demonstrate that MaskWAM significantly outperforms baselines in both language-clear and language-ambiguous tasks.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 46 of its 67 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

46 of 67 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learning21 Apr
  2. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  3. 2026World Action Models are Zero-shot Policies17 Feb
  4. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  5. 2026Causal World Modeling for Robot Control29 Jan
  6. 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
  7. 2025RynnVLA-002: A Unified Vision-Language-Action and World Model21 Nov
  8. 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Model31 Oct
  9. 2025FLARE: Robot Learning with Implicit World Modeling21 May
  10. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  11. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  12. 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr

Other references · 34

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  3. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  4. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  5. 2025SAM 3: Segment Anything with Conceptscited by 906
  6. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  7. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  8. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  9. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
  10. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  11. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  12. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
22 more
  1. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  2. 2023Any-point Trajectory Modeling for Policy Learningcited by 215
  3. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  4. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 197
  5. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
  6. 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
  7. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
  8. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
  9. 2024Flow as the Cross-Domain Manipulation Interfacecited by 132
  10. 2024MOKA: Open-World Robotic Manipulation through Mark-Based Visual Promptingcited by 129
  11. 2026A Pragmatic VLA Foundation Modelcited by 103
  12. 2025Video Generators are Robot Policiescited by 92
  13. 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 76
  14. 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 62
  15. 2025Point Policy: Unifying Observations and Actions with Key Points for Robot Manipulationcited by 47
  16. 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
  17. 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
  18. 2025SKIL: Semantic Keypoint Imitation Learning for Generalizable Data-efficient Manipulationcited by 21
  19. 2026HY-Embodied-0.5: Embodied Foundation Models for Real-World Agentscited by 18
  20. 2026Disentangled Robot Learning via Separate Forward and Inverse Dynamics Pretrainingcited by 14
  21. 2025Point What You Mean: Visually Grounded Instruction Policycited by 10
  22. 2026PoseVLA: Universal Pose Pretraining for Generalizable Vision-Language-Action Policiescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

  1. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 38
  2. 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shiftscited by 11
  3. 2026WAM-TTT: Steering World-Action Models by Watching Human Play at Test Timecited by 8
  4. 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulationcited by 4
  5. 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Controlcited by 3
  6. 2026SG-WAM: Text-Grounded and Spatial-aware Semantic Guidance for World-Action Modelscited by 3
  7. 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Modelscited by 3
  8. 2026DC-WAM: Dynamic-Centric Visual Supervision and Reasoning for World-Action Modelscited by 2
  9. 2026Beyond Instance Slots: Semantically Rich World Models for Physical Interaction Planningcited by 2
  10. 2026DIDO: Distilling Interaction-Centric Dynamics into One-Step Denoising for World Action Modelscited by 2
  11. 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Modelscited by 0
  12. 2026MaskHarness-WAM: Instance-Grounded Harnessing for Long-Horizon Robot Manipulationcited by 0
4 more
  1. 2026Skel-WAM: A Hand-Skeleton-Conditioned World Action Model for Human-to-Robot Manipulation Transfercited by 0
  2. 2026AR-WAM: A Visual-Conditioned Agent-Ready World Action Model for Robotic Manipulationcited by 0
  3. 2026FutureDuet: Decoupling Observation Access from Future Supervision in World Action Modelscited by 0
  4. 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Masked Visual Actions for Unified World Modeling
  2. 2026SelfWAM: A Self-Grounded Unified World Action Model for Fast Robot Control
  3. 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
  4. 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation
  5. 2026UniWAM: Unified World-Action Model
  6. 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling
  7. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  8. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies