MV-WAM: Manifold-Aware World Action Model with Value Augmentation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Achieving robust and generalizable manipulation across diverse environments remains a fundamental challenge in embodied robotics. Recent world action models achieve strong in-domain performance, yet their gains do not extend proportionally to out-of-distribution scenarios. We attribute this to a structural mismatch between visual and action modalities, whose intrinsically heterogeneous manifolds cause joint optimization to disproportionately degrade action robustness under distribution shift. To address this, we propose MV-WAM, a novel end-to-end framework that jointly models visual prediction, action generation, and value estimation designed to effectively leverage video priors during both training and inference for enhanced action generalization. Key to this unification is a cross-modality causal mask that hierarchically grounds actions in predicted video frames and value function tokens in both modalities. To further narrow the generalization gap, MV-WAM adopts a manifold-aware optimization scheme that explicitly accounts for the structural heterogeneity across modalities. Finally, MV-WAM introduces a progress-value regulation mechanism that estimates task completion and detects misalignment between predicted frames and generated actions, enabling the policy to autonomously identify execution deviations and recover through value-guided rollback. On the RoboTwin simulation, MV-WAM achieves a 55.7% mean success rate on random scenarios without any randomized action supervision, outperforming the strongest baseline by 29.3%. MV-WAM achieves a 77.5% mean success rate across four real-world tasks of varying difficulty on a dual-arm robot. Our results demonstrate that manifold-aware cross-modal alignment is essential for robust policy generalization, offering a path toward deployable robotic manipulation.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 35 of its 49 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
35 of 49 references.
Closest ancestors · 6
Same direction, newest first
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
Other references · 29
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2018World Modelscited by 1,513
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
17 more
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 102
- 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 78
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
- 2024Diffusion-VLA: Generalizable and Interpretable Robot Foundation Model via Self-Generated Reasoningcited by 57
- 2026BagelVLA: Enhancing Long-Horizon Manipulation via Interleaved Vision-Language-Action Generationcited by 30
- 2025AstraNav-World: World Model for Foresight Control and Consistencycited by 17
- 2026HALO: A Unified Vision-Language-Action Model for Embodied Multimodal Chain-of-Thought Reasoningcited by 16
- 2025Learning Beyond Euclid: Curvature-Adaptive Generalization for Neural Networks on Manifoldscited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 6
- 2026Lift3D-VLA: Lifting VLA Models to 3D Geometry and Dynamics-Aware Manipulationcited by 2
- 2026Modality-Autoregressive World-Action Modelscited by 2
- 2026MT-WAM: Reorienting the One-Pass Predictive Representation Toward Action Generationcited by 0
- 2026World Action Modeling with Progressive Visual Planningcited by 0
- 2026Native Action-Prior Learning from Videos for World Action Modelscited by 0
- 2026Native Action-Prior Learning from Videos for World Action Models2 Oct 2026
- 2026World Action Modeling with Progressive Visual Planning1 Oct 2026
- 2026MT-WAM: Reorienting the One-Pass Predictive Representation Toward Action Generation18 Sep 2026
- 2026Modality-Autoregressive World-Action Models15 Sep 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026Lift3D-VLA: Lifting VLA Models to 3D Geometry and Dynamics-Aware Manipulation7 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
- 2026HiMem-WAM: Hierarchical Memory-Gated World Action Models for Robotic Manipulation
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
- 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulation
- 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing