mlsanityData to 14 Oct 2026

MV-WAM: Manifold-Aware World Action Model with Value Augmentation

arXiv 2606.21088 ↗First posted 19 Jun 2026cs.ROcited by 6

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Achieving robust and generalizable manipulation across diverse environments remains a fundamental challenge in embodied robotics. Recent world action models achieve strong in-domain performance, yet their gains do not extend proportionally to out-of-distribution scenarios. We attribute this to a structural mismatch between visual and action modalities, whose intrinsically heterogeneous manifolds cause joint optimization to disproportionately degrade action robustness under distribution shift. To address this, we propose MV-WAM, a novel end-to-end framework that jointly models visual prediction, action generation, and value estimation designed to effectively leverage video priors during both training and inference for enhanced action generalization. Key to this unification is a cross-modality causal mask that hierarchically grounds actions in predicted video frames and value function tokens in both modalities. To further narrow the generalization gap, MV-WAM adopts a manifold-aware optimization scheme that explicitly accounts for the structural heterogeneity across modalities. Finally, MV-WAM introduces a progress-value regulation mechanism that estimates task completion and detects misalignment between predicted frames and generated actions, enabling the policy to autonomously identify execution deviations and recover through value-guided rollback. On the RoboTwin simulation, MV-WAM achieves a 55.7% mean success rate on random scenarios without any randomized action supervision, outperforming the strongest baseline by 29.3%. MV-WAM achieves a 77.5% mean success rate across four real-world tasks of varying difficulty on a dual-arm robot. Our results demonstrate that manifold-aware cross-modal alignment is essential for robust policy generalization, offering a path toward deployable robotic manipulation.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 35 of its 49 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

35 of 49 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  2. 2026World Action Models are Zero-shot Policies17 Feb
  3. 2026Causal World Modeling for Robot Control29 Jan
  4. 2025Motus: A Unified Latent Action World Model15 Dec
  5. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
  6. 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun

Other references · 29

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  5. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  6. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  8. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  10. 2018World Modelscited by 1,513
  11. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  12. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
17 more
  1. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  2. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  3. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  4. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  5. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  6. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
  7. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
  8. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
  9. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
  10. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 102
  11. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 78
  12. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
  13. 2024Diffusion-VLA: Generalizable and Interpretable Robot Foundation Model via Self-Generated Reasoningcited by 57
  14. 2026BagelVLA: Enhancing Long-Horizon Manipulation via Interleaved Vision-Language-Action Generationcited by 30
  15. 2025AstraNav-World: World Model for Foresight Control and Consistencycited by 17
  16. 2026HALO: A Unified Vision-Language-Action Model for Embodied Multimodal Chain-of-Thought Reasoningcited by 16
  17. 2025Learning Beyond Euclid: Curvature-Adaptive Generalization for Neural Networks on Manifoldscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  2. 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation
  3. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
  4. 2026HiMem-WAM: Hierarchical Memory-Gated World Action Models for Robotic Manipulation
  5. 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
  6. 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulation
  7. 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments
  8. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing