UniWAM: Unified World-Action Model
On the map: World models → Embodied and robot world models
also in 3 more
Abstract (arXiv)
Vision-language-action models benefit from the understanding and reasoning capabilities of pretrained vision-language models, but action-only supervision provides limited grounding in world dynamics. Conversely, world-action models inherit spatiotemporal priors from video generation models, yet remain limited in semantic understanding and reasoning under distribution shifts. We introduce UniWAM, a unified architecture that integrates a physical reasoner, a world generator, and an action predictor to jointly learn semantic understanding of the physical world, visual generation, and action prediction. To ensure the quality of the training data, we developed a rigorous data cleaning and annotation pipeline for both human egocentric data and robot data. To adapt the vision-language component to embodied tasks while preserving its inherited language capabilities, we represent low-level actions in natural language and introduce a pre-training recipe that assigns complementary supervision from visual question answering (VQA) data, human egocentric data, and robot demonstrations to the appropriate model components. During post-training, future visual noise augmentation reduces reliance on precise future predictions, while history-conditioned flow matching uses encoded action history to initialize action generation. Together, these designs significantly reduce denoising steps while maintaining performance. UniWAM achieves state-of-the-art (SOTA) performance across multiple evaluations, including in-distribution performance, robustness, generalization, instruction following, and long-horizon task execution. Furthermore, we uncover a log-linear scaling law of unified human-robot co-training, demonstrating the effectiveness of large-scale pre-training on a mixture of human and robot data.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 59 of its 101 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
59 of 101 references.
Closest ancestors · 17
Same direction, newest first
- 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining7 Sep
- 2026Riemann-1.0: An Embodied World Action Model for Physical AI27 Aug
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields8 Aug
- 2026MobileWAM: Bridging World Action Models to Mobile Manipulation with Chain-of-Foresight5 Aug
- 2026Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning15 Jul
- 2026Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Model13 Jul
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model1 Jul
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun
- 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
5 more
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
- 2025FLARE: Robot Learning with Implicit World Modeling21 May
Other references · 42
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
- 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 94
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
30 more
- 2025Visual Spatial Tuningcited by 85
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 77
- 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
- 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videoscited by 63
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
- 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
- 2025Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasetscited by 39
- 2026From Foundation to Application: Improving VLA Models in Practicecited by 25
- 2025RynnVLA-001: Using Human Demonstrations to Improve Robot Manipulationcited by 24
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectoriescited by 24
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulationcited by 20
- 2026G0.5: One Autoregressive Stream for Robot Reasoning and Actioncited by 17
- 2025SIMS-V: Simulated Instruction-Tuning for Spatial Video Understandingcited by 16
- 2026S-VAM: Shortcut Video-Action Model by Self-Distilling Geometric and Semantic Foresightcited by 16
- 2026Action-to-Action Flow Matchingcited by 15
- 2026EgoLive: A Large-Scale Egocentric Dataset from Real-World Human Taskscited by 15
- 2025Developing Vision-Language-Action Model from Egocentric Videoscited by 10
- 2025METIS: Multi-Source Egocentric Training for Integrated Dexterous Vision-Language-Action Modelcited by 9
- 2026HumanNet: Scaling Human-centric Video Learning to One Million Hourscited by 9
- 2026Joint-Aligned Latent Action: Towards Scalable VLA Pretraining in the Wildcited by 8
- 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AIcited by 8
- 2026Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Datacited by 8
- 2026RotVLA: Rotational Latent Action for Vision-Language-Action Modelcited by 7
- 2026GigaBrain-0.7: Scaling Embodied Foundation Models to Emergent Capabilities with a Three-System Architecturecited by 6
- 2026XPolicyLab: A Unified Standard and Open Ecosystem for Robot Policy Evaluation and Deploymentcited by 4
- 2026EgoSteer: An Open-Source Full-Stack System Towards Steerable Dexterous Manipulation from Egocentric Videoscited by 3
- 2026Extending Embodied Question Answering from Perception to Decisioncited by 1
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recoverycited by 1
- 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understandingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
- 2026EWAM: Emergent Depth-Wise Specialization in a Unified Embodied Model -- From Semantic Understanding through Visual Foresight to Action
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026WorldBagel: Uncovering the Power of Unified Multimodal Models for Vision-Language-Action-World Modeling
- 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modeling
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
- 2026Chain of World: World Model Thinking in Latent Motion