DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Mobile manipulation requires a robot to predict how locomotion and arm motion jointly alter future observations and control. Existing world-action models, developed largely for fixed-base platforms, do not explicitly distinguish camera ego-motion from base and arm actions. Here we introduce DECOWAM, a whole-body world-action model that separates these factors through dedicated conditional interfaces. DECOWAM freezes an adapted FastWAM backbone and trains residual adapters, an action-equivalent future bottleneck distilled from privileged observations, adversarially separated base and arm latents, and base-velocity conditioning for video prediction. We further introduce ARMDOG, a real-robot dataset that synchronizes video, whole-body state and action, and language. On a fixed replay protocol, DECOWAM improved both future-video and action prediction over FastWAM, reducing action MSE by 21.7% with 25.95M trainable adaptation parameters. Across 79 closed-loop trials per method, it achieved the highest observed whole-body coordination and base-displacement robustness among the compared systems, while task completion remained comparable to the strongest baseline. These results show that embodiment-aware factorization can support parameter-efficient joint visual prediction and whole-body control under moving viewpoints.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 48 of its 55 references that are in the map. First posted on arXiv 20 Aug 2026.
Builds on
48 of 55 references.
Closest ancestors · 3
Same direction, newest first
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning4 Feb
Other references · 45
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022Video Diffusion Modelscited by 2,280
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
33 more
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2018Datasheets for Datasetscited by 1,371
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2022A Generalist Agentcited by 802
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024Genie: Generative Interactive Environmentscited by 706
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2018Disentangling by Factorisingcited by 614
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2023Learning Interactive Real-World Simulatorscited by 440
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 395
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2022Interactive Language: Talking to Robots in Real Timecited by 217
- 2025Unified Video Action Modelcited by 195
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
- 2022Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behaviorcited by 113
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
- 2023ASC: Adaptive Skill Coordination for Robotic Mobile Manipulationcited by 38
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignmentcited by 1
- 2026ForeTime-VLA: Causal Future-Token Distillation from a World Action Model for Conveyor-Belt Manipulationcited by 0
- 2026ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modelingcited by 0
- 2026ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modeling18 Sep 2026
- 2026MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignment10 Sep 2026
- 2026ForeTime-VLA: Causal Future-Token Distillation from a World Action Model for Conveyor-Belt Manipulation21 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation
- 2026MobileWAM: Bridging World Action Models to Mobile Manipulation with Chain-of-Foresight
- 2026WholeBodyWAM: Generalizing Pre-trained World-Action Priors to Humanoid Loco-Manipulation via WBC-Grounded Coordination
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model
- 2026SkeleWAM: Skeleton World-Action Modeling for Efficient Robotic Manipulation
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation
- 2026World Models for Robotic Manipulation: A Survey