mlsanityData to 7 Oct 2026

DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation

arXiv 2608.20114 ↗First posted 20 Aug 2026cs.AI cs.ROcited by 3

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Mobile manipulation requires a robot to predict how locomotion and arm motion jointly alter future observations and control. Existing world-action models, developed largely for fixed-base platforms, do not explicitly distinguish camera ego-motion from base and arm actions. Here we introduce DECOWAM, a whole-body world-action model that separates these factors through dedicated conditional interfaces. DECOWAM freezes an adapted FastWAM backbone and trains residual adapters, an action-equivalent future bottleneck distilled from privileged observations, adversarially separated base and arm latents, and base-velocity conditioning for video prediction. We further introduce ARMDOG, a real-robot dataset that synchronizes video, whole-body state and action, and language. On a fixed replay protocol, DECOWAM improved both future-video and action prediction over FastWAM, reducing action MSE by 21.7% with 25.95M trainable adaptation parameters. Across 79 closed-loop trials per method, it achieved the highest observed whole-body coordination and base-displacement robustness among the compared systems, while task completion remained comparable to the strongest baseline. These results show that embodiment-aware factorization can support parameter-efficient joint visual prediction and whole-body control under moving viewpoints.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 48 of its 55 references that are in the map. First posted on arXiv 20 Aug 2026.

Builds on

48 of 55 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
  3. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning4 Feb

Other references · 45

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  5. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  7. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  8. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  9. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  10. 2022Video Diffusion Modelscited by 2,280
  11. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  12. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
33 more
  1. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  2. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  3. 2018Datasheets for Datasetscited by 1,371
  4. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  5. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  6. 2023Mastering Diverse Domains through World Modelscited by 1,193
  7. 2020Mastering Atari with Discrete World Modelscited by 990
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  9. 2022A Generalist Agentcited by 802
  10. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  11. 2024Genie: Generative Interactive Environmentscited by 706
  12. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  13. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  14. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  15. 2018Disentangling by Factorisingcited by 614
  16. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  17. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  18. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  19. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  20. 2023Learning Interactive Real-World Simulatorscited by 440
  21. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
  22. 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 395
  23. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  24. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
  25. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  26. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
  27. 2022Interactive Language: Talking to Robots in Real Timecited by 217
  28. 2025Unified Video Action Modelcited by 195
  29. 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
  30. 2022Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behaviorcited by 113
  31. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
  32. 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
  33. 2023ASC: Adaptive Skill Coordination for Robotic Mobile Manipulationcited by 38

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation
  2. 2026MobileWAM: Bridging World Action Models to Mobile Manipulation with Chain-of-Foresight
  3. 2026WholeBodyWAM: Generalizing Pre-trained World-Action Priors to Humanoid Loco-Manipulation via WBC-Grounded Coordination
  4. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
  5. 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model
  6. 2026SkeleWAM: Skeleton World-Action Modeling for Efficient Robotic Manipulation
  7. 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation
  8. 2026World Models for Robotic Manipulation: A Survey