mlsanityData to 14 Oct 2026

ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation

arXiv 2608.06375 ↗First posted 6 Aug 2026cs.ROcited by 6

On the map: World models → Humanoid and legged locomotion world models

Abstract (arXiv)

Humanoid household tasks often require concurrent loco-manipulation, where the robot must move, adjust posture, maintain balance, and manipulate objects as a single coordinated behavior. Yet existing humanoid policies typically decompose locomotion and manipulation, while recent world-action models remain either arm-centric or video-centered. We present ω-0, a latent predictive whole-body world-action model for real-world humanoid concurrent loco-manipulation. Given a language instruction, current visual observation, and robot proprioceptive state, ω-0 directly predicts controller-compatible whole-body action latents for real-robot execution. Rather than reconstructing future videos, ω-0 learns compact future observation embeddings as a lightweight predictive objective, coupling latent visual foresight with diffusion-based whole-body action generation. The model supports egocentric RGB, exocentric RGB, and exocentric depth inputs, and leverages controller-based simulation replay to ground human/public visual-motion priors into robot-executable action latents. We further collect ω-HOME, a 40+ hour real-world household humanoid dataset with synchronized multi-view observations, whole-body SMPL motions, robot states, and action latents. Real-world experiments on 11 household tasks demonstrate that a single ω-0 model can produce smooth manipulate-while-moving behaviors and consistently outperform representative imitation learning, VLA, humanoid, and WAM baselines.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Humanoid and legged locomotion world models, one of 11 directions in World models. Builds on 40 of its 52 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

40 of 52 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation8 Jun

Other references · 39

  1. 2020Denoising Diffusion Implicit Modelscited by 9,781
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  7. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  8. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  9. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  10. 2026World Action Models are Zero-shot Policiescited by 465
  11. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
  12. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
27 more
  1. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
  2. 2026Causal World Modeling for Robot Controlcited by 321
  3. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  4. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  5. 2025Motus: A Unified Latent Action World Modelcited by 251
  6. 2025Unified Video Action Modelcited by 205
  7. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
  8. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 139
  9. 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
  10. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 128
  11. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 101
  12. 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 88
  13. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
  14. 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 83
  15. 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 76
  16. 2025Training-Time Action Conditioning for Efficient Real-Time Chunkingcited by 64
  17. 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 51
  18. 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 37
  19. 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Controlcited by 36
  20. 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 33
  21. 2026Psi0: An Open Foundation Model Towards Universal Humanoid Loco-Manipulationcited by 27
  22. 2024TidyBot++: An Open-Source Holonomic Mobile Manipulator for Robot Learningcited by 22
  23. 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 18
  24. 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotioncited by 7
  25. 2025Do You Have Freestyle? Expressive Humanoid Locomotion via Audio Controlcited by 7
  26. 2026Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Trackingcited by 5
  27. 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots
  2. 2026WB-WAM: Heterogeneous Body-Hand Pre-training for Humanoid Loco-Manipulation ↗
  3. 2026Towards a General Humanoid Loco-Manipulation Model via Egocentric Whole-Body Human Data Pretraining ↗
  4. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  5. 2026DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation
  6. 2026WholeBodyWAM: Learning Whole-Body World Action Models with Scalable Motion Priors
  7. 2026SIMPLE: Simulation-Based Policy Learning and Evaluation for Humanoid Loco-manipulation
  8. 2026EgoActor: Grounding Task Planning into Spatial-aware Egocentric Actions for Humanoid Robots via Visual-Language Models