mlsanityData to 14 Oct 2026

Humanoid World Models: Open World Foundation Models for Humanoid Robotics

arXiv 2506.01182 ↗First posted 1 Jun 2025cs.RO cs.AIcited by 4

On the map: World models → Humanoid and legged locomotion world models

Abstract (arXiv)

Humanoid robots, with their human-like form, are uniquely suited for interacting in environments built for people. However, enabling humanoids to reason, plan, and act in complex open-world settings remains a challenge. World models, models that predict the future outcome of a given action, can support these capabilities by serving as a dynamics model in long-horizon planning and generating synthetic data for policy learning. We introduce Humanoid World Models (HWM), a family of lightweight, open-source models that forecast future egocentric video conditioned on humanoid control tokens. We train two types of generative models, Masked Transformers and Flow-Matching, on 100 hours of humanoid demonstrations. Additionally, we explore architectural variants with different attention mechanisms and parameter-sharing strategies. Our parameter-sharing techniques reduce model size by 33-53% with minimal impact on performance or visual fidelity. HWMs are designed to be trained and deployed in practical academic and small-lab settings, such as 1-2 GPUs.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Humanoid and legged locomotion world models, one of 11 directions in World models. Builds on 30 of its 45 references that are in the map. First posted on arXiv 1 Jun 2025.

Builds on

30 of 45 references.

References · 30

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2017Neural Discrete Representation Learningcited by 4,712
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  11. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  12. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
18 more
  1. 2018World Modelscited by 1,513
  2. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  3. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  4. 2024Genie: Generative Interactive Environmentscited by 747
  5. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
  6. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  7. 2023Learning Interactive Real-World Simulatorscited by 458
  8. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  9. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
  10. 2023A Survey on Video Diffusion Modelscited by 206
  11. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 146
  12. 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 125
  13. 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusioncited by 106
  14. 2024IRASim: A Fine-Grained World Model for Robot Manipulationcited by 100
  15. 2024Video as the New Language for Real-World Decision Makingcited by 87
  16. 2021Conditional Image Generation by Conditioning Variational Auto-Encoderscited by 25
  17. 2024LLM-enhanced Scene Graph Learning for Household Rearrangementcited by 12
  18. 2024Perceptions of Humanoid Robots in Caregiving: A Study of Skilled Nursing Home and Long Term Care Administratorscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Generative World Modelling for Humanoids: 1X World Model Challenge Technical Report
  2. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
  3. 2026Humanoid World Action Model With Joint State--Action Generation
  4. 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation
  5. 2026GreenWAM: A World Foundation Model for Robotics
  6. 2025DreamPolicy: A Unified World-model Policy for Scalable Humanoid Locomotion
  7. 2024Hierarchical World Models as Visual Whole-Body Humanoid Controllers
  8. 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots