Humanoid World Models: Open World Foundation Models for Humanoid Robotics
On the map: World models → Humanoid and legged locomotion world models
Abstract (arXiv)
Humanoid robots, with their human-like form, are uniquely suited for interacting in environments built for people. However, enabling humanoids to reason, plan, and act in complex open-world settings remains a challenge. World models, models that predict the future outcome of a given action, can support these capabilities by serving as a dynamics model in long-horizon planning and generating synthetic data for policy learning. We introduce Humanoid World Models (HWM), a family of lightweight, open-source models that forecast future egocentric video conditioned on humanoid control tokens. We train two types of generative models, Masked Transformers and Flow-Matching, on 100 hours of humanoid demonstrations. Additionally, we explore architectural variants with different attention mechanisms and parameter-sharing strategies. Our parameter-sharing techniques reduce model size by 33-53% with minimal impact on performance or visual fidelity. HWMs are designed to be trained and deployed in practical academic and small-lab settings, such as 1-2 GPUs.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Humanoid and legged locomotion world models, one of 11 directions in World models. Builds on 30 of its 45 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
30 of 45 references.
References · 30
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
18 more
- 2018World Modelscited by 1,513
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2023A Survey on Video Diffusion Modelscited by 206
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 146
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 125
- 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusioncited by 106
- 2024IRASim: A Fine-Grained World Model for Robot Manipulationcited by 100
- 2024Video as the New Language for Real-World Decision Makingcited by 87
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoderscited by 25
- 2024LLM-enhanced Scene Graph Learning for Household Rearrangementcited by 12
- 2024Perceptions of Humanoid Robots in Caregiving: A Study of Skilled Nursing Home and Long Term Care Administratorscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
- 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoningcited by 14
- 2026Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvementcited by 1
- 2026Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvement2 Sep 2026
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning20 Mar 2026
- 2025A Step Toward World Models: A Survey on Robotic Manipulation31 Oct 2025
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models1 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025Generative World Modelling for Humanoids: 1X World Model Challenge Technical Report
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- 2026Humanoid World Action Model With Joint State--Action Generation
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation
- 2026GreenWAM: A World Foundation Model for Robotics
- 2025DreamPolicy: A Unified World-model Policy for Scalable Humanoid Locomotion
- 2024Hierarchical World Models as Visual Whole-Body Humanoid Controllers
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots