mlsanityData to 7 Oct 2026

OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation

arXiv 2606.22174 ↗First posted 20 Jun 2026cs.ROcited by 4

On the map: Vision-language-action models → Tactile, force-aware and humanoid VLA

Abstract (arXiv)

Whole-body humanoid loco-manipulation requires coordinating the robot's entire kinematic chain. However, most existing systems typically decouple the upper and lower bodies into separate controllers, limiting such coordination and yielding behaviors similar to those of a wheeled dual-arm platform. In this paper, we ask what it takes to build a whole-body native vision-language-action (VLA) model that maps language and pixels directly to all of the humanoid's degrees of freedom. We conduct a systematic empirical study organized as a roadmap of one-variable-at-a-time experiments across three phases: whole-body teleoperation, VLA model design, and heterogeneous co-training. Our study yields several intriguing findings: a joint-based whole-body teleoperation interface outperforms alternatives that only partially expose the humanoid's degrees of freedom; a VLA pretrained on static and wheeled dual-arm platforms transfers surprisingly well to a humanoid's full action space; and co-training with HuMI, the humanoid analog of UMI, extends the policy to new objects and instructions without additional whole-body teleoperation on those targets. Following this roadmap yields OpenHLM, an open-source recipe for whole-body humanoid loco-manipulation. In a challenging long-horizon task that spans a wide vertical range of the humanoid, OpenHLM outperforms two state-of-the-art humanoid VLA baselines (GR00T N1.6 and Psi0) using less than half the total demonstration time. Our code, training data, and model checkpoints are available at [https://openhlm-project.github.io/].

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Tactile, force-aware and humanoid VLA, one of 13 directions in Vision-language-action models. Builds on 44 of its 54 references that are in the map. First posted on arXiv 20 Jun 2026.

Builds on

44 of 54 references.

References · 44

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  9. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  10. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  11. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
  12. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
32 more
  1. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  2. 2022VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Trainingcited by 384
  3. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
  4. 2024Latent Action Pretraining from Videoscited by 302
  5. 2025π*0.6: a VLA That Learns From Experiencecited by 280
  6. 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
  7. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  8. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
  9. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
  10. 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
  11. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
  12. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  13. 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
  14. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 116
  15. 2026Generative Modeling via Driftingcited by 98
  16. 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 86
  17. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
  18. 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
  19. 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 65
  20. 2025Humanoid Policy ~ Human Policycited by 65
  21. 2025Retargeting Matters: General Motion Retargeting for Humanoid Motion Trackingcited by 60
  22. 2024Visual Whole-Body Control for Legged Loco-Manipulationcited by 58
  23. 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 47
  24. 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 41
  25. 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection Systemcited by 39
  26. 2024FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Datasetcited by 36
  27. 2026Psi0: An Open Foundation Model Towards Universal Humanoid Loco-Manipulationcited by 25
  28. 2025MotionTrans: Human VR Data Enable Motion-Level Learning for Robotic Manipulation Policiescited by 22
  29. 2025HuB: Learning Extreme Humanoid Balancecited by 21
  30. 2026EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstrationcited by 18
  31. 2025Behavior Foundation Model for Humanoid Robotscited by 15
  32. 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Humanoid Loco-Manipulation With Discrete VLA Model
  2. 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Control
  3. 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning
  4. 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation
  5. 2025TrajBooster: Boosting Humanoid Whole-Body Manipulation via Trajectory-Centric Learning
  6. 2026KINO: A Keyframe Interface for VLM Planning and Whole-Body Control in Humanoid Loco-Manipulation ↗
  7. 2025DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulation
  8. 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting World