mlsanityData to 7 Oct 2026

KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Control

arXiv 2509.16638 ↗First posted 20 Sep 2025cs.RO cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Learning versatile whole-body skills by tracking various human motions is a fundamental step toward general-purpose humanoid robots. This task is particularly challenging because a single policy must master a broad repertoire of motion skills while ensuring stability over long-horizon sequences. To this end, we present VMS, a unified whole-body controller that enables humanoid robots to learn diverse and dynamic behaviors within a single policy. Our framework integrates a hybrid tracking objective that balances local motion fidelity with global trajectory consistency, and an Orthogonal Mixture-of-Experts (OMoE) architecture that encourages skill specialization while enhancing generalization across motions. A segment-level tracking reward is further introduced to relax rigid step-wise matching, enhancing robustness when handling global displacements and transient inaccuracies. We validate VMS extensively in both simulation and real-world experiments, demonstrating accurate imitation of dynamic skills, stable performance over minute-long sequences, and strong generalization to unseen motions. These results highlight the potential of VMS as a scalable foundation for versatile humanoid whole-body control. The project page is available at https://kungfubot2-humanoid.github.io.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 42 of its 54 references that are in the map. First posted on arXiv 20 Sep 2025.

Builds on

42 of 54 references.

References · 42

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  3. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  4. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
  5. 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
  6. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  7. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
  8. 2023From Sparse to Soft Mixtures of Expertscited by 245
  9. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
  10. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
  11. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
  12. 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 132
30 more
  1. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
  2. 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
  3. 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 109
  4. 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
  5. 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 101
  6. 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 98
  7. 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 86
  8. 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 76
  9. 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 75
  10. 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
  11. 2024Humanoid Parkour Learningcited by 66
  12. 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 63
  13. 2023Multi-Task Reinforcement Learning with Mixture of Orthogonal Expertscited by 45
  14. 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 39
  15. 2025CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Taskscited by 35
  16. 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 34
  17. 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 34
  18. 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 32
  19. 2025HITTER: A HumanoId Table TEnnis Robot via Hierarchical Planning and Learningcited by 29
  20. 2025FALCON: Learning Force-Adaptive Humanoid Loco-Manipulationcited by 28
  21. 2023Robust and Versatile Bipedal Jumping Control through Reinforcement Learningcited by 27
  22. 2025SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrationscited by 23
  23. 2025Learning Getting-Up Policies for Real-World Humanoid Robotscited by 21
  24. 2025HuB: Learning Extreme Humanoid Balancecited by 21
  25. 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 16
  26. 2025Adversarial Locomotion and Motion Imitation for Humanoid Policy Learningcited by 9
  27. 2025Hold My Beer: Learning Gentle Humanoid Locomotion and End-Effector Stabilization Controlcited by 8
  28. 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learningcited by 7
  29. 2025MoRE: Mixture of Residual Experts for Humanoid Lifelike Gaits Learning on Complex Terrainscited by 6
  30. 2025HIL: Hybrid Imitation Learning of Diverse Parkour Skills from Videoscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 10.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Embodiment-Aware Generalist Specialist Distillation for Unified Humanoid Whole-Body Control
  2. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control
  3. 2026WholeBodyWAM: Generalizing Pre-trained World-Action Priors to Humanoid Loco-Manipulation via WBC-Grounded Coordination
  4. 2024Hierarchical World Models as Visual Whole-Body Humanoid Controllers
  5. 2025Generating Physically Realistic and Directable Human Motions from Multi-Modal Inputs
  6. 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning
  7. 2026WholeBodyWAM: Learning Whole-Body World Action Models with Scalable Motion Priors
  8. 2026BAT: Balancing Agility and Stability via Online Policy Switching for Long-Horizon Whole-Body Humanoid Control