KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Control
Not on the map. Why?
Abstract (arXiv)
Learning versatile whole-body skills by tracking various human motions is a fundamental step toward general-purpose humanoid robots. This task is particularly challenging because a single policy must master a broad repertoire of motion skills while ensuring stability over long-horizon sequences. To this end, we present VMS, a unified whole-body controller that enables humanoid robots to learn diverse and dynamic behaviors within a single policy. Our framework integrates a hybrid tracking objective that balances local motion fidelity with global trajectory consistency, and an Orthogonal Mixture-of-Experts (OMoE) architecture that encourages skill specialization while enhancing generalization across motions. A segment-level tracking reward is further introduced to relax rigid step-wise matching, enhancing robustness when handling global displacements and transient inaccuracies. We validate VMS extensively in both simulation and real-world experiments, demonstrating accurate imitation of dynamic skills, stable performance over minute-long sequences, and strong generalization to unseen motions. These results highlight the potential of VMS as a scalable foundation for versatile humanoid whole-body control. The project page is available at https://kungfubot2-humanoid.github.io.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 42 of its 54 references that are in the map. First posted on arXiv 20 Sep 2025.
Builds on
42 of 54 references.
References · 42
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2023From Sparse to Soft Mixtures of Expertscited by 245
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 132
30 more
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 109
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 101
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 98
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 86
- 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 76
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 75
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
- 2024Humanoid Parkour Learningcited by 66
- 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 63
- 2023Multi-Task Reinforcement Learning with Mixture of Orthogonal Expertscited by 45
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 39
- 2025CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Taskscited by 35
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 34
- 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 34
- 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 32
- 2025HITTER: A HumanoId Table TEnnis Robot via Hierarchical Planning and Learningcited by 29
- 2025FALCON: Learning Force-Adaptive Humanoid Loco-Manipulationcited by 28
- 2023Robust and Versatile Bipedal Jumping Control through Reinforcement Learningcited by 27
- 2025SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrationscited by 23
- 2025Learning Getting-Up Policies for Real-World Humanoid Robotscited by 21
- 2025HuB: Learning Extreme Humanoid Balancecited by 21
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 16
- 2025Adversarial Locomotion and Motion Imitation for Humanoid Policy Learningcited by 9
- 2025Hold My Beer: Learning Gentle Humanoid Locomotion and End-Effector Stabilization Controlcited by 8
- 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learningcited by 7
- 2025MoRE: Mixture of Residual Experts for Humanoid Lifelike Gaits Learning on Complex Terrainscited by 6
- 2025HIL: Hybrid Imitation Learning of Diverse Parkour Skills from Videoscited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 10.
11 papers.
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026HoloMotion-1 Technical Reportcited by 8
- 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotioncited by 6
- 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstructioncited by 5
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 1
- 2026GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Trackingcited by 1
- 2026Stubborn: A Streamlined and Unified Reinforcement Learning Framework for Robust Motion Tracking and Fall Recovery for Humanoidscited by 0
- 2026AnyBody: Free-Form Whole-Body Humanoid Control from Arbitrary Keypoint Guidancecited by 0
- 2026GaitSpan: Growing Humanoid Locomotion from Walking to Runningcited by 0
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interactioncited by 0
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interaction18 Aug 2026
- 2026GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Tracking2 Aug 2026
- 2026GaitSpan: Growing Humanoid Locomotion from Walking to Running13 Jul 2026
- 2026AnyBody: Free-Form Whole-Body Humanoid Control from Arbitrary Keypoint Guidance28 Jun 2026
- 2026Stubborn: A Streamlined and Unified Reinforcement Learning Framework for Robust Motion Tracking and Fall Recovery for Humanoids11 Jun 2026
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework19 May 2026
- 2026HoloMotion-1 Technical Report14 May 2026
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating25 Mar 2026
- 2026MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstruction17 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026
- 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotion29 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026Embodiment-Aware Generalist Specialist Distillation for Unified Humanoid Whole-Body Control
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control
- 2026WholeBodyWAM: Generalizing Pre-trained World-Action Priors to Humanoid Loco-Manipulation via WBC-Grounded Coordination
- 2024Hierarchical World Models as Visual Whole-Body Humanoid Controllers
- 2025Generating Physically Realistic and Directable Human Motions from Multi-Modal Inputs
- 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning
- 2026WholeBodyWAM: Learning Whole-Body World Action Models with Scalable Motion Priors
- 2026BAT: Balancing Agility and Stability via Online Policy Switching for Long-Horizon Whole-Body Humanoid Control