HuB: Learning Extreme Humanoid Balance
Not on the map. Why?
Abstract (arXiv)
The human body demonstrates exceptional motor capabilities-such as standing steadily on one foot or performing a high kick with the leg raised over 1.5 meters-both requiring precise balance control. While recent research on humanoid control has leveraged reinforcement learning to track human motions for skill acquisition, applying this paradigm to balance-intensive tasks remains challenging. In this work, we identify three key obstacles: instability from reference motion errors, learning difficulties due to morphological mismatch, and the sim-to-real gap caused by sensor noise and unmodeled dynamics. To address these challenges, we propose HuB (Humanoid Balance), a unified framework that integrates reference motion refinement, balance-aware policy learning, and sim-to-real robustness training, with each component targeting a specific challenge. We validate our approach on the Unitree G1 humanoid robot across challenging quasi-static balance tasks, including extreme single-legged poses such as Swallow Balance and Bruce Lee's Kick. Our policy remains stable even under strong physical disturbances-such as a forceful soccer strike-while baseline methods consistently fail to complete these tasks. Project website: https://hub-robot.github.io
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 42 of its 69 references that are in the map. First posted on arXiv 12 May 2025.
Builds on
42 of 69 references.
References · 42
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 187
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
- 2019Active Domain Randomizationcited by 170
- 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 144
- 2017Preparing for the Unknown: Learning a Universal Policy with Online System Identificationcited by 141
30 more
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 130
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
- 2021Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robotscited by 116
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
- 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 99
- 2024Humanoid Parkour Learningcited by 96
- 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 91
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 88
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2024Humanoid Locomotion as Next Token Predictioncited by 69
- 2019Sim-to-Real Transfer for Biped Locomotioncited by 56
- 2024Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learningcited by 56
- 2024Learning Humanoid Locomotion with Perceptive Internal Modelcited by 50
- 2025Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoidscited by 48
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 46
- 2017Domain Randomization and Generative Models for Robotic Graspingcited by 36
- 2023Robust and Versatile Bipedal Jumping Control through Reinforcement Learningcited by 36
- 2024Learning Smooth Humanoid Locomotion through Lipschitz-Constrained Policiescited by 30
- 2024Whole-body Humanoid Robot Locomotion with Human Referencecited by 29
- 2025Learning Getting-Up Policies for Real-World Humanoid Robotscited by 26
- 2024Berkeley Humanoid: A Research Platform for Learning-based Controlcited by 24
- 2019TuneNet: One-Shot Residual Tuning for System Identification and Sim-to-Real Robot Task Transfercited by 22
- 2022A Real2Sim2Real Method for Robust Object Grasping with Neural Surface Reconstructioncited by 19
- 2022Learning and Deploying Robust Locomotion Policies with Minimal Dynamics Randomizationcited by 17
- 2018Using Deep Reinforcement Learning to Learn High-Level Policies on the ATRIAS Bipedcited by 10
- 2023Domain Randomization for Sim2real Transfer of Automatically Generated Grasping Datasetscited by 9
- 2025Embrace Collisions: Humanoid Shadowing for Deployable Contact-Agnostics Motionscited by 7
- 2020Learning Whole-body Motor Skills for Humanoidscited by 6
- 2022Reactive Stepping for Humanoid Robots using Reinforcement Learning: Application to Standing Push Recovery on the Exoskeleton Atalantecited by 2
Built on by
Citing papers per year: 2025: 15; 2026: 13.
28 papers.
Sort:
By area:
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 71
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 41
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 19
- 2025DreamControl: Human-Inspired Whole-Body Humanoid Control for Scene Interaction via Guided Diffusioncited by 15
- 2025KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Controlcited by 13
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
- 2026ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Controlcited by 11
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
- 2025Towards Adaptable Humanoid Control via Adaptive Motion Trackingcited by 8
- 2025Learning Human-Humanoid Coordination for Collaborative Object Carryingcited by 7
- 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotioncited by 7
16 more
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbationcited by 5
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 5
- 2025Coordinated Humanoid Manipulation with Choice Policiescited by 4
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperationcited by 4
- 2025RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Trackingcited by 3
- 2026Direct Dynamic Retargeting for Humanoid Imitation Learning from Videoscited by 2
- 2025Flexible Locomotion Learning with Diffusion Model Predictive Controlcited by 1
- 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environmentscited by 1
- 2026PDF-HR: Pose Distance Fields for Humanoid Robotscited by 1
- 2026HALO:Closing Sim-to-Real Gap for Heavy-loaded Humanoid Agile Motion Skills via Differentiable Simulationcited by 1
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulationcited by 0
- 2025Discovering Self-Protective Falling Policy for Humanoid Robot via Deep Reinforcement Learningcited by 0
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversalcited by 0
- 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoidscited by 0
- 2026Smoothness as a Constraint for Stable Humanoid Locomotioncited by 0
- 2026HexVIO: Towards All-Day Stereo-Inertial Tracking Through Commodity DSPscited by 0
- 2026HexVIO: Towards All-Day Stereo-Inertial Tracking Through Commodity DSPs2 Oct 2026
- 2026Smoothness as a Constraint for Stable Humanoid Locomotion21 Sep 2026
- 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoids14 Sep 2026
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal15 Jul 2026
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation20 Jun 2026
- 2026Direct Dynamic Retargeting for Humanoid Imitation Learning from Videos22 May 2026
- 2026HALO:Closing Sim-to-Real Gap for Heavy-loaded Humanoid Agile Motion Skills via Differentiable Simulation16 Mar 2026
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching17 Feb 2026
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperation13 Feb 2026
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations6 Feb 2026
- 2026PDF-HR: Pose Distance Fields for Humanoid Robots4 Feb 2026
- 2026ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control30 Jan 2026
16 more
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions19 Jan 2026
- 2025Coordinated Humanoid Manipulation with Choice Policies31 Dec 2025
- 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotion29 Dec 2025
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbation16 Dec 2025
- 2025Discovering Self-Protective Falling Policy for Humanoid Robot via Deep Reinforcement Learning1 Dec 2025
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulation26 Nov 2025
- 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environments25 Nov 2025
- 2025Towards Adaptable Humanoid Control via Adaptive Motion Tracking16 Oct 2025
- 2025Learning Human-Humanoid Coordination for Collaborative Object Carrying16 Oct 2025
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning6 Oct 2025
- 2025Flexible Locomotion Learning with Diffusion Model Predictive Control5 Oct 2025
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction30 Sep 2025
- 2025RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking25 Sep 2025
- 2025KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Control20 Sep 2025
- 2025DreamControl: Human-Inspired Whole-Body Humanoid Control for Scene Interaction via Guided Diffusion17 Sep 2025
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion11 Aug 2025
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 71
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
- 2025RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Trackingcited by 3
- 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environmentscited by 1
- 2026HALO:Closing Sim-to-Real Gap for Heavy-loaded Humanoid Agile Motion Skills via Differentiable Simulationcited by 1
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulationcited by 0
- 2025Discovering Self-Protective Falling Policy for Humanoid Robot via Deep Reinforcement Learningcited by 0
- 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoidscited by 0
- 2026Smoothness as a Constraint for Stable Humanoid Locomotioncited by 0
- 2026Smoothness as a Constraint for Stable Humanoid Locomotion21 Sep 2026
- 2026ResSafe: Learning Safety Filtering with Residual Reinforcement Learning for Humanoids14 Sep 2026
- 2026HALO:Closing Sim-to-Real Gap for Heavy-loaded Humanoid Agile Motion Skills via Differentiable Simulation16 Mar 2026
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions19 Jan 2026
- 2025Discovering Self-Protective Falling Policy for Humanoid Robot via Deep Reinforcement Learning1 Dec 2025
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulation26 Nov 2025
- 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environments25 Nov 2025
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction30 Sep 2025
- 2025RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking25 Sep 2025
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 41
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 19
- 2025KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Controlcited by 13
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
- 2026ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Controlcited by 11
- 2025Towards Adaptable Humanoid Control via Adaptive Motion Trackingcited by 8
- 2025Learning Human-Humanoid Coordination for Collaborative Object Carryingcited by 7
- 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotioncited by 7
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbationcited by 5
- 2025Coordinated Humanoid Manipulation with Choice Policiescited by 4
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperationcited by 4
- 2026PDF-HR: Pose Distance Fields for Humanoid Robotscited by 1
12 most cited of 14 All 14 (JSON)
- 2026HexVIO: Towards All-Day Stereo-Inertial Tracking Through Commodity DSPs2 Oct 2026
- 2026EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal15 Jul 2026
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching17 Feb 2026
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperation13 Feb 2026
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations6 Feb 2026
- 2026PDF-HR: Pose Distance Fields for Humanoid Robots4 Feb 2026
- 2026ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control30 Jan 2026
- 2025Coordinated Humanoid Manipulation with Choice Policies31 Dec 2025
- 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotion29 Dec 2025
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbation16 Dec 2025
- 2025Towards Adaptable Humanoid Control via Adaptive Motion Tracking16 Oct 2025
- 2025Learning Human-Humanoid Coordination for Collaborative Object Carrying16 Oct 2025
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning
- 2026Embedding Classical Balance Control Principles in Reinforcement Learning for Humanoid Recovery
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation
- 2026BAT: Balancing Agility and Stability via Online Policy Switching for Long-Horizon Whole-Body Humanoid Control
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skills
- 2026SkillX: Unified Multi-Skill Policy Learning for Humanoid Soccer
- 2024Agile and versatile bipedal robot tracking control through reinforcement learning
- 2025CoTaP: Compliant Task Pipeline and Reinforcement Learning of Its Controller with Compliance Modulation