mlsanityData to 14 Oct 2026

Booster Gym: An End-to-End Reinforcement Learning Framework for Humanoid Robot Locomotion

arXiv 2506.15132 ↗First posted 18 Jun 2025cs.ROcited by 3

On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation

Abstract (arXiv)

Recent advancements in reinforcement learning (RL) have led to significant progress in humanoid robot locomotion, simplifying the design and training of motion policies in simulation. However, the numerous implementation details make transferring these policies to real-world robots a challenging task. To address this, we have developed a comprehensive code framework that covers the entire process from training to deployment, incorporating common RL training methods, domain randomization, reward function design, and solutions for handling parallel structures. This library is made available as a community resource, with detailed descriptions of its design and experimental results. We validate the framework on the Booster T1 robot, demonstrating that the trained policies seamlessly transfer to the physical platform, enabling capabilities such as omnidirectional walking, disturbance resistance, and terrain adaptability. We hope this work provides a convenient tool for the robotics community, accelerating the development of humanoid robots. The code can be found in https://github.com/BoosterRobotics/booster_gym.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 19 of its 21 references that are in the map. First posted on arXiv 18 Jun 2025.

Builds on

19 of 21 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learning26 Aug
  2. 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control30 Jan

Other references · 17

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  3. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  4. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  5. 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
  6. 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
  7. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
  8. 2019Learning agile and dynamic motor skills for legged robotscited by 504
  9. 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 238
  10. 2018Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experiencecited by 217
  11. 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 187
  12. 2020Sim-to-Real Learning of All Common Bipedal Gaits via Periodic Reward Compositioncited by 96
5 more
  1. 2025MuJoCo Playgroundcited by 78
  2. 2022Adapting Rapid Motor Adaptation for Bipedal Robotscited by 54
  3. 2024Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfercited by 53
  4. 2024Tailoring Solution Accuracy for Fast Whole-body Model Predictive Control of Legged Robotscited by 13
  5. 2025HiFAR: Multi-Stage Curriculum Learning for High-Dynamics Humanoid Fall Recoverycited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Booster Lab: A Data-Centric Pipeline for Learning Deployable Humanoid Locomotion Policies ↗
  2. 2026AGILE: A Comprehensive Workflow for Humanoid Loco-Manipulation Learning
  3. 2025Robot Trains Robot: Automatic Real-World Policy Adaptation and Learning for Humanoids
  4. 2025STRIDE: Automating Reward Design, Deep Reinforcement Learning Training and Feedback Optimization in Humanoid Robotics Locomotion
  5. 2025Learning Sim-to-Real Humanoid Locomotion in 15 Minutes
  6. 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation
  7. 2025FastTD3: Simple, Fast, and Capable Reinforcement Learning for Humanoid Control
  8. 2024AnyBipe: An End-to-End Framework for Training and Deploying Bipedal Robots Guided by Large Language Models