Learning Impact-Rich Rotational Maneuvers via Centroidal Velocity Rewards and Sim-to-Real Techniques: A One-Leg Hopper Flip Case Study
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
Dynamic rotational maneuvers, such as front flips, inherently involve large angular momentum generation and intense impact forces, presenting major challenges for reinforcement learning and sim-to-real transfer. In this work, we propose a general framework for learning and deploying impact-rich, rotation-intensive behaviors through centroidal velocity-based rewards and actuator-aware sim-to-real techniques. We identify that conventional link-level reward formulations fail to induce true whole-body rotation and introduce a centroidal angular velocity reward that accurately captures system-wide rotational dynamics. To bridge the sim-to-real gap under extreme conditions, we model motor operating regions (MOR) and apply transmission load regularization to ensure realistic torque commands and mechanical robustness. Using the one-leg hopper front flip as a representative case study, we demonstrate the first successful hardware realization of a full front flip. Our results highlight that incorporating centroidal dynamics and actuator constraints is critical for reliably executing highly dynamic motions. A supplementary video is available at: https://youtu.be/atMAVI4s1RY
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 24 of its 35 references that are in the map. First posted on arXiv 18 May 2025.
Builds on
24 of 35 references.
Closest ancestors · 3
Same direction, newest first
- 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning24 Feb
- 2024Achieving Stable High-Speed Locomotion for Humanoid Robots with Deep Reinforcement Learning25 Sep
- 2024A Learning Framework for Diverse Legged Robot Locomotion Using Barrier-Based Style Rewards24 Sep
Other references · 21
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
- 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 319
- 2020Learning Agile Robotic Locomotion Skills by Imitating Animalscited by 251
- 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 152
- 2023Robot Parkour Learningcited by 149
- 2022Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotioncited by 88
- 2022Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrationscited by 45
- 2023Barkour: Benchmarking Animal-level Agility with Quadruped Robotscited by 41
- 2022OPT-Mimic: Imitation of Optimized Trajectories for Dynamic Quadruped Behaviorscited by 35
- 2022Optimization-Based Control for Dynamic Legged Robotscited by 35
- 2021The MIT Humanoid Robot: Design, Motion Planning, and Control For Acrobatic Behaviorscited by 32
9 more
- 2024Learning-based legged locomotion; state of the art and future perspectivescited by 23
- 2024Stage-Wise Reward Shaping for Acrobatic Robots: A Constrained Multi-Objective Reinforcement Learning Approachcited by 13
- 2024Cafe-Mpc: A Cascaded-Fidelity Model Predictive Control Framework with Tuning-Free Whole-Body Controlcited by 10
- 2024Identifying Terrain Physical Parameters from Vision -- Towards Physical-Parameter-Aware Locomotion and Navigationcited by 10
- 2023Contact-Implicit Model Predictive Control: Controlling Diverse Quadruped Motions Without Pre-Planned Contact Modes or Trajectoriescited by 8
- 2023Two-Stage Learning of Highly Dynamic Motions with Rigid and Articulated Soft Quadrupedscited by 7
- 2025Online Friction Coefficient Identification for Legged Robots on Slippery Terrain Using Smoothed Contact Gradientscited by 4
- 2021On the Emergence of Whole-body Strategies from Humanoid Robot Push-recovery Learningcited by 3
- 2022Momentum-Aware Trajectory Optimization and Control for Agile Quadrupedal Locomotioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulation
- 2025Towards bridging the gap: Systematic sim-to-real transfer for diverse legged robots
- 2026Actuator Reality Shaping for Zero-Shot Sim-to-Real Robot Learning ↗
- 2026Dynamics-Informed Reinforcement Learning for Agile and Energy-Efficient Locomotion of a Monopedal Hopping Quadcopter
- 2026Extending the Speed Limit of Quadrupedal Locomotion via Refined Actuator Modeling and Adaptive Command Scheduling ↗
- 2024Learning to Control Emulated Muscles in Real Robots: Towards Exploiting Bio-Inspired Actuator Morphology ↗
- 2024Lessons from Learning to Spin "Pens"
- 2025Reactive Aerobatic Flight via Reinforcement Learning