Autotuning Bipedal Locomotion MPC with GRFM-Net for Efficient Sim-to-Real Transfer
Not on the map. Why?
Abstract (arXiv)
Bipedal locomotion control is essential for humanoid robots to navigate complex, human-centric environments. While optimization-based control designs are popular for integrating sophisticated models of humanoid robots, they often require labor-intensive manual tuning. In this work, we address the challenges of parameter selection in bipedal locomotion control using DiffTune, a model-based autotuning method that leverages differential programming for efficient parameter learning. A major difficulty lies in balancing model fidelity with differentiability. We address this difficulty using a low-fidelity model for differentiability, enhanced by a Ground Reaction Force-and-Moment Network (GRFM-Net) to capture discrepancies between MPC commands and actual control effects. We validate the parameters learned by DiffTune with GRFM-Net in hardware experiments, which demonstrates the parameters' optimality in a multi-objective setting compared with baseline parameters, reducing the total loss by up to 40.5% compared with the expert-tuned parameters. The results confirm the GRFM-Net's effectiveness in mitigating the sim-to-real gap, improving the transferability of simulation-learned parameters to real hardware.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 51 references that are in the map. First posted on arXiv 24 Sep 2024.
Builds on
28 of 51 references.
References · 28
- 2019Learning agile and dynamic motor skills for legged robotscited by 402
- 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 375
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
- 2022Accelerated Policy Learning with Parallel Differentiable Simulationcited by 92
- 2022Do Differentiable Simulators Give Better Policy Gradients?cited by 83
- 2021Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contactcited by 50
- 2024A Review of Differentiable Simulatorscited by 26
- 2022Optimization-Based Control for Dynamic Legged Robotscited by 21
- 2017Bayesian Optimization Using Domain Knowledge on the ATRIAS Bipedcited by 17
- 2022The Curse of Unrolling: Rate of Differentiating Through Optimizationcited by 15
- 2021Recursive Feasibility Guided Optimal Parameter Adaptation of Differential Convex Optimization Policies for Safety-Critical Systemscited by 7
- 2024Tailoring Solution Accuracy for Fast Whole-body Model Predictive Control of Legged Robotscited by 7
16 more
- 2019Dynamic Locomotion For Passive-Ankle Biped Robots And Humanoids Using Whole-Body Locomotion Controlcited by 5
- 2021Autonomous Navigation of Underactuated Bipedal Robots in Height-Constrained Environmentscited by 5
- 2021Integrated Task and Motion Planning for Safe Legged Navigation in Partially Observable Environmentscited by 5
- 2022Bayesian Optimization Meets Hybrid Zero Dynamics: Safe Parameter Learning for Bipedal Locomotion Controlcited by 5
- 2015Stability of Surface Contacts for Humanoid Robots: Closed-Form Formulae of the Contact Wrench Cone for Rectangular Support Areascited by 4
- 2023Walking-by-Logic: Signal Temporal Logic-Guided Model Predictive Control for Bipedal Locomotion Resilient to External Perturbationscited by 4
- 2023DiffTune-MPC: Closed-Loop Learning for Model Predictive Controlcited by 4
- 2020Robust walking based on MPC with viability guaranteescited by 3
- 2020Global Position Control on Underactuated Bipedal Robots: Step-to-step Dynamics Approximation for Step Planningcited by 3
- 2021DiffLoop: Tuning PID controllers by differentiating through the feedback loopcited by 3
- 2022Planar Bipedal Locomotion with Nonlinear Model Predictive Control: Online Gait Generation using Whole-Body Dynamicscited by 3
- 2023Dynamic Loco-manipulation on HECTOR: Humanoid for Enhanced ConTrol and Open-source Researchcited by 3
- 2020LQR-Assisted Whole-Body Control of a Wheeled Bipedal Robot with Kinematic Loopscited by 2
- 2022DiffTune^+: Hyperparameter-Free Auto-Tuning using Auto-Differentiationcited by 2
- 2021Force-and-moment-based Model Predictive Control for Achieving Highly Dynamic Locomotion on Bipedal Robotscited by 1
- 2023Gaussian Process-Based Learning Control of Underactuated Balance Robots with an External and Internal Convertible Modeling Structurecited by 1
Built on by
Not cited yet.