Learning Linear Policies for Robust Bipedal Locomotion on Terrains with Varying Slopes
Not on the map. Why?
Abstract (arXiv)
In this paper, with a view toward deployment of light-weight control frameworks for bipedal walking robots, we realize end-foot trajectories that are shaped by a single linear feedback policy. We learn this policy via a model-free and a gradient-free learning algorithm, Augmented Random Search (ARS), in the two robot platforms Rabbit and Digit. Our contributions are two-fold: a) By using torso and support plane orientation as inputs, we achieve robust walking on slopes of up to 20 degrees in simulation. b) We demonstrate additional behaviors like walking backwards, stepping-in-place, and recovery from external pushes of up to 120 N. The end result is a robust and a fast feedback control law for bipedal walking on terrains with varying slopes. Towards the end, we also provide preliminary results of hardware transfer to Digit.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 4 Apr 2021.
Builds on
14 of 31 references.
References · 14
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2015Trust Region Policy Optimizationcited by 2,580
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
- 2020ALLSTEPS: Curriculum-driven Learning of Stepping Stone Skillscited by 54
- 2018Feedback Control For Cassie With Deep Reinforcement Learningcited by 45
- 2020Learning Memory-Based Control for Human-Scale Bipedal Locomotioncited by 28
- 2020Learning Task Space Actions for Bipedal Locomotioncited by 21
- 2019Contact-Aided Invariant Extended Kalman Filtering for Robot State Estimationcited by 18
- 2019Iterative Reinforcement Learning Based Design of Dynamic Locomotion Skills for Cassiecited by 14
- 2019Hybrid Zero Dynamics Inspired Feedback Control Policy Design for 3D Bipedal Locomotion using Reinforcement Learningcited by 8
- 2020Robust Quadrupedal Locomotion on Sloped Terrains: A Linear Policy Approachcited by 6
- 2017Combining Trajectory Optimization, Supervised Machine Learning, and Model Structure for Mitigating the Curse of Dimensionality in the Control of Bipedal Robotscited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 1.
3 papers.