mlsanityData to 7 Oct 2026

Gait Switching and Enhanced Stabilization of Walking Robots with Deep Learning-based Reachability: A Case Study on Two-link Walker

arXiv 2409.16301 ↗First posted 10 Sep 2024cs.RO cs.LG cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning-based approaches have recently shown notable success in legged locomotion. However, these approaches often lack accountability, necessitating empirical tests to determine their effectiveness. In this work, we are interested in designing a learning-based locomotion controller whose stability can be examined and guaranteed. This can be achieved by verifying regions of attraction (RoAs) of legged robots to their stable walking gaits. This is a non-trivial problem for legged robots due to their hybrid dynamics. Although previous work has shown the utility of Hamilton-Jacobi (HJ) reachability to solve this problem, its practicality was limited by its poor scalability. The core contribution of our work is the employment of a deep learning-based HJ reachability solution to the hybrid legged robot dynamics, which overcomes the previous work's limitation. With the learned reachability solution, first, we can estimate a library of RoAs for various gaits. Second, we can design a one-step predictive controller that effectively stabilizes to an individual gait within the verified RoA. Finally, we can devise a strategy that switches gaits, in response to external perturbations, whose feasibility is guided by the RoA analysis. We demonstrate our method in a two-link walker simulation, whose mathematical model is well established. Our method achieves improved stability than previous model-based methods, while ensuring transparency that was not present in the existing learning-based approaches.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 10 Sep 2024.

Builds on

25 of 42 references.

References · 25

  1. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  2. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  3. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  4. 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
  5. 2019Learning agile and dynamic motor skills for legged robotscited by 402
  6. 2017Hamilton-Jacobi Reachability: A Brief Overview and Recent Advancescited by 186
  7. 2021Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robotscited by 95
  8. 2020DeepReach: A Deep Learning Approach to High-Dimensional Reachabilitycited by 81
  9. 2021Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learningcited by 73
  10. 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 63
  11. 2024Humanoid Locomotion as Next Token Predictioncited by 63
  12. 2020Reinforcement Learning for Safety-Critical Control under Model Uncertainty, using Control Lyapunov Functions and Control Barrier Functionscited by 61
13 more
  1. 2021Fast and Efficient Locomotion via Learned Gait Transitionscited by 50
  2. 2014Reach-Avoid Problems with Time-Varying Dynamics, Targets and Constraintscited by 41
  3. 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
  4. 2019Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architecturescited by 21
  5. 2022Lyapunov Design for Robust and Efficient Robotic Reinforcement Learningcited by 20
  6. 2022Generating Formal Safety Assurances for High-Dimensional Reachabilitycited by 11
  7. 2022Parameter-Conditioned Reachable Sets for Updating Safety Assurances Onlinecited by 11
  8. 2020Reliable Trajectories for Dynamic Quadrupeds using Analytical Costs and Learned Initializationscited by 4
  9. 2022Computation of Regions of Attraction for Hybrid Limit Cycles Using Reachability: An Application to Walking Robotscited by 3
  10. 2021Reactive Locomotion Decision-Making and Robust Motion Planning for Real-Time Perturbation Recoverycited by 2
  11. 2018On infinitesimal contraction analysis for hybrid systemscited by 1
  12. 2023Hybrid Systems Neural Control with Region-of-Attraction Plannercited by 1
  13. 2023A Unified Perspective on Multiple Shooting In Differential Dynamic Programmingcited by 1

Built on by

Not cited yet.