mlsanityData to 7 Oct 2026

Hybrid Systems Neural Control with Region-of-Attraction Planner

arXiv 2303.10327 ↗First posted 18 Mar 2023cs.RO cs.LG cs.SYcited by 1

Not on the map. Why?

Abstract (arXiv)

Hybrid systems are prevalent in robotics. However, ensuring the stability of hybrid systems is challenging due to sophisticated continuous and discrete dynamics. A system with all its system modes stable can still be unstable. Hence special treatments are required at mode switchings to stabilize the system. In this work, we propose a hierarchical, neural network (NN)-based method to control general hybrid systems. For each system mode, we first learn an NN Lyapunov function and an NN controller to ensure the states within the region of attraction (RoA) can be stabilized. Then an RoA NN estimator is learned across different modes. Upon mode switching, we propose a differentiable planner to ensure the states after switching can land in next mode's RoA, hence stabilizing the hybrid system. We provide novel theoretical stability guarantees and conduct experiments in car tracking control, pogobot navigation, and bipedal walker locomotion. Our method only requires 0.25X of the training time as needed by other learning-based methods. With low running time (10-50X faster than model predictive control (MPC)), our controller achieves a higher stability/success rate over other baselines such as MPC, reinforcement learning (RL), common Lyapunov methods (CLF), linear quadratic regulator (LQR), quadratic programming (QP) and Hamilton-Jacobian-based methods (HJB). The project page is on https://mit-realm.github.io/hybrid-clf.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 73 references that are in the map. First posted on arXiv 18 Mar 2023.

Builds on

22 of 73 references.

References · 22

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  4. 2015Continuous control with deep reinforcement learningcited by 3,279
  5. 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
  6. 2022Safe Control with Learned Certificates: A Survey of Neural Lyapunov, Barrier, and Contraction methodscited by 148
  7. 2020Neural Lyapunov Controlcited by 142
  8. 2021Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functionscited by 91
  9. 2018The Lyapunov Neural Network: Adaptive Stability Certification for Safe Learning of Dynamical Systemscited by 87
  10. 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
  11. 2020Learning Certified Control using Contraction Metriccited by 48
  12. 2020Continuous-Discrete Reinforcement Learning for Hybrid Control in Roboticscited by 42
10 more
  1. 2021MBRL-Lib: A Modular Library for Model-based Reinforcement Learningcited by 41
  2. 2020Neural Bridge Sampling for Evaluating Safety-Critical Autonomous Systemscited by 34
  3. 2020Learning Lyapunov Functions for Hybrid Systemscited by 24
  4. 2019Warm Start of Mixed-Integer Programs for Model Predictive Control of Hybrid Systemscited by 17
  5. 2021Reactive and Safe Road User Simulations using Neural Barrier Certificatescited by 7
  6. 2022Computation of Regions of Attraction for Hybrid Limit Cycles Using Reachability: An Application to Walking Robotscited by 3
  7. 2020Learning Stable Nonparametric Dynamical Systems with Gaussian Process Regressioncited by 2
  8. 2018Poincar'e-Bendixson Theorem for Hybrid Systemscited by 1
  9. 2018Switching between Limit Cycles in a Model of Running Using Exponentially Stabilizing Discrete Control Lyapunov Functioncited by 1
  10. 2019Region of Attraction for Power Systems using Gaussian Process and Converse Lyapunov Function -- Part I: Theoretical Framework and Off-line Studycited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.