mlsanityData to 14 Oct 2026

Learned Lyapunov Shielding for Adaptive Control

arXiv 2605.06934 ↗First posted 7 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We augment the Slotine--Li adaptive controller for Euler--Lagrange systems with three learned components: a structured-quadratic Lyapunov function (V_psi) whose positive-definiteness follows from a Cholesky parameterization, a residual Soft Actor--Critic policy that adds bounded torque corrections to the analytic baseline, and a physics-informed neural network that estimates unmodeled dynamics. A closed-form safety filter, derived from the single affine constraint (dot V_psi + α V_psi ≤ 0), projects every policy output onto the safe set without requiring an online QP solver. We prove: global feasibility of the filter under a drift-decay condition on the control-degeneracy set; exponential stability under exact shielding, with a robust extension whose margin depends on the PINN approximation error; almost-sure convergence of the three-timescale policy--certificate--multiplier updates to a KKT point; and a PAC generalization bound for the certificate over compacts. On a 2-DOF manipulator with nonlinear friction and variable payload, the learned certificate accounts for most of the empirical gain: tracking error drops by 41% on nominal friction and 24% on aggressive friction at the centroid of the training distribution. A 7-DOF scalability study on a Franka Emika Panda confirms clean convergence of the full pipeline at industrial scale, identifies the conditions under which gains over exact model-based baselines should and should not be expected, and documents a warm-start pathology of the learned certificate that has practical implications for deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

21 of 39 references.

References · 21

  1. 2017Constrained Policy Optimizationcited by 983
  2. 2019Hamiltonian Neural Networkscited by 712
  3. 2018Reward Constrained Policy Optimizationcited by 417
  4. 2016Input Convex Neural Networkscited by 414
  5. 2020Responsive Safety in Reinforcement Learning by PID Lagrangian Methodscited by 316
  6. 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 297
  7. 2019End-to-End Safe Reinforcement Learning through Barrier Functions for Safety-Critical Continuous Control Taskscited by 289
  8. 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 287
  9. 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
  10. 2019Constrained Reinforcement Learning Has Zero Duality Gapcited by 151
  11. 2020Neural Lyapunov Controlcited by 142
  12. 2021Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functionscited by 94
9 more
  1. 2018The Lyapunov Neural Network: Adaptive Stability Certification for Safe Learning of Dynamical Systemscited by 88
  2. 2021Safe Reinforcement Learning Using Robust Control Barrier Functionscited by 59
  3. 2022Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guaranteescited by 40
  4. 2021Physics-Informed Neural Nets for Control of Dynamical Systemscited by 31
  5. 2024Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulationcited by 25
  6. 2022Learning Safe, Generalizable Perception-based Hybrid Control with Certificatescited by 24
  7. 2021Physics-informed Neural Networks-based Model Predictive Control for Multi-link Manipulatorscited by 21
  8. 2023Physics-informed Neural Networks to Model and Control Robots: a Theoretical and Experimental Investigationcited by 17
  9. 2025Explicit Control Barrier Function-based Safety Filters and their Resource-Aware Computationcited by 1

Built on by

Not cited yet.