Neural Lyapunov Control
Not on the map. Why?
Abstract (arXiv)
We propose new methods for learning control policies and neural network Lyapunov functions for nonlinear control problems, with provable guarantee of stability. The framework consists of a learner that attempts to find the control and Lyapunov functions, and a falsifier that finds counterexamples to quickly guide the learner towards solutions. The procedure terminates when no counterexample is found by the falsifier, in which case the controlled nonlinear system is provably stable. The approach significantly simplifies the process of Lyapunov control design, provides end-to-end correctness guarantee, and can obtain much larger regions of attraction than existing methods such as LQR and SOS/SDP. We show experiments on how the new methods obtain high-quality solutions for challenging control problems.
Key facts. Cited by 142 papers in the map (data through 13 Oct 2026). First posted on arXiv 1 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 26; 2023: 22; 2024: 31; 2025: 19; 2026: 18.
142 papers.
Sort:
By area:
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2022Enforcing Hard Constraints with Soft Barriers: Safe Reinforcement Learning in Unknown Stochastic Environmentscited by 54
- 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 43
- 2021Contraction Theory for Nonlinear Stability Analysis and Learning-based Control: A Tutorial Overviewcited by 42
- 2022Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guaranteescited by 40
- 2021On the Sample Complexity of Stability Constrained Imitation Learningcited by 38
- 2021Adaptive-Control-Oriented Meta-Learning for Nonlinear Systemscited by 38
- 2023Iterative Reachability Estimation for Safe Reinforcement Learningcited by 35
- 2021Enforcing Policy Feasibility Constraints through Differentiable Projection for Energy Optimizationcited by 31
- 2021Offline Reinforcement Learning for Autonomous Driving with Safety and Exploration Enhancementcited by 29
- 2024Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformerscited by 29
- 2022Lyapunov Density Models: Constraining Distribution Shift in Learning-Based Controlcited by 28
38 more
- 2022Safe Control Under Input Limits with Neural Control Barrier Functionscited by 27
- 2021Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learningcited by 25
- 2021Stability Verification in Stochastic Control Systems via Neural Network Supermartingalescited by 24
- 2022Safety Certification for Stochastic Systems via Neural Barrier Functionscited by 22
- 2023Neural Lyapunov Control for Discrete-Time Systemscited by 22
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guaranteescited by 21
- 2023Physics-Informed Neural Network Lyapunov Functions: PDE Characterization, Learning, and Verificationcited by 20
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attackscited by 20
- 2025Dexterous Manipulation through Imitation Learning: A Surveycited by 20
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrationscited by 19
- 2021Value Iteration in Continuous Actions, States and Timecited by 18
- 2022Backward Reachability Analysis of Neural Feedback Loops: Techniques for Linear and Nonlinear Systemscited by 18
- 2021Learning Stable Deep Dynamics Models for Partially Observed or Delayed Dynamical Systemscited by 17
- 2022SABLAS: Learning Safe Control for Black-box Dynamical Systemscited by 17
- 2022Control-oriented meta-learningcited by 17
- 2021Neural Termination Analysiscited by 16
- 2021Almost Surely Stable Deep Dynamicscited by 16
- 2021Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximationcited by 16
- 2023AutoCost: Evolving Intrinsic Cost for Zero-violation Reinforcement Learningcited by 16
- 2023In-Distribution Barrier Functions: Self-Supervised Policy Filters that Avoid Out-of-Distribution Statescited by 16
- 2023Neural Operators of Backstepping Controller and Observer Gain Functions for Reaction-Diffusion PDEscited by 16
- 2023Fossil 2.0: Formal Certificate Synthesis for the Verification and Control of Dynamical Modelscited by 15
- 2024Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificatescited by 15
- 2021Infinite Time Horizon Safety of Bayesian Neural Networkscited by 13
- 2021Learning over All Stabilizing Nonlinear Controllers for a Partially-Observed Linear Systemcited by 13
- 2022Policy Optimization with Advantage Regularization for Long-Term Fairness in Decision Systemscited by 13
- 2023Compositional Policy Learning in Stochastic Control Systems with Formal Guaranteescited by 12
- 2024Hamilton-Jacobi Reachability in Reinforcement Learning: A Surveycited by 12
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagationcited by 12
- 2025Systems Security Foundations for Agentic Computingcited by 12
- 2021Learning Density Distribution of Reachable States for Autonomous Systemscited by 11
- 2022Neural Koopman Lyapunov Controlcited by 11
- 2022Joint Differentiable Optimization and Verification for Certified Reinforcement Learningcited by 11
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systemscited by 11
- 2023Neural Abstractionscited by 11
- 2021Youla-REN: Learning Nonlinear Feedback Policies with Robust Stability Guaranteescited by 10
- 2024LyZNet: A Lightweight Python Tool for Learning and Verifying Neural Lyapunov Functions and Regions of Attractioncited by 10
- 2021Robust Value Iteration for Continuous Control Taskscited by 8
50 most cited of 142 All 142 (JSON)
- 2026Learning Provable Neural Network Observer for Uncertain Dynamical Systems25 Sep 2026
- 2026Lyapunov Guidance: A Unified Framework for Stabilizing Generative Flows15 Jul 2026
- 2026PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation11 Jun 2026
- 2026Certificate-Guided Evaluation of Reinforcement Learning Generalization30 May 2026
- 2026Bridging Control with Neural Network Verifier alpha-beta-CROWN: A Tutorial26 May 2026
- 2026Adaptive Data Harvesting for Efficient Neural Network Learning with Universal Constraints10 May 2026
- 2026Learned Lyapunov Shielding for Adaptive Control7 May 2026
- 2026Set-Based Training of Neural Barrier Certificates for Safety Verification of Dynamical Systems4 May 2026
- 2026Lyapunov-Guided Self-Alignment: Test-Time Adaptation for Offline Safe Reinforcement Learning29 Apr 2026
- 2026Co-Learning Port-Hamiltonian Systems and Optimal Energy-Shaping Control28 Apr 2026
- 2026GIFT: Global stabilisation via Intrinsic Fine Tuning25 Apr 2026
- 2026Verifiable Error Bounds for Physics-Informed Neural Network Solutions of Lyapunov and Hamilton-Jacobi-Bellman Equations20 Mar 2026
38 more
- 2026Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees19 Mar 2026
- 2026Functorial Neural Architectures from Higher Inductive Types17 Mar 2026
- 2026Continuous Modal Logical Neural Networks: Modal Reasoning via Stochastic Accessibility4 Mar 2026
- 2026Reinforcement Learning for Control with Probabilistic Stability Guarantee: A Finite-Sample Approach9 Feb 2026
- 2026Formal Synthesis of Certifiably Robust Neural Lyapunov-Barrier Certificates5 Feb 2026
- 2026Discovering Data Manifold Geometry through Geometric Properties2 Feb 2026
- 2025MSACL: Multi-Step Actor-Critic Learning with Lyapunov Certificates for Exponentially Stabilizing Control31 Dec 2025
- 2025Systems Security Foundations for Agentic Computing1 Dec 2025
- 2025The Silence that Speaks: Neural Estimation via Communication Gaps30 Nov 2025
- 2025Lyapunov Stability Learning with Nonlinear Control via Inductive Biases3 Nov 2025
- 2025A Fast Initialization Method for Neural Network Controllers: A Case Study of Image-based Visual Servoing Control for the multicopter Interception23 Sep 2025
- 2025Off Policy Lyapunov Stability in Reinforcement Learning11 Sep 2025
- 2025Formal Verification of Neural Certificates Done Dynamically16 Jul 2025
- 2025A New Perspective On AI Safety Through Control Theory Methodologies30 Jun 2025
- 2025Safe Domains of Attraction for Discrete-Time Nonlinear Systems: Characterization and Verifiable Neural Network Estimation16 Jun 2025
- 2025Two-Stage Learning of Stabilizing Neural Controllers via Zubov Sampling and Iterative Domain Expansion2 Jun 2025
- 2025VeRecycle: Reclaiming Guarantees from Probabilistic Certificates for Stochastic Dynamical Systems after Change20 May 2025
- 2025Certifying Stability of Reinforcement Learning Policies using Generalized Lyapunov Functions16 May 2025
- 2025Neural Contraction Metrics with Formal Guarantees for Discrete-Time Nonlinear Dynamical Systems23 Apr 2025
- 2025Learning Verifiable Control Policies Using Relaxed Verification23 Apr 2025
- 2025Dexterous Manipulation through Imitation Learning: A Survey4 Apr 2025
- 2025Learning Geometrically-Informed Lyapunov Functions with Deep Diffeomorphic RBF Networks3 Apr 2025
- 2025Neural Lyapunov Function Approximation with Self-Supervised Reinforcement Learning19 Mar 2025
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks28 Feb 2025
- 2025Hierarchical Multi-Agent Framework for Carbon-Efficient Liquid-Cooled Data Center Clusters12 Feb 2025
- 2024AI-Powered CPS-Enabled Vulnerable-User-Aware Urban Transportation Digital Twin: Methods and Applications30 Dec 2024
- 2024Neural Continuous-Time Supermartingale Certificates23 Dec 2024
- 2024Neural Control and Certificate Repair via Runtime Monitoring17 Dec 2024
- 2024Certified Training with Branch-and-Bound for Lyapunov-stable Neural Control27 Nov 2024
- 2024Safe PDE Boundary Control with Neural Operators23 Nov 2024
- 2024Dynamic Tube MPC: Learning Tube Dynamics with Massively Parallel Simulation for Robust Safety in Practice22 Nov 2024
- 2024Neural Model Checking31 Oct 2024
- 2024Adversarially Robust Out-of-Distribution Detection Using Lyapunov-Stabilized Embeddings14 Oct 2024
- 2024Control the GNN: Utilizing Neural Controller with Lyapunov Stability for Test-Time Feature Reconstruction13 Oct 2024
- 2024Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers10 Oct 2024
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagation4 Oct 2024
- 2024Formally Verified Physics-Informed Neural Control Lyapunov Functions30 Sep 2024
- 2024Training Safe Neural Networks with Global SDP Bounds15 Sep 2024
50 newest of 142 All 142 (JSON)
- 2024Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificatescited by 15
- 2024Hamilton-Jacobi Reachability in Reinforcement Learning: A Surveycited by 12
- 2024Actor-Critic Physics-informed Neural Lyapunov Controlcited by 6
- 2024Safe and Reliable Training of Learning-Based Aerospace Controllerscited by 4
- 2024Mollification Effects of Policy Gradient Methodscited by 2
- 2025Off Policy Lyapunov Stability in Reinforcement Learningcited by 2
- 2025Neural Lyapunov Function Approximation with Self-Supervised Reinforcement Learningcited by 0
- 2025Certifying Stability of Reinforcement Learning Policies using Generalized Lyapunov Functionscited by 0
- 2025A Fast Initialization Method for Neural Network Controllers: A Case Study of Image-based Visual Servoing Control for the multicopter Interceptioncited by 0
- 2025MSACL: Multi-Step Actor-Critic Learning with Lyapunov Certificates for Exponentially Stabilizing Controlcited by 0
- 2026Formal Synthesis of Certifiably Robust Neural Lyapunov-Barrier Certificatescited by 0
- 2026Reinforcement Learning for Control with Probabilistic Stability Guarantee: A Finite-Sample Approachcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Certificate-Guided Evaluation of Reinforcement Learning Generalization30 May 2026
- 2026GIFT: Global stabilisation via Intrinsic Fine Tuning25 Apr 2026
- 2026Reinforcement Learning for Control with Probabilistic Stability Guarantee: A Finite-Sample Approach9 Feb 2026
- 2026Formal Synthesis of Certifiably Robust Neural Lyapunov-Barrier Certificates5 Feb 2026
- 2025MSACL: Multi-Step Actor-Critic Learning with Lyapunov Certificates for Exponentially Stabilizing Control31 Dec 2025
- 2025A Fast Initialization Method for Neural Network Controllers: A Case Study of Image-based Visual Servoing Control for the multicopter Interception23 Sep 2025
- 2025Off Policy Lyapunov Stability in Reinforcement Learning11 Sep 2025
- 2025Certifying Stability of Reinforcement Learning Policies using Generalized Lyapunov Functions16 May 2025
- 2025Neural Lyapunov Function Approximation with Self-Supervised Reinforcement Learning19 Mar 2025
- 2024Hamilton-Jacobi Reachability in Reinforcement Learning: A Survey12 Jul 2024
- 2024Safe and Reliable Training of Learning-Based Aerospace Controllers9 Jul 2024
- 2024Mollification Effects of Policy Gradient Methods28 May 2024
12 newest of 14 All 14 (JSON)
- 2021On the Sample Complexity of Stability Constrained Imitation Learningcited by 38
- 2025Dexterous Manipulation through Imitation Learning: A Surveycited by 20
- 2024Globally Stable Neural Imitation Policiescited by 3
- 2026Lyapunov-Guided Self-Alignment: Test-Time Adaptation for Offline Safe Reinforcement Learningcited by 0
- 2026Lyapunov-Guided Self-Alignment: Test-Time Adaptation for Offline Safe Reinforcement Learning29 Apr 2026
- 2025Dexterous Manipulation through Imitation Learning: A Survey4 Apr 2025
- 2024Globally Stable Neural Imitation Policies7 Mar 2024
- 2021On the Sample Complexity of Stability Constrained Imitation Learning18 Feb 2021
- 2025Systems Security Foundations for Agentic Computingcited by 12
- 2025Systems Security Foundations for Agentic Computing1 Dec 2025
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2022Enforcing Hard Constraints with Soft Barriers: Safe Reinforcement Learning in Unknown Stochastic Environmentscited by 54
- 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 43
- 2021Contraction Theory for Nonlinear Stability Analysis and Learning-based Control: A Tutorial Overviewcited by 42
- 2022Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guaranteescited by 40
- 2021Adaptive-Control-Oriented Meta-Learning for Nonlinear Systemscited by 38
- 2023Iterative Reachability Estimation for Safe Reinforcement Learningcited by 35
- 2021Enforcing Policy Feasibility Constraints through Differentiable Projection for Energy Optimizationcited by 31
- 2022Lyapunov Density Models: Constraining Distribution Shift in Learning-Based Controlcited by 28
- 2022Safe Control Under Input Limits with Neural Control Barrier Functionscited by 27
- 2021Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learningcited by 25
- 2021Stability Verification in Stochastic Control Systems via Neural Network Supermartingalescited by 24
12 most cited of 115 All 115 (JSON)
- 2026Learning Provable Neural Network Observer for Uncertain Dynamical Systems25 Sep 2026
- 2026Bridging Control with Neural Network Verifier alpha-beta-CROWN: A Tutorial26 May 2026
- 2026Adaptive Data Harvesting for Efficient Neural Network Learning with Universal Constraints10 May 2026
- 2026Learned Lyapunov Shielding for Adaptive Control7 May 2026
- 2026Set-Based Training of Neural Barrier Certificates for Safety Verification of Dynamical Systems4 May 2026
- 2026Co-Learning Port-Hamiltonian Systems and Optimal Energy-Shaping Control28 Apr 2026
- 2026Verifiable Error Bounds for Physics-Informed Neural Network Solutions of Lyapunov and Hamilton-Jacobi-Bellman Equations20 Mar 2026
- 2026Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees19 Mar 2026
- 2026Functorial Neural Architectures from Higher Inductive Types17 Mar 2026
- 2026Discovering Data Manifold Geometry through Geometric Properties2 Feb 2026
- 2025The Silence that Speaks: Neural Estimation via Communication Gaps30 Nov 2025
- 2025Lyapunov Stability Learning with Nonlinear Control via Inductive Biases3 Nov 2025
12 newest of 115 All 115 (JSON)