Neural Certificates for Safe Control Policies
Not on the map. Why?
Abstract (arXiv)
This paper develops an approach to learn a policy of a dynamical system that is guaranteed to be both provably safe and goal-reaching. Here, the safety means that a policy must not drive the state of the system to any unsafe region, while the goal-reaching requires the trajectory of the controlled system asymptotically converges to a goal region (a generalization of stability). We obtain the safe and goal-reaching policy by jointly learning two additional certificate functions: a barrier function that guarantees the safety and a developed Lyapunov-like function to fulfill the goal-reaching requirement, both of which are represented by neural networks. We show the effectiveness of the method to learn both safe and goal-reaching policies on various systems, including pendulums, cart-poles, and UAVs.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 12; 2023: 8; 2024: 7; 2025: 1.
35 papers.
Sort:
By area:
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspectivecited by 34
- 2021Safe Pontryagin Differentiable Programmingcited by 25
- 2021Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learningcited by 25
- 2024Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulationcited by 23
- 2022Safety Certification for Stochastic Systems via Neural Barrier Functionscited by 22
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guaranteescited by 21
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrationscited by 19
- 2023In-Distribution Barrier Functions: Self-Supervised Policy Filters that Avoid Out-of-Distribution Statescited by 15
- 2021Learning Robust Hybrid Control Barrier Functions for Uncertain Systemscited by 14
- 2021BarrierNet: A Safety-Guaranteed Layer for Neural Networkscited by 11
- 2022Neural Koopman Lyapunov Controlcited by 11
23 more
- 2022Joint Differentiable Optimization and Verification for Certified Reinforcement Learningcited by 11
- 2022Differentiable Control Barrier Functions for Vision-based End-to-End Autonomous Drivingcited by 10
- 2022On the Forward Invariance of Neural ODEscited by 10
- 2023Reinforcement Learning for Safe Robot Control using Control Lyapunov Barrier Functionscited by 9
- 2023Sequential Neural Barriers for Scalable Dynamic Obstacle Avoidancecited by 8
- 2024Verification-Aided Learning of Neural Network Barrier Functions with Termination Guaranteescited by 7
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systemscited by 6
- 2023A General Framework for Verification and Control of Dynamical Models via Certificate Synthesiscited by 6
- 2024Actor-Critic Physics-informed Neural Lyapunov Controlcited by 6
- 2022KCRL: Krasovskii-Constrained Reinforcement Learning with Guaranteed Stability in Nonlinear Dynamical Systemscited by 5
- 2024Safe Reach Set Computation via Neural Barrier Certificatescited by 5
- 2022Learning Provably Stabilizing Neural Controllers for Discrete-Time Stochastic Systemscited by 4
- 2022FI-ODE: Certifiably Robust Forward Invariance in Neural ODEscited by 3
- 2024Certified Training with Branch-and-Bound for Lyapunov-stable Neural Controlcited by 3
- 2021Adversarially Robust Stability Certificates can be Sample-Efficientcited by 2
- 2022Recursively Feasible Probabilistic Safe Online Learning with Control Barrier Functionscited by 2
- 2023Meta-Learning-Based Adaptive Stability Certificates for Dynamical Systemscited by 2
- 2024Transfer of Safety Controllers Through Learning Deep Inverse Dynamics Modelcited by 1
- 2025Safe Online Control-Informed Learningcited by 1
- 2022Revisiting PGD Attacks for Stability Analysis of Large-Scale Nonlinear Systems and Perception-Based Controlcited by 0
- 2023A Policy Optimization Method Towards Optimal-time Stabilitycited by 0
- 2023Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Dockingcited by 0
- 2024Structured Deep Neural Network-Based Backstepping Trajectory Tracking Control for Lagrangian Systemscited by 0
- 2025Safe Online Control-Informed Learning15 Dec 2025
- 2024Certified Training with Branch-and-Bound for Lyapunov-stable Neural Control27 Nov 2024
- 2024Transfer of Safety Controllers Through Learning Deep Inverse Dynamics Model22 May 2024
- 2024Safe Reach Set Computation via Neural Barrier Certificates29 Apr 2024
- 2024Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulation11 Apr 2024
- 2024Actor-Critic Physics-informed Neural Lyapunov Control13 Mar 2024
- 2024Verification-Aided Learning of Neural Network Barrier Functions with Termination Guarantees12 Mar 2024
- 2024Structured Deep Neural Network-Based Backstepping Trajectory Tracking Control for Lagrangian Systems1 Mar 2024
- 2023Meta-Learning-Based Adaptive Stability Certificates for Dynamical Systems23 Dec 2023
- 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspective28 Nov 2023
- 2023Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Docking7 Nov 2023
- 2023A General Framework for Verification and Control of Dynamical Models via Certificate Synthesis12 Sep 2023
23 more
- 2023Sequential Neural Barriers for Scalable Dynamic Obstacle Avoidance6 Jul 2023
- 2023Reinforcement Learning for Safe Robot Control using Control Lyapunov Barrier Functions16 May 2023
- 2023In-Distribution Barrier Functions: Self-Supervised Policy Filters that Avoid Out-of-Distribution States27 Jan 2023
- 2023A Policy Optimization Method Towards Optimal-time Stability2 Jan 2023
- 2022FI-ODE: Certifiably Robust Forward Invariance in Neural ODEs30 Oct 2022
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systems15 Oct 2022
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guarantees11 Oct 2022
- 2022Learning Provably Stabilizing Neural Controllers for Discrete-Time Stochastic Systems11 Oct 2022
- 2022On the Forward Invariance of Neural ODEs10 Oct 2022
- 2022Recursively Feasible Probabilistic Safe Online Learning with Control Barrier Functions23 Aug 2022
- 2022KCRL: Krasovskii-Constrained Reinforcement Learning with Guaranteed Stability in Nonlinear Dynamical Systems3 Jun 2022
- 2022Safety Certification for Stochastic Systems via Neural Barrier Functions3 Jun 2022
- 2022Differentiable Control Barrier Functions for Vision-based End-to-End Autonomous Driving4 Mar 2022
- 2022Joint Differentiable Optimization and Verification for Certified Reinforcement Learning28 Jan 2022
- 2022Neural Koopman Lyapunov Control13 Jan 2022
- 2022Revisiting PGD Attacks for Stability Analysis of Large-Scale Nonlinear Systems and Perception-Based Control3 Jan 2022
- 2021Adversarially Robust Stability Certificates can be Sample-Efficient20 Dec 2021
- 2021BarrierNet: A Safety-Guaranteed Layer for Neural Networks22 Nov 2021
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrations18 Nov 2021
- 2021Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learning15 Nov 2021
- 2021Safe Pontryagin Differentiable Programming31 May 2021
- 2021Learning Robust Hybrid Control Barrier Functions for Uncertain Systems16 Jan 2021
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificates14 Jan 2021
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2021Safe Pontryagin Differentiable Programmingcited by 25
- 2021Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learningcited by 25
- 2024Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulationcited by 23
- 2022Safety Certification for Stochastic Systems via Neural Barrier Functionscited by 22
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guaranteescited by 21
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrationscited by 19
- 2023In-Distribution Barrier Functions: Self-Supervised Policy Filters that Avoid Out-of-Distribution Statescited by 15
- 2021Learning Robust Hybrid Control Barrier Functions for Uncertain Systemscited by 14
- 2021BarrierNet: A Safety-Guaranteed Layer for Neural Networkscited by 11
- 2022Neural Koopman Lyapunov Controlcited by 11
- 2022Joint Differentiable Optimization and Verification for Certified Reinforcement Learningcited by 11
12 most cited of 33 All 33 (JSON)
- 2025Safe Online Control-Informed Learning15 Dec 2025
- 2024Certified Training with Branch-and-Bound for Lyapunov-stable Neural Control27 Nov 2024
- 2024Transfer of Safety Controllers Through Learning Deep Inverse Dynamics Model22 May 2024
- 2024Safe Reach Set Computation via Neural Barrier Certificates29 Apr 2024
- 2024Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulation11 Apr 2024
- 2024Actor-Critic Physics-informed Neural Lyapunov Control13 Mar 2024
- 2024Verification-Aided Learning of Neural Network Barrier Functions with Termination Guarantees12 Mar 2024
- 2024Structured Deep Neural Network-Based Backstepping Trajectory Tracking Control for Lagrangian Systems1 Mar 2024
- 2023Meta-Learning-Based Adaptive Stability Certificates for Dynamical Systems23 Dec 2023
- 2023Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Docking7 Nov 2023
- 2023A General Framework for Verification and Control of Dynamical Models via Certificate Synthesis12 Sep 2023
- 2023Sequential Neural Barriers for Scalable Dynamic Obstacle Avoidance6 Jul 2023
12 newest of 33 All 33 (JSON)