Safe Control with Neural Network Dynamic Models
Not on the map. Why?
Abstract (arXiv)
Safety is critical in autonomous robotic systems. A safe control law ensures forward invariance of a safe set (a subset in the state space). It has been extensively studied regarding how to derive a safe control law with a control-affine analytical dynamic model. However, in complex environments and tasks, it is challenging and time-consuming to obtain a principled analytical model of the system. In these situations, data-driven learning is extensively used and the learned models are encoded in neural networks. How to formally derive a safe control law with Neural Network Dynamic Models (NNDM) remains unclear due to the lack of computationally tractable methods to deal with these black-box functions. In fact, even finding the control that minimizes an objective for NNDM without any safety constraint is still challenging. In this work, we propose MIND-SIS (Mixed Integer for Neural network Dynamic model with Safety Index Synthesis), the first method to derive safe control laws for NNDM. The method includes two parts: 1) SIS: an algorithm for the offline synthesis of the safety index (also called as barrier function), which uses evolutionary methods and 2) MIND: an algorithm for online computation of the optimal and safe control signal, which solves a constrained optimization using a computationally efficient encoding of neural networks. It has been theoretically proved that MIND-SIS guarantees forward invariance and finite convergence. And it has been numerically validated that MIND-SIS achieves safe and optimal control of NNDM. From our experiments, the optimality gap is less than 10-8, and the safety constraint violation is 0.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 16 of its 36 references that are in the map. First posted on arXiv 3 Oct 2021.
Builds on
16 of 36 references.
References · 16
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 564
- 2016The CMA Evolution Strategy: A Tutorialcited by 364
- 2019Control Barrier Functions: Theory and Applicationscited by 332
- 2017Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuningcited by 288
- 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 261
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 241
- 2019Algorithms for Verifying Deep Neural Networkscited by 221
- 2017Hamilton-Jacobi Reachability: A Brief Overview and Recent Advancescited by 186
- 2018Semidefinite relaxations for certifying robustness to adversarial examplescited by 178
- 2017An approach to reachability analysis for feed-forward ReLU neural networkscited by 126
- 2018A Dual Approach to Scalable Verification of Deep Networkscited by 125
4 more
- 2020Enabling certification of verification-agnostic networks via memory-efficient semidefinite programmingcited by 65
- 2019Safe Control Algorithms Using Energy Functions: A Unified Framework, Benchmark, and New Directionscited by 17
- 2017The Convex Feasible Set Algorithm for Real Time Optimization in Motion Planningcited by 7
- 2017Path Planning using Positive Invariant Setscited by 3
Built on by
Citing papers per year: 2022: 2; 2023: 7; 2024: 7; 2025: 4; 2026: 1.
21 papers.
Sort:
By area:
- 2023State-wise Safe Reinforcement Learning: A Surveycited by 48
- 2022Safe Control Under Input Limits with Neural Control Barrier Functionscited by 27
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attackscited by 20
- 2023Model-Based Control with Sparse Neural Dynamicscited by 16
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagationcited by 12
- 2023Adversarial Robustness Certification for Bayesian Neural Networkscited by 7
- 2024Verified Safe Reinforcement Learning for Neural Network Dynamic Modelscited by 7
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networkscited by 7
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systemscited by 6
- 2023System-level Safety Guard: Safe Tracking Control through Uncertain Neural Network Dynamics Modelscited by 5
- 2024Real-Time Safe Control of Neural Network Dynamic Models with Sound Approximationcited by 5
- 2023Promises of Deep Kernel Learning for Control Synthesiscited by 4
9 more
- 2023Probabilistic Reach-Avoid for Bayesian Neural Networkscited by 4
- 2023Efficient Certified Training and Robustness Verification of Neural ODEscited by 3
- 2024Meta-Control: Automatic Model-based Control Synthesis for Heterogeneous Robot Skillscited by 2
- 2024Myopically Verifiable Probabilistic Certificates for Safe Control and Learningcited by 1
- 2025ECLipsE-Gen-Local: Efficient Compositional Local Lipschitz Estimates for Deep Neural Networkscited by 1
- 2026Dyna-Style Safety Augmented Reinforcement Learning: Staying Safe in the Face of Uncertaintycited by 1
- 2024Efficient model predictive control for nonlinear systems modelled by deep neural networkscited by 0
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functionscited by 0
- 2025Control Invariant Sets for Neural Network Dynamical Systems and Recursive Feasibility in Model Predictive Controlcited by 0
- 2026Dyna-Style Safety Augmented Reinforcement Learning: Staying Safe in the Face of Uncertainty28 Apr 2026
- 2025ECLipsE-Gen-Local: Efficient Compositional Local Lipschitz Estimates for Deep Neural Networks6 Oct 2025
- 2025Control Invariant Sets for Neural Network Dynamical Systems and Recursive Feasibility in Model Predictive Control15 May 2025
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks28 Feb 2025
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functions20 Feb 2025
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagation4 Oct 2024
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networks30 Jun 2024
- 2024Verified Safe Reinforcement Learning for Neural Network Dynamic Models25 May 2024
- 2024Meta-Control: Automatic Model-based Control Synthesis for Heterogeneous Robot Skills18 May 2024
- 2024Efficient model predictive control for nonlinear systems modelled by deep neural networks16 May 2024
- 2024Myopically Verifiable Probabilistic Certificates for Safe Control and Learning23 Apr 2024
- 2024Real-Time Safe Control of Neural Network Dynamic Models with Sound Approximation20 Apr 2024
9 more
- 2023Model-Based Control with Sparse Neural Dynamics20 Dec 2023
- 2023System-level Safety Guard: Safe Tracking Control through Uncertain Neural Network Dynamics Models11 Dec 2023
- 2023Probabilistic Reach-Avoid for Bayesian Neural Networks3 Oct 2023
- 2023Promises of Deep Kernel Learning for Control Synthesis12 Sep 2023
- 2023Adversarial Robustness Certification for Bayesian Neural Networks23 Jun 2023
- 2023Efficient Certified Training and Robustness Verification of Neural ODEs9 Mar 2023
- 2023State-wise Safe Reinforcement Learning: A Survey6 Feb 2023
- 2022Safe Control Under Input Limits with Neural Control Barrier Functions20 Nov 2022
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systems15 Oct 2022
- 2023State-wise Safe Reinforcement Learning: A Surveycited by 48
- 2022Safe Control Under Input Limits with Neural Control Barrier Functionscited by 27
- 2023Model-Based Control with Sparse Neural Dynamicscited by 16
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagationcited by 12
- 2023Adversarial Robustness Certification for Bayesian Neural Networkscited by 7
- 2024Verified Safe Reinforcement Learning for Neural Network Dynamic Modelscited by 7
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networkscited by 7
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systemscited by 6
- 2023System-level Safety Guard: Safe Tracking Control through Uncertain Neural Network Dynamics Modelscited by 5
- 2024Real-Time Safe Control of Neural Network Dynamic Models with Sound Approximationcited by 5
- 2023Promises of Deep Kernel Learning for Control Synthesiscited by 4
- 2023Probabilistic Reach-Avoid for Bayesian Neural Networkscited by 4
12 most cited of 20 All 20 (JSON)
- 2026Dyna-Style Safety Augmented Reinforcement Learning: Staying Safe in the Face of Uncertainty28 Apr 2026
- 2025ECLipsE-Gen-Local: Efficient Compositional Local Lipschitz Estimates for Deep Neural Networks6 Oct 2025
- 2025Control Invariant Sets for Neural Network Dynamical Systems and Recursive Feasibility in Model Predictive Control15 May 2025
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functions20 Feb 2025
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagation4 Oct 2024
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networks30 Jun 2024
- 2024Verified Safe Reinforcement Learning for Neural Network Dynamic Models25 May 2024
- 2024Meta-Control: Automatic Model-based Control Synthesis for Heterogeneous Robot Skills18 May 2024
- 2024Efficient model predictive control for nonlinear systems modelled by deep neural networks16 May 2024
- 2024Myopically Verifiable Probabilistic Certificates for Safe Control and Learning23 Apr 2024
- 2024Real-Time Safe Control of Neural Network Dynamic Models with Sound Approximation20 Apr 2024
- 2023Model-Based Control with Sparse Neural Dynamics20 Dec 2023
12 newest of 20 All 20 (JSON)