ShieldNN: A Provably Safe NN Filter for Unsafe NN Controllers
Not on the map. Why?
Abstract (arXiv)
In this paper, we develop a novel closed-form Control Barrier Function (CBF) and associated controller shield for the Kinematic Bicycle Model (KBM) with respect to obstacle avoidance. The proposed CBF and shield -- designed by an algorithm we call ShieldNN -- provide two crucial advantages over existing methodologies. First, ShieldNN considers steering and velocity constraints directly with the non-affine KBM dynamics; this is in contrast to more general methods, which typically consider only affine dynamics and do not guarantee invariance properties under control constraints. Second, ShieldNN provides a closed-form set of safe controls for each state unlike more general methods, which typically rely on optimization algorithms to generate a single instantaneous for each state. Together, these advantages make ShieldNN uniquely suited as an efficient Multi-Obstacle Safe Actions (i.e. multiple-barrier-function shielding) during training time of a Reinforcement Learning (RL) enabled Neural Network controller. We show via experiments that ShieldNN dramatically increases the completion rate of RL training episodes in the presence of multiple obstacles, thus establishing the value of ShieldNN in training RL-based controllers.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 2; 2023: 6; 2024: 5.
17 papers.
Sort:
By area:
- 2023SafeDiffuser: Safe Planning with Diffusion Probabilistic Modelscited by 69
- 2023State-wise Safe Reinforcement Learning: A Surveycited by 48
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrationscited by 19
- 2023AutoCost: Evolving Intrinsic Cost for Zero-violation Reinforcement Learningcited by 16
- 2021Learning Robust Hybrid Control Barrier Functions for Uncertain Systemscited by 14
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagationcited by 12
- 2021BarrierNet: A Safety-Guaranteed Layer for Neural Networkscited by 11
- 2022Differentiable Control Barrier Functions for Vision-based End-to-End Autonomous Drivingcited by 10
- 2022On the Forward Invariance of Neural ODEscited by 10
- 2021Provably Correct Training of Neural Network Controllers Using Reachability Analysiscited by 5
- 2024Implicit Safe Set Algorithm for Provably Safe Reinforcement Learningcited by 3
- 2023ConBaT: Control Barrier Transformer for Safe Policy Learningcited by 2
5 more
- 2023EnergyShield: Provably-Safe Offloading of Neural Network Controllers for Energy Efficiencycited by 1
- 2024Savvy: Trustworthy Autonomous Vehicles Architecturecited by 1
- 2023SEO: Safety-Aware Energy Optimization Framework for Multi-Sensor Neural Controllers at the Edgecited by 0
- 2024ABNet: Attention BarrierNet for Safe and Scalable Robot Learningcited by 0
- 2024Absolute State-wise Constrained Policy Optimization: High-Probability State-wise Constraints Satisfactioncited by 0
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagation4 Oct 2024
- 2024Absolute State-wise Constrained Policy Optimization: High-Probability State-wise Constraints Satisfaction2 Oct 2024
- 2024ABNet: Attention BarrierNet for Safe and Scalable Robot Learning18 Jun 2024
- 2024Implicit Safe Set Algorithm for Provably Safe Reinforcement Learning4 May 2024
- 2024Savvy: Trustworthy Autonomous Vehicles Architecture8 Feb 2024
- 2023SafeDiffuser: Safe Planning with Diffusion Probabilistic Models31 May 2023
- 2023ConBaT: Control Barrier Transformer for Safe Policy Learning7 Mar 2023
- 2023SEO: Safety-Aware Energy Optimization Framework for Multi-Sensor Neural Controllers at the Edge24 Feb 2023
- 2023EnergyShield: Provably-Safe Offloading of Neural Network Controllers for Energy Efficiency13 Feb 2023
- 2023State-wise Safe Reinforcement Learning: A Survey6 Feb 2023
- 2023AutoCost: Evolving Intrinsic Cost for Zero-violation Reinforcement Learning24 Jan 2023
- 2022On the Forward Invariance of Neural ODEs10 Oct 2022
5 more
- 2022Differentiable Control Barrier Functions for Vision-based End-to-End Autonomous Driving4 Mar 2022
- 2021BarrierNet: A Safety-Guaranteed Layer for Neural Networks22 Nov 2021
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrations18 Nov 2021
- 2021Provably Correct Training of Neural Network Controllers Using Reachability Analysis22 Feb 2021
- 2021Learning Robust Hybrid Control Barrier Functions for Uncertain Systems16 Jan 2021
- 2023State-wise Safe Reinforcement Learning: A Surveycited by 48
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrationscited by 19
- 2023AutoCost: Evolving Intrinsic Cost for Zero-violation Reinforcement Learningcited by 16
- 2021Learning Robust Hybrid Control Barrier Functions for Uncertain Systemscited by 14
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagationcited by 12
- 2021BarrierNet: A Safety-Guaranteed Layer for Neural Networkscited by 11
- 2022On the Forward Invariance of Neural ODEscited by 10
- 2021Provably Correct Training of Neural Network Controllers Using Reachability Analysiscited by 5
- 2024Implicit Safe Set Algorithm for Provably Safe Reinforcement Learningcited by 3
- 2023ConBaT: Control Barrier Transformer for Safe Policy Learningcited by 2
- 2023EnergyShield: Provably-Safe Offloading of Neural Network Controllers for Energy Efficiencycited by 1
- 2024Savvy: Trustworthy Autonomous Vehicles Architecturecited by 1
12 most cited of 15 All 15 (JSON)
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagation4 Oct 2024
- 2024Absolute State-wise Constrained Policy Optimization: High-Probability State-wise Constraints Satisfaction2 Oct 2024
- 2024ABNet: Attention BarrierNet for Safe and Scalable Robot Learning18 Jun 2024
- 2024Implicit Safe Set Algorithm for Provably Safe Reinforcement Learning4 May 2024
- 2024Savvy: Trustworthy Autonomous Vehicles Architecture8 Feb 2024
- 2023ConBaT: Control Barrier Transformer for Safe Policy Learning7 Mar 2023
- 2023SEO: Safety-Aware Energy Optimization Framework for Multi-Sensor Neural Controllers at the Edge24 Feb 2023
- 2023EnergyShield: Provably-Safe Offloading of Neural Network Controllers for Energy Efficiency13 Feb 2023
- 2023State-wise Safe Reinforcement Learning: A Survey6 Feb 2023
- 2023AutoCost: Evolving Intrinsic Cost for Zero-violation Reinforcement Learning24 Jan 2023
- 2022On the Forward Invariance of Neural ODEs10 Oct 2022
- 2021BarrierNet: A Safety-Guaranteed Layer for Neural Networks22 Nov 2021
12 newest of 15 All 15 (JSON)