Reachable Set Computation and Safety Verification for Neural Networks with ReLU Activations
Not on the map. Why?
Abstract (arXiv)
Neural networks have been widely used to solve complex real-world problems. Due to the complicate, nonlinear, non-convex nature of neural networks, formal safety guarantees for the output behaviors of neural networks will be crucial for their applications in safety-critical systems.In this paper, the output reachable set computation and safety verification problems for a class of neural networks consisting of Rectified Linear Unit (ReLU) activation functions are addressed. A layer-by-layer approach is developed to compute output reachable set. The computation is formulated in the form of a set of manipulations for a union of polyhedra, which can be efficiently applied with the aid of polyhedron computation tools. Based on the output reachable set computation results, the safety verification for a ReLU neural network can be performed by checking the intersections of unsafe regions and output reachable set described by a union of polyhedra. A numerical example of a randomly generated ReLU neural network is provided to show the effectiveness of the approach developed in this paper.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 5; 2024: 2; 2025: 1; 2026: 1.
22 papers.
Sort:
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 42
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021Neural Network Repair with Reachability Analysiscited by 19
- 2022CertiFair: A Framework for Certified Global Fairness of Neural Networkscited by 17
- 2021Traversing the Local Polytopes of ReLU Neural Networks: A Unified Approach for Network Verificationcited by 13
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networkscited by 11
- 2021SyReNN: A Tool for Analyzing Deep Neural Networkscited by 10
- 2021Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigationcited by 10
- 2021Fast BATLLNN: Fast Box Analysis of Two-Level Lattice Neural Networkscited by 8
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networkscited by 7
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systemscited by 6
- 2022Safety Verification for Neural Networks Based on Set-boundary Analysiscited by 5
10 more
- 2022BERN-NN: Tight Bound Propagation For Neural Networks Using Bernstein Polynomial Interval Arithmeticcited by 5
- 2021Reachability Analysis of Convolutional Neural Networkscited by 4
- 2023Safety Verification of Neural Network Control Systems Using Guaranteed Neural Network Model Reductioncited by 2
- 2021Robust Optimization Framework for Training Shallow Neural Networks Using Reachability Methodcited by 1
- 2023Vertex-based reachability analysis for verifying ReLU deep neural networkscited by 1
- 2023Verifying Safety of Neural Networks from Topological Perspectivescited by 1
- 2022Work In Progress: Safety and Robustness Verification of Autoencoder-Based Regression Models using the NNV Toolcited by 0
- 2024UR4NNV: Neural Network Verification, Under-approximation Reachability Works!cited by 0
- 2025Lipschitz-Based Robustness Certification for Recurrent Neural Networks via Convex Relaxationcited by 0
- 2026Exact and Asymptotically Complete Robust Verifications of Neural Networks via Ising Solverscited by 0
- 2026Exact and Asymptotically Complete Robust Verifications of Neural Networks via Ising Solvers28 Feb 2026
- 2025Lipschitz-Based Robustness Certification for Recurrent Neural Networks via Convex Relaxation22 Sep 2025
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networks30 Jun 2024
- 2024UR4NNV: Neural Network Verification, Under-approximation Reachability Works!23 Jan 2024
- 2023Verifying Safety of Neural Networks from Topological Perspectives27 Jun 2023
- 2023When Deep Learning Meets Polyhedral Theory: A Survey29 Apr 2023
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networks29 Jan 2023
- 2023Vertex-based reachability analysis for verifying ReLU deep neural networks27 Jan 2023
- 2023Safety Verification of Neural Network Control Systems Using Guaranteed Neural Network Model Reduction17 Jan 2023
- 2022BERN-NN: Tight Bound Propagation For Neural Networks Using Bernstein Polynomial Interval Arithmetic22 Nov 2022
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systems15 Oct 2022
- 2022Safety Verification for Neural Networks Based on Set-boundary Analysis9 Oct 2022
10 more
- 2022Work In Progress: Safety and Robustness Verification of Autoencoder-Based Regression Models using the NNV Tool14 Jul 2022
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective24 Jun 2022
- 2022CertiFair: A Framework for Certified Global Fairness of Neural Networks20 May 2022
- 2021Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigation16 Dec 2021
- 2021Fast BATLLNN: Fast Box Analysis of Two-Level Lattice Neural Networks17 Nov 2021
- 2021Traversing the Local Polytopes of ReLU Neural Networks: A Unified Approach for Network Verification17 Nov 2021
- 2021Neural Network Repair with Reachability Analysis9 Aug 2021
- 2021Robust Optimization Framework for Training Shallow Neural Networks Using Reachability Method27 Jul 2021
- 2021Reachability Analysis of Convolutional Neural Networks22 Jun 2021
- 2021SyReNN: A Tool for Analyzing Deep Neural Networks9 Jan 2021
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 42
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021Neural Network Repair with Reachability Analysiscited by 19
- 2022CertiFair: A Framework for Certified Global Fairness of Neural Networkscited by 17
- 2021Traversing the Local Polytopes of ReLU Neural Networks: A Unified Approach for Network Verificationcited by 13
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networkscited by 11
- 2021SyReNN: A Tool for Analyzing Deep Neural Networkscited by 10
- 2021Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigationcited by 10
- 2021Fast BATLLNN: Fast Box Analysis of Two-Level Lattice Neural Networkscited by 8
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networkscited by 7
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systemscited by 6
- 2022Safety Verification for Neural Networks Based on Set-boundary Analysiscited by 5
12 most cited of 22 All 22 (JSON)
- 2026Exact and Asymptotically Complete Robust Verifications of Neural Networks via Ising Solvers28 Feb 2026
- 2025Lipschitz-Based Robustness Certification for Recurrent Neural Networks via Convex Relaxation22 Sep 2025
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networks30 Jun 2024
- 2024UR4NNV: Neural Network Verification, Under-approximation Reachability Works!23 Jan 2024
- 2023Verifying Safety of Neural Networks from Topological Perspectives27 Jun 2023
- 2023When Deep Learning Meets Polyhedral Theory: A Survey29 Apr 2023
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networks29 Jan 2023
- 2023Vertex-based reachability analysis for verifying ReLU deep neural networks27 Jan 2023
- 2023Safety Verification of Neural Network Control Systems Using Guaranteed Neural Network Model Reduction17 Jan 2023
- 2022BERN-NN: Tight Bound Propagation For Neural Networks Using Bernstein Polynomial Interval Arithmetic22 Nov 2022
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systems15 Oct 2022
- 2022Safety Verification for Neural Networks Based on Set-boundary Analysis9 Oct 2022
12 newest of 22 All 22 (JSON)