Enumerating Safe Regions in Deep Neural Networks with Provable Probabilistic Guarantees
Not on the map. Why?
Abstract (arXiv)
Identifying safe areas is a key point to guarantee trust for systems that are based on Deep Neural Networks (DNNs). To this end, we introduce the AllDNN-Verification problem: given a safety property and a DNN, enumerate the set of all the regions of the property input domain which are safe, i.e., where the property does hold. Due to the #P-hardness of the problem, we propose an efficient approximation method called epsilon-ProVe. Our approach exploits a controllable underestimation of the output reachable sets obtained via statistical prediction of tolerance limits, and can provide a tight (with provable probabilistic guarantees) lower estimate of the safe areas. Our empirical evaluation on different standard benchmarks shows the scalability and effectiveness of our method, offering valuable insights for this new type of verification of DNNs.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 18 Aug 2023.
Builds on
19 of 30 references.
References · 19
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2013Intriguing properties of neural networkscited by 5,155
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 744
- 2015An Introduction to Convolutional Neural Networkscited by 514
- 2021Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Robustness Verificationcited by 228
- 2019Algorithms for Verifying Deep Neural Networkscited by 221
- 2018Formal Security Analysis of Neural Networks using Symbolic Intervalscited by 185
- 2018Efficient Formal Safety Analysis of Neural Networkscited by 165
- 2022General Cutting Planes for Bound-Propagation-Based Neural Network Verificationcited by 103
- 2021The Second International Verification of Neural Networks Competition (VNN-COMP 2021): Summary and Resultscited by 71
- 2019Quantitative Verification of Neural Networks And its Security Applicationscited by 56
7 more
- 2022Verifying Learning-Based Robotic Navigation Systemscited by 33
- 2021Neural Network Repair with Reachability Analysiscited by 19
- 2023The #DNN-Verification Problem: Counting Unsafe Inputs for Deep Neural Networkscited by 19
- 2021Curriculum Learning for Safe Mapless Navigationcited by 11
- 2023Safe Deep Reinforcement Learning by Verifying Task-Level Propertiescited by 9
- 2023Constrained Reinforcement Learning and Formal Verification for Safe Colonoscopy Navigationcited by 9
- 2023Online Safety Property Collection and Refinement for Safe Deep Reinforcement Learning in Mapless Navigationcited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 7; 2025: 8; 2026: 3.
19 papers.
Sort:
By area:
- 2024Verification-Guided Shielding for Deep Reinforcement Learningcited by 13
- 2024Analyzing Adversarial Inputs in Deep Reinforcement Learningcited by 7
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networkscited by 7
- 2024Rigorous Probabilistic Guarantees for Robust Counterfactual Explanationscited by 6
- 2024Improving Policy Optimization via varepsilon-Retraincited by 5
- 2024Solving Probabilistic Verification Problems of Neural Networks using Branch and Boundcited by 4
- 2025Advancing Neural Network Verification through Hierarchical Safety Abstract Interpretationcited by 4
- 2025Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigationcited by 3
- 2025Probabilistic Robustness Analysis in High Dimensional Space: Application to Semantic Segmentation Networkcited by 3
- 2025On the Probabilistic Learnability of Compact Neural Network Preimage Boundscited by 3
- 2025Inductive Learning of Robot Task Knowledge from Raw Data and Online Expert Feedbackcited by 2
- 2025Probabilistically Tightened Linear Relaxation-based Perturbation Analysis for Neural Network Verificationcited by 2
7 more
- 2023Scaling #DNN-Verification Tools with Efficient Bound Propagation and Parallel Computingcited by 1
- 2024LEVIS: Large Exact Verifiable Input Spaces for Neural Networkscited by 1
- 2025Formal Verification of Variational Quantum Circuitscited by 1
- 2025BaB-prob: Branch and Bound with Preactivation Splitting for Probabilistic Verification of Neural Networkscited by 0
- 2026Probabilistic Verification of Recurrent Neural Networks for Single and Multi-Agent Reinforcement Learningcited by 0
- 2026Verifiable Foundation Models for Robot Safetycited by 0
- 2026A Survey on the Verification of Reinforcement Learning Policiescited by 0
- 2026Verifiable Foundation Models for Robot Safety22 Jun 2026
- 2026A Survey on the Verification of Reinforcement Learning Policies14 May 2026
- 2026Probabilistic Verification of Recurrent Neural Networks for Single and Multi-Agent Reinforcement Learning14 May 2026
- 2025On the Probabilistic Learnability of Compact Neural Network Preimage Bounds10 Nov 2025
- 2025BaB-prob: Branch and Bound with Preactivation Splitting for Probabilistic Verification of Neural Networks30 Sep 2025
- 2025Probabilistic Robustness Analysis in High Dimensional Space: Application to Semantic Segmentation Network15 Sep 2025
- 2025Formal Verification of Variational Quantum Circuits14 Jul 2025
- 2025Probabilistically Tightened Linear Relaxation-based Perturbation Analysis for Neural Network Verification7 Jul 2025
- 2025Advancing Neural Network Verification through Hierarchical Safety Abstract Interpretation8 May 2025
- 2025Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigation30 Apr 2025
- 2025Inductive Learning of Robot Task Knowledge from Raw Data and Online Expert Feedback13 Jan 2025
- 2024LEVIS: Large Exact Verifiable Input Spaces for Neural Networks16 Aug 2024
7 more
- 2024Rigorous Probabilistic Guarantees for Robust Counterfactual Explanations10 Jul 2024
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networks30 Jun 2024
- 2024Improving Policy Optimization via varepsilon-Retrain12 Jun 2024
- 2024Verification-Guided Shielding for Deep Reinforcement Learning10 Jun 2024
- 2024Solving Probabilistic Verification Problems of Neural Networks using Branch and Bound27 May 2024
- 2024Analyzing Adversarial Inputs in Deep Reinforcement Learning7 Feb 2024
- 2023Scaling #DNN-Verification Tools with Efficient Bound Propagation and Parallel Computing10 Dec 2023
- 2024Verification-Guided Shielding for Deep Reinforcement Learningcited by 13
- 2024Analyzing Adversarial Inputs in Deep Reinforcement Learningcited by 7
- 2025Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigationcited by 3
- 2026A Survey on the Verification of Reinforcement Learning Policiescited by 0
- 2026A Survey on the Verification of Reinforcement Learning Policies14 May 2026
- 2025Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigation30 Apr 2025
- 2024Verification-Guided Shielding for Deep Reinforcement Learning10 Jun 2024
- 2024Analyzing Adversarial Inputs in Deep Reinforcement Learning7 Feb 2024
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networkscited by 7
- 2024Rigorous Probabilistic Guarantees for Robust Counterfactual Explanationscited by 6
- 2024Improving Policy Optimization via varepsilon-Retraincited by 5
- 2024Solving Probabilistic Verification Problems of Neural Networks using Branch and Boundcited by 4
- 2025Advancing Neural Network Verification through Hierarchical Safety Abstract Interpretationcited by 4
- 2025Probabilistic Robustness Analysis in High Dimensional Space: Application to Semantic Segmentation Networkcited by 3
- 2025On the Probabilistic Learnability of Compact Neural Network Preimage Boundscited by 3
- 2025Inductive Learning of Robot Task Knowledge from Raw Data and Online Expert Feedbackcited by 2
- 2025Probabilistically Tightened Linear Relaxation-based Perturbation Analysis for Neural Network Verificationcited by 2
- 2023Scaling #DNN-Verification Tools with Efficient Bound Propagation and Parallel Computingcited by 1
- 2024LEVIS: Large Exact Verifiable Input Spaces for Neural Networkscited by 1
- 2025Formal Verification of Variational Quantum Circuitscited by 1
12 most cited of 15 All 15 (JSON)
- 2026Verifiable Foundation Models for Robot Safety22 Jun 2026
- 2026Probabilistic Verification of Recurrent Neural Networks for Single and Multi-Agent Reinforcement Learning14 May 2026
- 2025On the Probabilistic Learnability of Compact Neural Network Preimage Bounds10 Nov 2025
- 2025BaB-prob: Branch and Bound with Preactivation Splitting for Probabilistic Verification of Neural Networks30 Sep 2025
- 2025Probabilistic Robustness Analysis in High Dimensional Space: Application to Semantic Segmentation Network15 Sep 2025
- 2025Formal Verification of Variational Quantum Circuits14 Jul 2025
- 2025Probabilistically Tightened Linear Relaxation-based Perturbation Analysis for Neural Network Verification7 Jul 2025
- 2025Advancing Neural Network Verification through Hierarchical Safety Abstract Interpretation8 May 2025
- 2025Inductive Learning of Robot Task Knowledge from Raw Data and Online Expert Feedback13 Jan 2025
- 2024LEVIS: Large Exact Verifiable Input Spaces for Neural Networks16 Aug 2024
- 2024Rigorous Probabilistic Guarantees for Robust Counterfactual Explanations10 Jul 2024
- 2024ModelVerification.jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networks30 Jun 2024
12 newest of 15 All 15 (JSON)