Reachability Analysis of Deep Neural Networks with Provable Guarantees
Not on the map. Why?
Abstract (arXiv)
Verifying correctness of deep neural networks (DNNs) is challenging. We study a generic reachability problem for feed-forward DNNs which, for a given set of inputs to the network and a Lipschitz-continuous function over its outputs, computes the lower and upper bound on the function values. Because the network and the function are Lipschitz continuous, all values in the interval between the lower and upper bound are reachable. We show how to obtain the safety verification problem, the output range analysis problem and a robustness measure by instantiating the reachability problem. We present a novel algorithm based on adaptive nested optimisation to solve the reachability problem. The technique has been implemented and evaluated on a range of DNNs, demonstrating its efficiency, scalability and ability to handle a broader class of networks than state-of-the-art verification approaches.
Key facts. Cited by 93 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 29; 2022: 19; 2023: 19; 2024: 17; 2025: 6; 2026: 3.
93 papers.
Sort:
By area:
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2024Building Guardrails for Large Language Modelscited by 61
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2022A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awarenesscited by 49
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 41
- 2024A review on data-driven constitutive laws for solidscited by 35
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2021Reachability Is NP-Complete Even for the Simplest Neural Networkscited by 27
- 2021DNNV: A Framework for Deep Neural Network Verificationcited by 23
- 2023Training robust and generalizable quantum modelscited by 21
- 2022PRoA: A Probabilistic Robustness Assessment against Functional Perturbationscited by 19
- 2022Verification-Aided Deep Ensemble Selectioncited by 18
38 more
- 2021A Survey on AI Assurancecited by 16
- 2021Attack as Defense: Characterizing Adversarial Examples using Robustnesscited by 14
- 2021Minimal Multi-Layer Modifications of Deep Neural Networkscited by 14
- 2021On Recurrent Neural Networks for learning-based control: recent results and ideas for future developmentscited by 14
- 2023From Robustness to Explainability and Back Againcited by 14
- 2022Reachability Analysis of a General Class of Neural Ordinary Differential Equationscited by 13
- 2023Provable Preimage Under-Approximation for Neural Networks (Full Version)cited by 13
- 2021Towards Practical Robustness Analysis for DNNs based on PAC-Model Learningcited by 12
- 2021Infinite Time Horizon Safety of Bayesian Neural Networkscited by 12
- 2023POLAR-Express: Efficient and Precise Formal Reachability Analysis of Neural-Network Controlled Systemscited by 12
- 2021Sparse Adversarial Video Attacks with Spatial Transformationscited by 11
- 2021On the Impact of Hard Adversarial Instances on Overfitting in Adversarial Trainingcited by 11
- 2021Curriculum Learning for Safe Mapless Navigationcited by 11
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networkscited by 11
- 2023Verifying Generalization in Deep Learningcited by 11
- 2024A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligencecited by 10
- 2024ProTIP: Probabilistic Robustness Verification on Text-to-Image Diffusion Models against Stochastic Perturbationcited by 10
- 2021Analyzing Human Models that Adapt Onlinecited by 8
- 2021ε-weakened Robustness of Deep Neural Networkscited by 8
- 2022Hierarchical Distribution-Aware Testing of Deep Learningcited by 8
- 2022Provably Tightest Linear Approximation for Robustness Verification of Sigmoid-like Neural Networkscited by 8
- 2023Reachability Analysis of Neural Network Control Systemscited by 8
- 2024PREMAP: A Unifying PREiMage APproximation Framework for Neural Networkscited by 8
- 2021A Scalable Two Stage Approach to Computing Optimal Decision Setscited by 7
- 2022Certified Policy Smoothing for Cooperative Multi-Agent Reinforcement Learningcited by 7
- 2021Customizable Reference Runtime Monitoring of Neural Networks using Resolution Boxescited by 6
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systemscited by 6
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systemscited by 6
- 2023Reward Certification for Policy Smoothed Reinforcement Learningcited by 6
- 2024Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systemscited by 6
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Surveycited by 6
- 2025Probabilistic Robustness in Deep Learning: A Concise yet Comprehensive Guidecited by 6
- 2026Embodied Foundation Models at the Edge: A Survey of Deployment Constraints and Mitigation Strategiescited by 6
- 2021Fooling Object Detectors: Adversarial Attacks by Half-Neighbor Maskscited by 5
- 2021Adversarial Robustness Guarantees for Gaussian Processescited by 5
- 2021Static analysis of ReLU neural networks with tropical polyhedracited by 5
- 2021Adversarial Robustness of Deep Learning: Theory, Algorithms, and Applicationscited by 5
- 2022Reachability In Simple Neural Networkscited by 5
50 most cited of 93 All 93 (JSON)
- 2026The Complexity of Verifying Feedforward Neural Networks in Quantised Settings28 May 2026
- 2026Lipschitz Optimization for Formal Verification of Homographies22 May 2026
- 2026Embodied Foundation Models at the Edge: A Survey of Deployment Constraints and Mitigation Strategies16 Mar 2026
- 2025Stable Robot Motions on Manifolds: Learning Lyapunov-Constrained Neural Manifold ODEs7 Oct 2025
- 2025ECLipsE-Gen-Local: Efficient Compositional Local Lipschitz Estimates for Deep Neural Networks6 Oct 2025
- 2025Control Invariant Sets for Neural Network Dynamical Systems and Recursive Feasibility in Model Predictive Control15 May 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025Probabilistic Robustness in Deep Learning: A Concise yet Comprehensive Guide20 Feb 2025
- 2025Scalable and Interpretable Verification of Image-based Neural Network Controllers for Autonomous Vehicles23 Jan 2025
- 2024Using Formal Models, Safety Shields and Certified Control to Validate AI-Based Train Systems21 Nov 2024
- 2024Achieving Domain-Independent Certified Robustness via Knowledge Continuity3 Nov 2024
- 2024Formal Explanations for Neuro-Symbolic AI18 Oct 2024
38 more
- 2024Understanding Human Activity with Uncertainty Measure for Novelty in Graph Convolutional Networks10 Oct 2024
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Survey26 Sep 2024
- 2024A constrained optimization approach to improve robustness of neural networks18 Sep 2024
- 2024PREMAP: A Unifying PREiMage APproximation Framework for Neural Networks17 Aug 2024
- 2024Verifying the Generalization of Deep Learning to Out-of-Distribution Domains4 Jun 2024
- 2024Solving Probabilistic Verification Problems of Neural Networks using Branch and Bound27 May 2024
- 2024A review on data-driven constitutive laws for solids6 May 2024
- 2024A Survey of Neural Network Robustness Assessment in Image Recognition12 Apr 2024
- 2024Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systems2 Apr 2024
- 2024Patch Synthesis for Property Repair of Deep Neural Networks2 Apr 2024
- 2024Robustness Verifcation in Neural Networks20 Mar 2024
- 2024ProTIP: Probabilistic Robustness Verification on Text-to-Image Diffusion Models against Stochastic Perturbation23 Feb 2024
- 2024Building Guardrails for Large Language Models2 Feb 2024
- 2024A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligence6 Jan 2024
- 2023Robustness Verification of Deep Reinforcement Learning Based Control Systems using Reward Martingales15 Dec 2023
- 2023Reward Certification for Policy Smoothed Reinforcement Learning11 Dec 2023
- 2023Training robust and generalizable quantum models20 Nov 2023
- 2023Verified Compositional Neuro-Symbolic Control for Stochastic Systems with Temporal Logic Tasks17 Nov 2023
- 2023Extending Neural Network Verification to a Larger Family of Piece-wise Linear Activation Functions16 Nov 2023
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systems20 Jul 2023
- 2023Verifying Global Neural Network Specifications using Hyperproperties21 Jun 2023
- 2023From Robustness to Explainability and Back Again5 Jun 2023
- 2023Evaluating robustness of support vector machines with the Lagrangian dual approach5 Jun 2023
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation19 May 2023
- 2023Uncertainty Estimation and Out-of-Distribution Detection for Deep Learning-Based Image Reconstruction using the Local Lipschitz12 May 2023
- 2023Provable Preimage Under-Approximation for Neural Networks (Full Version)5 May 2023
- 2023Model-Agnostic Reachability Analysis on Deep Neural Networks3 Apr 2023
- 2023POLAR-Express: Efficient and Precise Formal Reachability Analysis of Neural-Network Controlled Systems31 Mar 2023
- 2023Safe Multi-agent Learning via Trapping Regions27 Feb 2023
- 2023Verifying Generalization in Deep Learning11 Feb 2023
- 2023Incremental Satisfiability Modulo Theory for Verification of Deep Neural Networks10 Feb 2023
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networks29 Jan 2023
- 2023Reachability Analysis of Neural Network Control Systems28 Jan 2023
- 2022Certified Policy Smoothing for Cooperative Multi-Agent Reinforcement Learning22 Dec 2022
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checking10 Dec 2022
- 2022Reachability Verification Based Reliability Assessment for Deep Reinforcement Learning Controlled Robotics and Autonomous Systems26 Oct 2022
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systems15 Oct 2022
- 2022Provably Tightest Linear Approximation for Robustness Verification of Sigmoid-like Neural Networks21 Aug 2022
50 newest of 93 All 93 (JSON)
- 2024Building Guardrails for Large Language Modelscited by 61
- 2024Building Guardrails for Large Language Models2 Feb 2024
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2022A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awarenesscited by 49
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 41
- 2024A review on data-driven constitutive laws for solidscited by 35
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2021Reachability Is NP-Complete Even for the Simplest Neural Networkscited by 27
- 2021DNNV: A Framework for Deep Neural Network Verificationcited by 23
- 2023Training robust and generalizable quantum modelscited by 21
- 2022PRoA: A Probabilistic Robustness Assessment against Functional Perturbationscited by 19
- 2022Verification-Aided Deep Ensemble Selectioncited by 18
- 2021A Survey on AI Assurancecited by 16
12 most cited of 90 All 90 (JSON)
- 2026The Complexity of Verifying Feedforward Neural Networks in Quantised Settings28 May 2026
- 2026Lipschitz Optimization for Formal Verification of Homographies22 May 2026
- 2026Embodied Foundation Models at the Edge: A Survey of Deployment Constraints and Mitigation Strategies16 Mar 2026
- 2025Stable Robot Motions on Manifolds: Learning Lyapunov-Constrained Neural Manifold ODEs7 Oct 2025
- 2025ECLipsE-Gen-Local: Efficient Compositional Local Lipschitz Estimates for Deep Neural Networks6 Oct 2025
- 2025Control Invariant Sets for Neural Network Dynamical Systems and Recursive Feasibility in Model Predictive Control15 May 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025Probabilistic Robustness in Deep Learning: A Concise yet Comprehensive Guide20 Feb 2025
- 2025Scalable and Interpretable Verification of Image-based Neural Network Controllers for Autonomous Vehicles23 Jan 2025
- 2024Using Formal Models, Safety Shields and Certified Control to Validate AI-Based Train Systems21 Nov 2024
- 2024Achieving Domain-Independent Certified Robustness via Knowledge Continuity3 Nov 2024
- 2024Formal Explanations for Neuro-Symbolic AI18 Oct 2024
12 newest of 90 All 90 (JSON)