Algorithms for Verifying Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
Deep neural networks are widely used for nonlinear function approximation with applications ranging from computer vision to control. Although these networks involve the composition of simple arithmetic operations, it can be very challenging to verify whether a particular network satisfies certain input-output properties. This article surveys methods that have emerged recently for soundly verifying such properties. These methods borrow insights from reachability analysis, optimization, and search. We discuss fundamental differences and connections between existing algorithms. In addition, we provide pedagogical implementations of existing methods and compare them on a set of benchmark problems.
Key facts. Cited by 221 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 37; 2022: 41; 2023: 44; 2024: 35; 2025: 39; 2026: 24.
221 papers.
Sort:
By area:
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021The Second International Verification of Neural Networks Competition (VNN-COMP 2021): Summary and Resultscited by 71
- 2023First Three Years of the International Verification of Neural Networks Competition (VNN-COMP)cited by 58
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learningcited by 43
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networkscited by 42
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 41
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021OVERT: An Algorithm for Safety Verification of Neural Network Control Policies for Nonlinear Systemscited by 37
- 2021Neural Network Robustness as a Verification Property: A Principled Case Studycited by 35
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
38 more
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2024HardNet: Hard-Constrained Neural Networks with Universal Approximation Guaranteescited by 29
- 2021Verification of Image-based Neural Network Controllers Using Generative Modelscited by 27
- 2021Verification of Neural-Network Control Systems by Integrating Taylor Models and Zonotopescited by 26
- 2022Efficient Neural Network Analysis with Sum-of-Infeasibilitiescited by 24
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2021DNNV: A Framework for Deep Neural Network Verificationcited by 23
- 2023A DPLL(T) Framework for Verifying Deep Neural Networkscited by 23
- 2024Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulationcited by 23
- 2022Double Sampling Randomized Smoothingcited by 22
- 2021Safe Control with Neural Network Dynamic Modelscited by 21
- 2021Pruning and Slicing Neural Networks using Formal Verificationcited by 20
- 2022Physics guided neural networks for modelling of non-linear dynamicscited by 20
- 2023DiffSmooth: Certifiably Robust Learning via Diffusion Models and Local Smoothingcited by 20
- 2021Scaling Up Exact Neural Network Compression by ReLU Stabilitycited by 19
- 2022POLICE: Provably Optimal Linear Constraint Enforcement for Deep Neural Networkscited by 19
- 2023The #DNN-Verification Problem: Counting Unsafe Inputs for Deep Neural Networkscited by 19
- 2023Enumerating Safe Regions in Deep Neural Networks with Provable Probabilistic Guaranteescited by 19
- 2021Make Sure You're Unsure: A Framework for Verifying Probabilistic Specificationscited by 18
- 2022CertiFair: A Framework for Certified Global Fairness of Neural Networkscited by 17
- 2021Neural Termination Analysiscited by 16
- 2023From Robustness to Explainability and Back Againcited by 14
- 2024NLP Verification: Towards a General Methodology for Certifying Robustnesscited by 14
- 2021Traversing the Local Polytopes of ReLU Neural Networks: A Unified Approach for Network Verificationcited by 13
- 2022Reachability Analysis of a General Class of Neural Ordinary Differential Equationscited by 13
- 2023Provable Preimage Under-Approximation for Neural Networks (Full Version)cited by 13
- 2024Verification-Guided Shielding for Deep Reinforcement Learningcited by 13
- 2021A Simple and Efficient Sampling-based Algorithm for General Reachability Analysiscited by 12
- 2022A Unified View of SDP-based Neural Network Verification through Completely Positive Programmingcited by 12
- 2024Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagationcited by 12
- 2020PILOT: Efficient Planning by Imitation Learning and Optimisation for Safe Autonomous Drivingcited by 11
- 2021Learning Density Distribution of Reachable States for Autonomous Systemscited by 11
- 2021Curriculum Learning for Safe Mapless Navigationcited by 11
- 2022Constrained Reinforcement Learning for Robotics via Scenario-Based Programmingcited by 11
- 2023Neural Abstractionscited by 11
- 2023Towards Verifying the Geometric Robustness of Large-scale Neural Networkscited by 11
- 2021Coordinate Linear Variance Reduction for Generalized Linear Programmingcited by 10
- 2021Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigationcited by 10
50 most cited of 221 All 221 (JSON)
- 2026Validating, Not Sampling: Region-Level Robustness of Vision-Language and Vision-Language-Action Models14 Sep 2026
- 2026Branch and Bound for Relational Verification of Neural Networks13 Aug 2026
- 2026Formal Verification of Agentic Systems over Operational Data4 Aug 2026
- 2026Mining Verdict Boundaries for Neural Network Verification31 Jul 2026
- 2026Certified Training for Convolutional Perturbations20 Jul 2026
- 2026Are Safety Guarantees in Neural Networks Safe? How to Compute Trustworthy Robustness Certifications22 Jun 2026
- 2026Engineering Reliable Autonomous Systems: Challenges and Solutions22 Jun 2026
- 2026TNODEV: Toolbox for Neural ODE Verification15 Jun 2026
- 2026Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers25 May 2026
- 2026Lipschitz Optimization for Formal Verification of Homographies22 May 2026
- 2026A Survey on the Verification of Reinforcement Learning Policies14 May 2026
- 2026Probabilistic Verification of Recurrent Neural Networks for Single and Multi-Agent Reinforcement Learning14 May 2026
38 more
- 2026Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement14 May 2026
- 2026Quantitative Linear Logic for Neuro-Symbolic Learning and Verification13 May 2026
- 2026On Hallucinations in Inverse Problems: Fundamental Limits and Provable Assessment Methods13 May 2026
- 2026A Robust Out-of-Distribution Detection Framework via Synergistic Smoothing5 May 2026
- 2026Certified geometric robustness -- Super-DeepG27 Apr 2026
- 2026Towards Verified and Targeted Explanations through Formal Methods5 Apr 2026
- 2026SafePilot: A Framework for Assuring LLM-enabled Cyber-Physical Systems23 Mar 2026
- 2026From Decoupled to Coupled: Robustness Verification for Learning-based Keypoint Detection with Joint Specifications5 Mar 2026
- 2026Exact and Asymptotically Complete Robust Verifications of Neural Networks via Ising Solvers28 Feb 2026
- 2026Synthesis and Verification of Transformer Programs (Technical Report)18 Feb 2026
- 2026Safe-SDL:Establishing Safety Boundaries and Control Mechanisms for AI-Driven Self-Driving Laboratories13 Feb 2026
- 2026Optimized Piecewise Affine Abstractions of Neural Networks with Learnable Activation Functions6 Feb 2026
- 2025Bridging Efficiency and Safety: Formal Verification of Neural Networks with Early Exits23 Dec 2025
- 2025Constrained Policy Optimization via Sampling-Based Weight-Space Projection15 Dec 2025
- 2025LUCID: Learning-Enabled Uncertainty-Aware Certification of Stochastic Dynamical Systems12 Dec 2025
- 2025Deterministic World Models for Closed-loop Reachability Analysis of End-to-End Vision-based Control8 Dec 2025
- 2025Formalized Hopfield Networks and Boltzmann Machines8 Dec 2025
- 2025SAIL: Sound Abstract Interpreters with LLMs17 Nov 2025
- 2025On the Probabilistic Learnability of Compact Neural Network Preimage Bounds10 Nov 2025
- 2025SMiLE: Provably Enforcing Global Relational Properties in Neural Networks10 Nov 2025
- 2025Worst-Case Distance-Aware Error Bounds for Neural Networks24 Oct 2025
- 2025Aircraft Collision Avoidance Systems: Technological Challenges and Solutions on the Path to Regulatory Acceptance23 Oct 2025
- 2025Self-Certifying Primal-Dual Optimization Proxies for Large-Scale Batch Economic Dispatch17 Oct 2025
- 2025KoALA: KL-L0 Adversarial Detector via Label Agreement14 Oct 2025
- 2025Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based properties1 Oct 2025
- 2025Enhancing Certifiable Semantic Robustness via Robust Pruning of Deep Neural Networks30 Sep 2025
- 2025Lipschitz-Based Robustness Certification for Recurrent Neural Networks via Convex Relaxation22 Sep 2025
- 2025Out-of-Distribution Detection using Counterfactual Distance13 Aug 2025
- 2025Efficient Neural Network Verification via Order Leading Exploration of Branch-and-Bound Trees23 Jul 2025
- 2025Formal Verification of Variational Quantum Circuits14 Jul 2025
- 2025Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approach14 Jul 2025
- 2025Probabilistically Tightened Linear Relaxation-based Perturbation Analysis for Neural Network Verification7 Jul 2025
- 2025TrainVerify: Equivalence-Based Verification for Distributed LLM Training19 Jun 2025
- 2025Abstraction-Based Proof Production in Formal Verification of Neural Networks11 Jun 2025
- 2025Towards provable probabilistic safety for scalable embodied AI systems5 Jun 2025
- 2025No Soundness in the Real World: On the Challenges of the Verification of Deployed Neural Networks1 Jun 2025
- 2025Verifiable Safety Q-Filters via Hamilton-Jacobi Reachability and Multiplicative Q-Networks27 May 2025
- 2025Logic Gate Neural Networks are Good for Verification26 May 2025
50 newest of 221 All 221 (JSON)
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021The Second International Verification of Neural Networks Competition (VNN-COMP 2021): Summary and Resultscited by 71
- 2023First Three Years of the International Verification of Neural Networks Competition (VNN-COMP)cited by 58
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learningcited by 43
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networkscited by 42
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 41
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021OVERT: An Algorithm for Safety Verification of Neural Network Control Policies for Nonlinear Systemscited by 37
- 2021Neural Network Robustness as a Verification Property: A Principled Case Studycited by 35
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
12 most cited of 213 All 213 (JSON)
- 2026Branch and Bound for Relational Verification of Neural Networks13 Aug 2026
- 2026Mining Verdict Boundaries for Neural Network Verification31 Jul 2026
- 2026Certified Training for Convolutional Perturbations20 Jul 2026
- 2026Are Safety Guarantees in Neural Networks Safe? How to Compute Trustworthy Robustness Certifications22 Jun 2026
- 2026Engineering Reliable Autonomous Systems: Challenges and Solutions22 Jun 2026
- 2026TNODEV: Toolbox for Neural ODE Verification15 Jun 2026
- 2026Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers25 May 2026
- 2026Lipschitz Optimization for Formal Verification of Homographies22 May 2026
- 2026A Survey on the Verification of Reinforcement Learning Policies14 May 2026
- 2026Probabilistic Verification of Recurrent Neural Networks for Single and Multi-Agent Reinforcement Learning14 May 2026
- 2026Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement14 May 2026
- 2026Quantitative Linear Logic for Neuro-Symbolic Learning and Verification13 May 2026
12 newest of 213 All 213 (JSON)