Parallelization Techniques for Verifying Neural Networks
Not on the map. Why?
Abstract (arXiv)
Inspired by recent successes with parallel optimization techniques for solving Boolean satisfiability, we investigate a set of strategies and heuristics that aim to leverage parallel computing to improve the scalability of neural network verification. We introduce an algorithm based on partitioning the verification problem in an iterative manner and explore two partitioning strategies, that work by partitioning the input space or by case splitting on the phases of the neuron activations, respectively. We also introduce a highly parallelizable pre-processing algorithm that uses the neuron activation phases to simplify the neural network verification problems. An extensive experimental evaluation shows the benefit of these techniques on both existing benchmarks and new benchmarks from the aviation domain. A preliminary experiment with ultra-scaling our algorithm using a large distributed cloud-based platform also shows promising results.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 13; 2023: 7; 2024: 2; 2025: 1; 2026: 4.
36 papers.
Sort:
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2021The Second International Verification of Neural Networks Competition (VNN-COMP 2021): Summary and Resultscited by 71
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networkscited by 42
- 2022The Third International Verification of Neural Networks Competition (VNN-COMP 2022): Summary and Resultscited by 39
- 2021OVERT: An Algorithm for Safety Verification of Neural Network Control Policies for Nonlinear Systemscited by 37
- 2021Towards Scalable Verification of Deep Reinforcement Learningcited by 33
- 2022Verifying Learning-Based Robotic Navigation Systemscited by 33
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2022An Abstraction-Refinement Approach to Verifying Convolutional Neural Networkscited by 24
- 2022Efficient Neural Network Analysis with Sum-of-Infeasibilitiescited by 24
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2023A DPLL(T) Framework for Verifying Deep Neural Networkscited by 23
24 more
- 2022Neural Network Verification with Proof Productioncited by 22
- 2021Pruning and Slicing Neural Networks using Formal Verificationcited by 20
- 2022Verification-Aided Deep Ensemble Selectioncited by 18
- 2022Scalable Verification of GNN-based Job Schedulerscited by 18
- 2021Minimal Multi-Layer Modifications of Deep Neural Networkscited by 14
- 2021DeepCert: Verification of Contextually Relevant Robustness for Neural Network Image Classifierscited by 11
- 2022Constrained Reinforcement Learning for Robotics via Scenario-Based Programmingcited by 11
- 2023Verifying Generalization in Deep Learningcited by 11
- 2021RoMA: a Method for Neural Network Robustness Measurement and Assessmentcited by 10
- 2022Tighter Abstract Queries in Neural Network Verificationcited by 8
- 2021Self-Correcting Neural Networks For Safe Classificationcited by 4
- 2022Boosting Robustness Verification of Semantic Feature Neighborhoodscited by 4
- 2023DelBugV: Delta-Debugging Neural Network Verifierscited by 3
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verificationcited by 3
- 2021ZoPE: A Fast Optimizer for ReLU Networks with Low-Dimensional Inputscited by 2
- 2022Negative Selection Approach to support Formal Verification and Validation of BlackBox Models' Input Constraintscited by 2
- 2023UnbiasedNets: A Dataset Diversification Framework for Robustness Bias Alleviation in Neural Networkscited by 2
- 2024Boosting Few-Pixel Robustness Verification via Covering Verification Designscited by 2
- 2026Incremental Neural Network Verification via Learned Conflictscited by 2
- 2026Lookahead Branching for Neural Network Verificationcited by 1
- 2023Scaling Model Checking for DNN Analysis via State-Space Reduction and Input Segmentation (Extended Version)cited by 0
- 2023Verification of Neural Networks Local Differential Classification Privacycited by 0
- 2026veriFIRE: an Industrial Case Study in Verifying Consistency Properties for a DNN-Based Wildfire Detection Systemcited by 0
- 2026Verifying Neural Networks with Reinforcement Learningcited by 0
- 2026Verifying Neural Networks with Reinforcement Learning28 Sep 2026
- 2026Lookahead Branching for Neural Network Verification19 Jul 2026
- 2026veriFIRE: an Industrial Case Study in Verifying Consistency Properties for a DNN-Based Wildfire Detection System2 Jun 2026
- 2026Incremental Neural Network Verification via Learned Conflicts12 Mar 2026
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verification15 Mar 2025
- 2024Boosting Few-Pixel Robustness Verification via Covering Verification Designs17 May 2024
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networks25 Jan 2024
- 2023Verification of Neural Networks Local Differential Classification Privacy31 Oct 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2023A DPLL(T) Framework for Verifying Deep Neural Networks17 Jul 2023
- 2023Scaling Model Checking for DNN Analysis via State-Space Reduction and Input Segmentation (Extended Version)29 Jun 2023
- 2023DelBugV: Delta-Debugging Neural Network Verifiers29 May 2023
24 more
- 2023UnbiasedNets: A Dataset Diversification Framework for Robustness Bias Alleviation in Neural Networks24 Feb 2023
- 2023Verifying Generalization in Deep Learning11 Feb 2023
- 2022The Third International Verification of Neural Networks Competition (VNN-COMP 2022): Summary and Results20 Dec 2022
- 2022VeriX: Towards Verified Explainability of Deep Neural Networks2 Dec 2022
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networks25 Oct 2022
- 2022Tighter Abstract Queries in Neural Network Verification23 Oct 2022
- 2022Boosting Robustness Verification of Semantic Feature Neighborhoods12 Sep 2022
- 2022Negative Selection Approach to support Formal Verification and Validation of BlackBox Models' Input Constraints3 Sep 2022
- 2022Constrained Reinforcement Learning for Robotics via Scenario-Based Programming20 Jun 2022
- 2022Neural Network Verification with Proof Production1 Jun 2022
- 2022Verifying Learning-Based Robotic Navigation Systems26 May 2022
- 2022Efficient Neural Network Analysis with Sum-of-Infeasibilities19 Mar 2022
- 2022Scalable Verification of GNN-based Job Schedulers7 Mar 2022
- 2022Verification-Aided Deep Ensemble Selection8 Feb 2022
- 2022An Abstraction-Refinement Approach to Verifying Convolutional Neural Networks6 Jan 2022
- 2021RoMA: a Method for Neural Network Robustness Measurement and Assessment21 Oct 2021
- 2021Minimal Multi-Layer Modifications of Deep Neural Networks18 Oct 2021
- 2021The Second International Verification of Neural Networks Competition (VNN-COMP 2021): Summary and Results31 Aug 2021
- 2021OVERT: An Algorithm for Safety Verification of Neural Network Control Policies for Nonlinear Systems3 Aug 2021
- 2021Self-Correcting Neural Networks For Safe Classification23 Jul 2021
- 2021ZoPE: A Fast Optimizer for ReLU Networks with Low-Dimensional Inputs9 Jun 2021
- 2021Pruning and Slicing Neural Networks using Formal Verification28 May 2021
- 2021Towards Scalable Verification of Deep Reinforcement Learning25 May 2021
- 2021DeepCert: Verification of Contextually Relevant Robustness for Neural Network Image Classifiers2 Mar 2021
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2021The Second International Verification of Neural Networks Competition (VNN-COMP 2021): Summary and Resultscited by 71
- 2022Towards Formal XAI: Formally Approximate Minimal Explanations of Neural Networkscited by 42
- 2022The Third International Verification of Neural Networks Competition (VNN-COMP 2022): Summary and Resultscited by 39
- 2021OVERT: An Algorithm for Safety Verification of Neural Network Control Policies for Nonlinear Systemscited by 37
- 2021Towards Scalable Verification of Deep Reinforcement Learningcited by 33
- 2022Verifying Learning-Based Robotic Navigation Systemscited by 33
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2022An Abstraction-Refinement Approach to Verifying Convolutional Neural Networkscited by 24
- 2022Efficient Neural Network Analysis with Sum-of-Infeasibilitiescited by 24
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2023A DPLL(T) Framework for Verifying Deep Neural Networkscited by 23
12 most cited of 36 All 36 (JSON)
- 2026Verifying Neural Networks with Reinforcement Learning28 Sep 2026
- 2026Lookahead Branching for Neural Network Verification19 Jul 2026
- 2026veriFIRE: an Industrial Case Study in Verifying Consistency Properties for a DNN-Based Wildfire Detection System2 Jun 2026
- 2026Incremental Neural Network Verification via Learned Conflicts12 Mar 2026
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verification15 Mar 2025
- 2024Boosting Few-Pixel Robustness Verification via Covering Verification Designs17 May 2024
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networks25 Jan 2024
- 2023Verification of Neural Networks Local Differential Classification Privacy31 Oct 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2023A DPLL(T) Framework for Verifying Deep Neural Networks17 Jul 2023
- 2023Scaling Model Checking for DNN Analysis via State-Space Reduction and Input Segmentation (Extended Version)29 Jun 2023
- 2023DelBugV: Delta-Debugging Neural Network Verifiers29 May 2023
12 newest of 36 All 36 (JSON)