Optimization and Abstraction: A Synergistic Approach for Analyzing Neural Network Robustness
Not on the map. Why?
Abstract (arXiv)
In recent years, the notion of local robustness (or robustness for short) has emerged as a desirable property of deep neural networks. Intuitively, robustness means that small perturbations to an input do not cause the network to perform misclassifications. In this paper, we present a novel algorithm for verifying robustness properties of neural networks. Our method synergistically combines gradient-based optimization methods for counterexample search with abstraction-based proof search to obtain a sound and (δ-)complete decision procedure. Our method also employs a data-driven approach to learn a verification policy that guides abstract interpretation during proof search. We have implemented the proposed approach in a tool called Charon and experimentally evaluated it on hundreds of benchmarks. Our experiments show that the proposed approach significantly outperforms three state-of-the-art tools, namely AI2 , Reluplex, and Reluval.
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 13; 2023: 9; 2024: 5; 2025: 0; 2026: 2.
40 papers.
Sort:
By area:
- 2021Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Robustness Verificationcited by 228
- 2021PRIMA: General and Precise Neural Network Certification via Scalable Convex Hull Approximationscited by 77
- 2021Provable Repair of Deep Neural Networkscited by 42
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2022An Abstraction-Refinement Approach to Verifying Convolutional Neural Networkscited by 24
- 2022Efficient Neural Network Analysis with Sum-of-Infeasibilitiescited by 24
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2021Certifying Robustness to Programmable Data Bias in Decision Treescited by 21
- 2022Scalable Verification of GNN-based Job Schedulerscited by 19
- 2023Convex Bounds on the Softmax Function with Applications to Robustness Verificationcited by 19
- 2022Verification-Aided Deep Ensemble Selectioncited by 18
- 2021BDD4BNN: A BDD-based Quantitative Analysis Framework for Binarized Neural Networkscited by 17
28 more
- 2022Toward Certified Robustness Against Real-World Distribution Shiftscited by 16
- 2023Incremental Verification of Neural Networkscited by 14
- 2022QVIP: An ILP-based Formal Verification Approach for Quantized Neural Networkscited by 12
- 2023Verifying Generalization in Deep Learningcited by 11
- 2021SyReNN: A Tool for Analyzing Deep Neural Networkscited by 10
- 2022Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustnesscited by 10
- 2024Verification of Neural Networks' Global Robustnesscited by 10
- 2022Safe Neurosymbolic Learning with Differentiable Symbolic Executioncited by 9
- 2022QEBVerif: Quantization Error Bound Verification of Neural Networkscited by 9
- 2022Tighter Abstract Queries in Neural Network Verificationcited by 8
- 2021Neural Network Branch-and-Bound for Neural Network Verificationcited by 6
- 2024DeepCDCL: An CDCL-based Neural Network Verification Frameworkcited by 6
- 2021Reachability Analysis of Convolutional Neural Networkscited by 4
- 2021Self-Correcting Neural Networks For Safe Classificationcited by 4
- 2022Sound and Complete Verification of Polynomial Networkscited by 4
- 2024Safe and Reliable Training of Learning-Based Aerospace Controllerscited by 4
- 2023A Neurosymbolic Approach to the Verification of Temporal Logic Properties of Learning enabled Control Systemscited by 3
- 2023DelBugV: Delta-Debugging Neural Network Verifierscited by 3
- 2023Robustness Verification of Deep Neural Networks using Star-Based Reachability Analysis with Variable-Length Time Series Inputcited by 2
- 2024Boosting Few-Pixel Robustness Verification via Covering Verification Designscited by 2
- 2024Verifying the Generalization of Deep Learning to Out-of-Distribution Domainscited by 2
- 2021Adversarial Robustness Verification and Attack Synthesis in Stochastic Systemscited by 0
- 2021Synthesizing Machine Learning Programs with PAC Guarantees via Statistical Sketchingcited by 0
- 2022Work In Progress: Safety and Robustness Verification of Autoencoder-Based Regression Models using the NNV Toolcited by 0
- 2023Verification of Neural Networks Local Differential Classification Privacycited by 0
- 2023Formal Verification of Long Short-Term Memory based Audio Classifiers: A Star based Approachcited by 0
- 2026Towards Verified and Targeted Explanations through Formal Methodscited by 0
- 2026Branch and Bound for Relational Verification of Neural Networkscited by 0
- 2026Branch and Bound for Relational Verification of Neural Networks13 Aug 2026
- 2026Towards Verified and Targeted Explanations through Formal Methods5 Apr 2026
- 2024Safe and Reliable Training of Learning-Based Aerospace Controllers9 Jul 2024
- 2024Verifying the Generalization of Deep Learning to Out-of-Distribution Domains4 Jun 2024
- 2024Boosting Few-Pixel Robustness Verification via Covering Verification Designs17 May 2024
- 2024DeepCDCL: An CDCL-based Neural Network Verification Framework12 Mar 2024
- 2024Verification of Neural Networks' Global Robustness29 Feb 2024
- 2023Formal Verification of Long Short-Term Memory based Audio Classifiers: A Star based Approach16 Nov 2023
- 2023Verification of Neural Networks Local Differential Classification Privacy31 Oct 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2023Robustness Verification of Deep Neural Networks using Star-Based Reachability Analysis with Variable-Length Time Series Input26 Jul 2023
- 2023DelBugV: Delta-Debugging Neural Network Verifiers29 May 2023
28 more
- 2023Incremental Verification of Neural Networks4 Apr 2023
- 2023A Neurosymbolic Approach to the Verification of Temporal Logic Properties of Learning enabled Control Systems7 Mar 2023
- 2023Convex Bounds on the Softmax Function with Applications to Robustness Verification3 Mar 2023
- 2023Verifying Generalization in Deep Learning11 Feb 2023
- 2022QVIP: An ILP-based Formal Verification Approach for Quantized Neural Networks10 Dec 2022
- 2022QEBVerif: Quantization Error Bound Verification of Neural Networks6 Dec 2022
- 2022VeriX: Towards Verified Explainability of Deep Neural Networks2 Dec 2022
- 2022Tighter Abstract Queries in Neural Network Verification23 Oct 2022
- 2022Sound and Complete Verification of Polynomial Networks15 Sep 2022
- 2022Work In Progress: Safety and Robustness Verification of Autoencoder-Based Regression Models using the NNV Tool14 Jul 2022
- 2022Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness15 Jun 2022
- 2022Toward Certified Robustness Against Real-World Distribution Shifts8 Jun 2022
- 2022Efficient Neural Network Analysis with Sum-of-Infeasibilities19 Mar 2022
- 2022Safe Neurosymbolic Learning with Differentiable Symbolic Execution15 Mar 2022
- 2022Scalable Verification of GNN-based Job Schedulers7 Mar 2022
- 2022Verification-Aided Deep Ensemble Selection8 Feb 2022
- 2022An Abstraction-Refinement Approach to Verifying Convolutional Neural Networks6 Jan 2022
- 2021Synthesizing Machine Learning Programs with PAC Guarantees via Statistical Sketching11 Oct 2021
- 2021Certifying Robustness to Programmable Data Bias in Decision Trees8 Oct 2021
- 2021Adversarial Robustness Verification and Attack Synthesis in Stochastic Systems5 Oct 2021
- 2021Neural Network Branch-and-Bound for Neural Network Verification27 Jul 2021
- 2021Self-Correcting Neural Networks For Safe Classification23 Jul 2021
- 2021Reachability Analysis of Convolutional Neural Networks22 Jun 2021
- 2021Provable Repair of Deep Neural Networks9 Apr 2021
- 2021BDD4BNN: A BDD-based Quantitative Analysis Framework for Binarized Neural Networks12 Mar 2021
- 2021Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Robustness Verification11 Mar 2021
- 2021PRIMA: General and Precise Neural Network Certification via Scalable Convex Hull Approximations5 Mar 2021
- 2021SyReNN: A Tool for Analyzing Deep Neural Networks9 Jan 2021
- 2021Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Robustness Verificationcited by 228
- 2021PRIMA: General and Precise Neural Network Certification via Scalable Convex Hull Approximationscited by 77
- 2021Provable Repair of Deep Neural Networkscited by 42
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2022An Abstraction-Refinement Approach to Verifying Convolutional Neural Networkscited by 24
- 2022Efficient Neural Network Analysis with Sum-of-Infeasibilitiescited by 24
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2021Certifying Robustness to Programmable Data Bias in Decision Treescited by 21
- 2022Scalable Verification of GNN-based Job Schedulerscited by 19
- 2023Convex Bounds on the Softmax Function with Applications to Robustness Verificationcited by 19
- 2022Verification-Aided Deep Ensemble Selectioncited by 18
- 2021BDD4BNN: A BDD-based Quantitative Analysis Framework for Binarized Neural Networkscited by 17
12 most cited of 39 All 39 (JSON)
- 2026Branch and Bound for Relational Verification of Neural Networks13 Aug 2026
- 2026Towards Verified and Targeted Explanations through Formal Methods5 Apr 2026
- 2024Verifying the Generalization of Deep Learning to Out-of-Distribution Domains4 Jun 2024
- 2024Boosting Few-Pixel Robustness Verification via Covering Verification Designs17 May 2024
- 2024DeepCDCL: An CDCL-based Neural Network Verification Framework12 Mar 2024
- 2024Verification of Neural Networks' Global Robustness29 Feb 2024
- 2023Formal Verification of Long Short-Term Memory based Audio Classifiers: A Star based Approach16 Nov 2023
- 2023Verification of Neural Networks Local Differential Classification Privacy31 Oct 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2023Robustness Verification of Deep Neural Networks using Star-Based Reachability Analysis with Variable-Length Time Series Input26 Jul 2023
- 2023DelBugV: Delta-Debugging Neural Network Verifiers29 May 2023
- 2023Incremental Verification of Neural Networks4 Apr 2023
12 newest of 39 All 39 (JSON)