Verifying Properties of Binarized Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
Understanding properties of deep neural networks is an important challenge in deep learning. In this paper, we take a step in this direction by proposing a rigorous way of verifying properties of a popular class of neural networks, Binarized Neural Networks, using the well-developed means of Boolean satisfiability. Our main contribution is a construction that creates a representation of a binarized neural network as a Boolean formula. Our encoding is the first exact Boolean representation of a deep neural network. Using this encoding, we leverage the power of modern SAT solvers along with a proposed counterexample-guided search procedure to verify various properties of these networks. A particular focus will be on the critical property of robustness to adversarial perturbations. For this property, our experimental results demonstrate that our approach scales to medium-size deep neural networks used in image classification tasks. To the best of our knowledge, this is the first work on verifying properties of deep neural networks using an exact Boolean encoding of the network.
Key facts. Cited by 79 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 21; 2023: 18; 2024: 8; 2025: 10; 2026: 3.
79 papers.
Sort:
By area:
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 41
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2021Reachability Is NP-Complete Even for the Simplest Neural Networkscited by 27
- 2022ASTERYX : A model-Agnostic SaT-basEd appRoach for sYmbolic and score-based eXplanationscited by 26
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 25
- 2022On the Computation of Necessary and Sufficient Explanationscited by 23
- 2022Computing Abductive Explanations for Boosted Treescited by 23
- 2023Logic for Explainable AIcited by 23
- 2021Scaling Up Exact Neural Network Compression by ReLU Stabilitycited by 19
- 2022Verification-Aided Deep Ensemble Selectioncited by 18
38 more
- 2021BDD4BNN: A BDD-based Quantitative Analysis Framework for Binarized Neural Networkscited by 17
- 2025RvLLM: LLM Runtime Verification with Domain Knowledgecited by 17
- 2021Neural Termination Analysiscited by 16
- 2021On Quantifying Literals in Boolean Logic and Its Applications to Explainable AIcited by 16
- 2021Minimal Multi-Layer Modifications of Deep Neural Networkscited by 14
- 2025Systems Security Foundations for Agentic Computingcited by 13
- 2021Towards Practical Robustness Analysis for DNNs based on PAC-Model Learningcited by 12
- 2022QVIP: An ILP-based Formal Verification Approach for Quantized Neural Networkscited by 12
- 2025Neural Network Verification is a Programming Language Challengecited by 12
- 2024Network Inversion of Binarised Neural Netscited by 11
- 2022On Neural Network Equivalence Checking using SMT Solverscited by 10
- 2024A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligencecited by 10
- 2022QEBVerif: Quantization Error Bound Verification of Neural Networkscited by 9
- 2022Tighter Abstract Queries in Neural Network Verificationcited by 8
- 2023A New Class of Explanations for Classifiers with Non-Binary Featurescited by 8
- 2021Drop Clause: Enhancing Performance, Interpretability and Robustness of the Tsetlin Machinecited by 7
- 2021Customizable Reference Runtime Monitoring of Neural Networks using Resolution Boxescited by 6
- 2021Provable Guarantees on the Robustness of Decision Rules to Causal Interventionscited by 6
- 2021Verifying Quantized Neural Networks using SMT-Based Model Checkingcited by 6
- 2021Geometric Path Enumeration for Equivalence Verification of Neural Networkscited by 6
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systemscited by 6
- 2023Locally-Minimal Probabilistic Explanationscited by 6
- 2024Formal Explanations for Neuro-Symbolic AIcited by 6
- 2022Reachability In Simple Neural Networkscited by 5
- 2023On the Complexity of Enumerating Prime Implicants from Decision-DNNF Circuitscited by 5
- 2021QNNVerifier: A Tool for Verifying Neural Networks using SMT-Based Model Checkingcited by 4
- 2022A Scalable, Interpretable, Verifiable & Differentiable Logic Gate Convolutional Neural Network Architecture From Truth Tablescited by 4
- 2024Revisiting Differential Verification: Equivalence Verification with Confidencecited by 4
- 2021BCNN: Binary Complex Neural Networkcited by 3
- 2022A Mixed Integer Programming Approach for Verifying Properties of Binarized Neural Networkscited by 3
- 2022Quantization-aware Interval Bound Propagation for Training Certifiably Robust Quantized Neural Networkscited by 3
- 2023Efficient Computation of Shap Explanation Scores for Neural Network Classifiers via Knowledge Compilationcited by 3
- 2024A Survey of Neural Network Robustness Assessment in Image Recognitioncited by 3
- 2021Toward Neural-Network-Guided Program Synthesis and Verificationcited by 2
- 2022Systems Challenges for Trustworthy Embodied Systemscited by 2
- 2022Deep Binary Reinforcement Learning for Scalable Verificationcited by 2
- 2022CEG4N: Counter-Example Guided Neural Network Quantization Refinementcited by 2
- 2023Incremental Satisfiability Modulo Theory for Verification of Deep Neural Networkscited by 2
50 most cited of 79 All 79 (JSON)
- 2026Some Complexity Results for Robustness Verification for Binarized Neural Networks17 Jun 2026
- 2026A Sugeno Integral View of Binarized Neural Network Inference20 Apr 2026
- 2026Scalable Digital Compute-in-Memory Ising Machines for Robustness Verification of Binary Neural Networks5 Mar 2026
- 2025Uncovering Discrimination Clusters: Quantifying and Explaining Systematic Fairness Violations29 Dec 2025
- 2025Systems Security Foundations for Agentic Computing1 Dec 2025
- 2025Provable Repair of Deep Neural Network Defects by Preimage Synthesis and Property Refinement11 Nov 2025
- 2025On Integer Programming for the Binarized Neural Network Verification Problem1 Oct 2025
- 2025Efficient Certified Reasoning for Binarized Neural Networks25 Jun 2025
- 2025MUC-G4: Minimal Unsat Core-Guided Incremental Verification for Deep Neural Network Compression3 Jun 2025
- 2025RvLLM: LLM Runtime Verification with Domain Knowledge24 May 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025Hierarchical Fallback Architecture for High Risk Online Machine Learning Inference29 Jan 2025
38 more
- 2025Neural Network Verification is a Programming Language Challenge10 Jan 2025
- 2024Revisiting Differential Verification: Equivalence Verification with Confidence26 Oct 2024
- 2024Formal Explanations for Neuro-Symbolic AI18 Oct 2024
- 2024Formal Local Implication Between Two Neural Networks25 Sep 2024
- 2024Verifying Properties of Binary Neural Networks Using Sparse Polynomial Optimization27 May 2024
- 2024A Survey of Neural Network Robustness Assessment in Image Recognition12 Apr 2024
- 2024Network Inversion of Binarised Neural Nets19 Feb 2024
- 2024Probabilistic ML Verification via Weighted Model Integration7 Feb 2024
- 2024A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligence6 Jan 2024
- 2023Locally-Minimal Probabilistic Explanations19 Dec 2023
- 2023Compositional Inductive Invariant Based Verification of Neural Network Controlled Systems17 Dec 2023
- 2023Decomposing Hard SAT Instances with Metaheuristic Optimization16 Dec 2023
- 2023Benchmarking Local Robustness of High-Accuracy Binary Neural Networks for Enhanced Traffic Sign Recognition25 Sep 2023
- 2023Current and Future Challenges in Knowledge Representation and Reasoning8 Aug 2023
- 2023An Automata-Theoretic Approach to Synthesizing Binarized Neural Networks29 Jul 2023
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systems20 Jul 2023
- 2023Scaling Model Checking for DNN Analysis via State-Space Reduction and Input Segmentation (Extended Version)29 Jun 2023
- 2023Boosting-based Construction of BDDs for Linear Threshold Functions and Its Application to Verification of Neural Networks8 Jun 2023
- 2023Logic for Explainable AI9 May 2023
- 2023When Deep Learning Meets Polyhedral Theory: A Survey29 Apr 2023
- 2023A New Class of Explanations for Classifiers with Non-Binary Features28 Apr 2023
- 2023Model-Agnostic Reachability Analysis on Deep Neural Networks3 Apr 2023
- 2023Verifying Properties of Tsetlin Machines25 Mar 2023
- 2023Efficient Computation of Shap Explanation Scores for Neural Network Classifiers via Knowledge Compilation11 Mar 2023
- 2023Incremental Satisfiability Modulo Theory for Verification of Deep Neural Networks10 Feb 2023
- 2023On the Complexity of Enumerating Prime Implicants from Decision-DNNF Circuits30 Jan 2023
- 2023Uncertainty Estimation based on Geometric Separation11 Jan 2023
- 2022QVIP: An ILP-based Formal Verification Approach for Quantized Neural Networks10 Dec 2022
- 2022QEBVerif: Quantization Error Bound Verification of Neural Networks6 Dec 2022
- 2022Quantization-aware Interval Bound Propagation for Training Certifiably Robust Quantized Neural Networks29 Nov 2022
- 2022Tighter Abstract Queries in Neural Network Verification23 Oct 2022
- 2022Computing Abductive Explanations for Boosted Trees16 Sep 2022
- 2022A Scalable, Interpretable, Verifiable & Differentiable Logic Gate Convolutional Neural Network Architecture From Truth Tables18 Aug 2022
- 2022Verification of Sigmoidal Artificial Neural Networks using iSAT14 Jul 2022
- 2022CEG4N: Counter-Example Guided Neural Network Quantization Refinement9 Jul 2022
- 2022ASTERYX : A model-Agnostic SaT-basEd appRoach for sYmbolic and score-based eXplanations23 Jun 2022
- 2022A Geometric Method for Improved Uncertainty Estimation in Real-time23 Jun 2022
- 2022A Model-Agnostic SAT-based Approach for Symbolic Explanation Enumeration23 Jun 2022
50 newest of 79 All 79 (JSON)
- 2025Systems Security Foundations for Agentic Computingcited by 13
- 2025Systems Security Foundations for Agentic Computing1 Dec 2025
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 41
- 2021On the Computational Intelligibility of Boolean Classifierscited by 40
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2021Reachability Is NP-Complete Even for the Simplest Neural Networkscited by 27
- 2022ASTERYX : A model-Agnostic SaT-basEd appRoach for sYmbolic and score-based eXplanationscited by 26
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 25
- 2022On the Computation of Necessary and Sufficient Explanationscited by 23
- 2022Computing Abductive Explanations for Boosted Treescited by 23
- 2023Logic for Explainable AIcited by 23
- 2021Scaling Up Exact Neural Network Compression by ReLU Stabilitycited by 19
- 2022Verification-Aided Deep Ensemble Selectioncited by 18
12 most cited of 77 All 77 (JSON)
- 2026Some Complexity Results for Robustness Verification for Binarized Neural Networks17 Jun 2026
- 2026A Sugeno Integral View of Binarized Neural Network Inference20 Apr 2026
- 2026Scalable Digital Compute-in-Memory Ising Machines for Robustness Verification of Binary Neural Networks5 Mar 2026
- 2025Uncovering Discrimination Clusters: Quantifying and Explaining Systematic Fairness Violations29 Dec 2025
- 2025On Integer Programming for the Binarized Neural Network Verification Problem1 Oct 2025
- 2025Efficient Certified Reasoning for Binarized Neural Networks25 Jun 2025
- 2025MUC-G4: Minimal Unsat Core-Guided Incremental Verification for Deep Neural Network Compression3 Jun 2025
- 2025RvLLM: LLM Runtime Verification with Domain Knowledge24 May 2025
- 2025Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms6 May 2025
- 2025Hierarchical Fallback Architecture for High Risk Online Machine Learning Inference29 Jan 2025
- 2025Neural Network Verification is a Programming Language Challenge10 Jan 2025
- 2024Revisiting Differential Verification: Equivalence Verification with Confidence26 Oct 2024
12 newest of 77 All 77 (JSON)