PRIMA: General and Precise Neural Network Certification via Scalable Convex Hull Approximations
Not on the map. Why?
Abstract (arXiv)
Formal verification of neural networks is critical for their safe adoption in real-world applications. However, designing a precise and scalable verifier which can handle different activation functions, realistic network architectures and relevant specifications remains an open and difficult challenge. In this paper, we take a major step forward in addressing this challenge and present a new verification framework, called PRIMA. PRIMA is both (i) general: it handles any non-linear activation function, and (ii) precise: it computes precise convex abstractions involving multiple neurons via novel convex hull approximation algorithms that leverage concepts from computational geometry. The algorithms have polynomial complexity, yield fewer constraints, and minimize precision loss. We evaluate the effectiveness of PRIMA on a variety of challenging tasks from prior work. Our results show that PRIMA is significantly more precise than the state-of-the-art, verifying robustness to input perturbations for up to 20%, 30%, and 34% more images than existing work on ReLU-, Sigmoid-, and Tanh-based networks, respectively. Further, PRIMA enables, for the first time, the precise verification of a realistic neural network for autonomous driving within a few minutes.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). Builds on 30 of its 74 references that are in the map. First posted on arXiv 5 Mar 2021.
Builds on
30 of 74 references.
References · 30
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 462
- 2018Efficient Neural Network Robustness Certification with General Activation Functionscited by 439
- 2019Provably Robust Deep Learning via Adversarially Trained Smoothed Classifierscited by 328
- 2016Safety Verification of Deep Neural Networkscited by 262
- 2018Towards Fast Computation of Certified Robustness for ReLU Networkscited by 254
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 241
- 2020Fast and Complete: Enabling Complete Neural Network Verification with Rapid and Massively Parallel Incomplete Verifierscited by 183
18 more
- 2018Semidefinite relaxations for certifying robustness to adversarial examplescited by 178
- 2018Efficient Formal Safety Analysis of Neural Networkscited by 165
- 2018Scaling provable adversarial defensescited by 141
- 2019Branch and Bound for Piecewise Linear Neural Network Verificationcited by 138
- 2019A Convex Relaxation Barrier to Tight Robustness Verification of Neural Networkscited by 124
- 2018Strong mixed-integer programming formulations for trained neural networkscited by 115
- 2017Output Reachable Set Estimation and Verification for Multi-Layer Neural Networkscited by 79
- 2020Learning Certified Individually Fair Representationscited by 69
- 2020Enabling certification of verification-agnostic networks via memory-efficient semidefinite programmingcited by 65
- 2018CNN-Cert: An Efficient Framework for Certifying Robustness of Convolutional Neural Networkscited by 50
- 2020The Convex Relaxation Barrier, Revisited: Tightened Single-Neuron Relaxations for Neural Network Verificationcited by 50
- 2019Neural Network Branching for Neural Network Verificationcited by 45
- 2020Scaling Polyhedral Neural Network Verification on GPUscited by 43
- 2019Optimization and Abstraction: A Synergistic Approach for Analyzing Neural Network Robustnesscited by 40
- 2019Fastened CROWN: Tightened Neural Network Robustness Certificatescited by 39
- 2020Efficient Certification of Spatial Robustnesscited by 11
- 2020An efficient nonconvex reformulation of stagewise convex optimization problemscited by 7
- 2016Computing the Approximate Convex Hull in High Dimensionscited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 16; 2023: 20; 2024: 20; 2025: 10; 2026: 10.
77 papers.
Sort:
By area:
- 2022Complete Verification via Multi-Neuron Relaxation Guided Branch-and-Boundcited by 92
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2022Certified Training: Small Boxes are All You Needcited by 51
- 2024Neural Network Verification with Branch-and-Bound for General Nonlinearitiescited by 47
- 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planescited by 33
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2023Understanding Certified Training with Interval Bound Propagationcited by 26
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2023Expressive Losses for Verified Robustness via Convex Combinationscited by 23
- 2023A DPLL(T) Framework for Verifying Deep Neural Networkscited by 23
- 2022Neural Network Verification with Proof Productioncited by 22
- 2022IBP Regularization for Verified Adversarial Robustness via Branch-and-Boundcited by 21
38 more
- 2022Toward Certified Robustness Against Real-World Distribution Shiftscited by 16
- 2023From Robustness to Explainability and Back Againcited by 14
- 2024Vehicle: Bridging the Embedding Gap in the Verification of Neuro-Symbolic Programscited by 14
- 2024NLP Verification: Towards a General Methodology for Certifying Robustnesscited by 14
- 2023TAPS: Connecting Certified and Adversarial Trainingcited by 11
- 2024Verifying message-passing neural networks via topology-based bounds tighteningcited by 10
- 2026Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guaranteescited by 10
- 2023Architecture-Preserving Provable Repair of Deep Neural Networkscited by 9
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verificationcited by 9
- 2022Tighter Abstract Queries in Neural Network Verificationcited by 8
- 2023Expressivity of ReLU-Networks under Convex Relaxationscited by 8
- 2024Robustness Assessment of a Runway Object Classifier for Safe Aircraft Taxiingcited by 8
- 2024Formal Verification of Graph Convolutional Networks with Uncertain Node Features and Uncertain Graph Structurecited by 8
- 2022On Optimizing Back-Substitution Methods for Neural Network Verificationcited by 6
- 2023Optimization and Optimizers for Adversarial Robustnesscited by 6
- 2023Fully Automatic Neural Network Reduction for Formal Verificationcited by 6
- 2024Set-Based Training for Neural Network Verificationcited by 6
- 2024DeepCDCL: An CDCL-based Neural Network Verification Frameworkcited by 6
- 2025Out of the Shadows: Exploring a Latent Space for Neural Network Verificationcited by 6
- 2022(De-)Randomized Smoothing for Decision Stump Ensemblescited by 5
- 2022Chordal Sparsity for SDP-based Neural Network Verificationcited by 4
- 2022A Scalable, Interpretable, Verifiable & Differentiable Logic Gate Convolutional Neural Network Architecture From Truth Tablescited by 4
- 2023Efficient MILP Decomposition in Quantum Computing for ReLU Network Robustnesscited by 4
- 2023Precise and Generalized Robustness Certification for Neural Networkscited by 4
- 2024Towards Formal Verification of Deep Neural Networks for Object Detectioncited by 4
- 2024Efficiently Computing Compact Formal Explanationscited by 4
- 2025Faster Verified Explanations for Neural Networkscited by 4
- 2023Reliability Assurance for Deep Neural Network Architectures Against Numerical Defectscited by 3
- 2023Efficient Certified Training and Robustness Verification of Neural ODEscited by 3
- 2023DelBugV: Delta-Debugging Neural Network Verifierscited by 3
- 2024Compiling High-Level Neural Network Specifications into VNN-LIB Queriescited by 3
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verificationcited by 3
- 2023A Tale of Two Approximations: Tightening Over-Approximation for DNN Robustness Verification via Under-Approximationcited by 2
- 2023Pixel-wise Smoothing for Certified Robustness against Camera Motion Perturbationscited by 2
- 2024Monitizer: Automating Design and Evaluation of Neural Network Monitorscited by 2
- 2024Expressiveness of Multi-Neuron Convex Relaxations in Neural Network Certificationcited by 2
- 2025Adaptive Branch-and-Bound Tree Exploration for Neural Network Verificationcited by 2
- 2021Abstract Interpretation of Fixpoint Iterators with Applications to Neural Networkscited by 1
50 most cited of 77 All 77 (JSON)
- 2026Branch and Bound for Relational Verification of Neural Networks13 Aug 2026
- 2026Propagation of~Interval Belief Structures and~Imprecise Copulas for~Neural Network Verification29 Jun 2026
- 2026Semantic Robustness Certification for Vision-Language Models17 Jun 2026
- 2026Neural Network Verification using Partial Multi-Neuron Relaxation28 May 2026
- 2026VNN-LIB 2.0: Rigorous Foundations for Neural Network Verification8 May 2026
- 2026Towards Verified and Targeted Explanations through Formal Methods5 Apr 2026
- 2026The Luna Bound Propagator for Formal Analysis of Neural Networks25 Mar 2026
- 2026Provably Explaining Neural Additive Models19 Feb 2026
- 2026Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guarantees18 Feb 2026
- 2026E-Globe: Scalable ε-Global Verification of Neural Networks via Tight Upper Bounds and Pattern-Aware Branching4 Feb 2026
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verification11 Dec 2025
- 2025Dual Randomized Smoothing: Beyond Global Noise Variance1 Dec 2025
38 more
- 2025Faster Verified Explanations for Neural Networks28 Nov 2025
- 2025Tighter Truncated Rectangular Prism Approximation for RNN Robustness Verification12 Nov 2025
- 2025Solution-aware vs global ReLU selection: partial MILP strikes back for DNN verification31 Jul 2025
- 2025Efficient Neural Network Verification via Order Leading Exploration of Branch-and-Bound Trees23 Jul 2025
- 2025Out of the Shadows: Exploring a Latent Space for Neural Network Verification23 May 2025
- 2025Adaptive Branch-and-Bound Tree Exploration for Neural Network Verification2 May 2025
- 2025Support is All You Need for Certified VAE Training16 Apr 2025
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verification15 Mar 2025
- 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planes31 Dec 2024
- 2024Tightening convex relaxations of trained neural networks: a unified approach for convex and S-shaped activations30 Oct 2024
- 2024Expressiveness of Multi-Neuron Convex Relaxations in Neural Network Certification9 Oct 2024
- 2024Efficiently Computing Compact Formal Explanations4 Sep 2024
- 2024Towards Formal Verification of Deep Neural Networks for Object Detection1 Jul 2024
- 2024CAPM: Fast and Robust Verification on Maxpool-based CNN via Dual Network27 Jun 2024
- 2024Towards General Robustness Verification of MaxPool-based Convolutional Neural Networks via Tightening Linear Approximation2 Jun 2024
- 2024Neural Network Verification with Branch-and-Bound for General Nonlinearities31 May 2024
- 2024Uncertainty Measurement of Deep Learning System based on the Convex Hull of Training Sets25 May 2024
- 2024Monitizer: Automating Design and Evaluation of Neural Network Monitors16 May 2024
- 2024Cross-Input Certified Training for Universal Perturbations15 May 2024
- 2024Formal Verification of Graph Convolutional Networks with Uncertain Node Features and Uncertain Graph Structure23 Apr 2024
- 2024NLP Verification: Towards a General Methodology for Certifying Robustness15 Mar 2024
- 2024DeepCDCL: An CDCL-based Neural Network Verification Framework12 Mar 2024
- 2024Verifying message-passing neural networks via topology-based bounds tightening21 Feb 2024
- 2024Set-Based Training for Neural Network Verification26 Jan 2024
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networks25 Jan 2024
- 2024Compiling High-Level Neural Network Specifications into VNN-LIB Queries24 Jan 2024
- 2024Vehicle: Bridging the Embedding Gap in the Verification of Neuro-Symbolic Programs12 Jan 2024
- 2024Robustness Assessment of a Runway Object Classifier for Safe Aircraft Taxiing8 Jan 2024
- 2023STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformers28 Nov 2023
- 2023Expressivity of ReLU-Networks under Convex Relaxations7 Nov 2023
- 2023Pixel-wise Smoothing for Certified Robustness against Camera Motion Perturbations22 Sep 2023
- 2023Expediting Neural Network Verification via Network Reduction7 Aug 2023
- 2023Formally Explaining Neural Networks within Reactive Systems31 Jul 2023
- 2023A DPLL(T) Framework for Verifying Deep Neural Networks17 Jul 2023
- 2023Understanding Certified Training with Interval Bound Propagation17 Jun 2023
- 2023Precise and Generalized Robustness Certification for Neural Networks11 Jun 2023
- 2023From Robustness to Explainability and Back Again5 Jun 2023
- 2023DelBugV: Delta-Debugging Neural Network Verifiers29 May 2023
50 newest of 77 All 77 (JSON)
- 2026Semantic Robustness Certification for Vision-Language Models17 Jun 2026
- 2022Complete Verification via Multi-Neuron Relaxation Guided Branch-and-Boundcited by 92
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2022Certified Training: Small Boxes are All You Needcited by 51
- 2024Neural Network Verification with Branch-and-Bound for General Nonlinearitiescited by 47
- 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planescited by 33
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2023Understanding Certified Training with Interval Bound Propagationcited by 26
- 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
- 2023Expressive Losses for Verified Robustness via Convex Combinationscited by 23
- 2023A DPLL(T) Framework for Verifying Deep Neural Networkscited by 23
- 2022Neural Network Verification with Proof Productioncited by 22
- 2022IBP Regularization for Verified Adversarial Robustness via Branch-and-Boundcited by 21
12 most cited of 76 All 76 (JSON)
- 2026Branch and Bound for Relational Verification of Neural Networks13 Aug 2026
- 2026Propagation of~Interval Belief Structures and~Imprecise Copulas for~Neural Network Verification29 Jun 2026
- 2026Neural Network Verification using Partial Multi-Neuron Relaxation28 May 2026
- 2026VNN-LIB 2.0: Rigorous Foundations for Neural Network Verification8 May 2026
- 2026Towards Verified and Targeted Explanations through Formal Methods5 Apr 2026
- 2026The Luna Bound Propagator for Formal Analysis of Neural Networks25 Mar 2026
- 2026Provably Explaining Neural Additive Models19 Feb 2026
- 2026Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guarantees18 Feb 2026
- 2026E-Globe: Scalable ε-Global Verification of Neural Networks via Tight Upper Bounds and Pattern-Aware Branching4 Feb 2026
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verification11 Dec 2025
- 2025Dual Randomized Smoothing: Beyond Global Noise Variance1 Dec 2025
- 2025Faster Verified Explanations for Neural Networks28 Nov 2025
12 newest of 76 All 76 (JSON)