Maximum Resilience of Artificial Neural Networks
Not on the map. Why?
Abstract (arXiv)
The deployment of Artificial Neural Networks (ANNs) in safety-critical applications poses a number of new verification and certification challenges. In particular, for ANN-enabled self-driving vehicles it is important to establish properties about the resilience of ANNs to noisy or even maliciously manipulated sensory input. We are addressing these challenges by defining resilience properties of ANN-based classifiers as the maximal amount of input or sensor perturbation which is still tolerated. This problem of computing maximal perturbation bounds for ANNs is then reduced to solving mixed integer optimization problems (MIP). A number of MIP encoding heuristics are developed for drastically reducing MIP-solver runtimes, and using parallelization of MIP-solvers results in an almost linear speed-up in the number (up to a certain limit) of computing cores in our experiments. We demonstrate the effectiveness and scalability of our approach by means of computing maximal resilience bounds for a number of ANN benchmark sets ranging from typical image recognition scenarios to the autonomous maneuvering of robots.
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 27; 2023: 17; 2024: 14; 2025: 13; 2026: 3.
97 papers.
Sort:
By area:
- 2021Orthogonalizing Convolutional Layers with the Cayley Transformcited by 105
- 2022Learning To Cut By Looking Ahead: Cutting Plane Selection via Imitation Learningcited by 58
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 41
- 2021Learning a Large Neighborhood Search Algorithm for Mixed Integer Programscited by 41
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 41
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 40
- 2021Partition-based formulations for mixed-integer optimization of trained ReLU neural networkscited by 39
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 36
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2022An Abstraction-Refinement Approach to Verifying Convolutional Neural Networkscited by 24
38 more
- 2022Open- and Closed-Loop Neural Network Verification using Polynomial Zonotopescited by 24
- 2021Scaling Up Exact Neural Network Compression by ReLU Stabilitycited by 19
- 2021BDD4BNN: A BDD-based Quantitative Analysis Framework for Binarized Neural Networkscited by 17
- 2021Provably Robust Detection of Out-of-distribution Data (almost) for freecited by 17
- 2022Maximizing information from chemical engineering data sets: Applications to machine learningcited by 17
- 2022CertiFair: A Framework for Certified Global Fairness of Neural Networkscited by 17
- 2024Compact Proofs of Model Performance via Mechanistic Interpretabilitycited by 17
- 2022Neur2SP: Neural Two-Stage Stochastic Programmingcited by 16
- 2021Towards Evaluating and Training Verifiably Robust Neural Networkscited by 15
- 2022Efficient Global Robustness Certification of Neural Networks via Interleaving Twin-Network Encodingcited by 15
- 2022A Unified View of SDP-based Neural Network Verification through Completely Positive Programmingcited by 12
- 2022QVIP: An ILP-based Formal Verification Approach for Quantized Neural Networkscited by 12
- 2023POLAR-Express: Efficient and Precise Formal Reachability Analysis of Neural-Network Controlled Systemscited by 12
- 2022UniCR: Universally Approximated Certified Robustness via Randomized Smoothingcited by 10
- 2023Learning To Dive In Branch And Boundcited by 10
- 2024A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligencecited by 10
- 2024Optimization Over Trained Neural Networks: Taking a Relaxing Walkcited by 10
- 2024Detecting Brittle Decisions for Free: Leveraging Margin Consistency in Deep Robust Classifierscited by 10
- 2022MultiGuard: Provably Robust Multi-label Classification against Adversarial Examplescited by 9
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verificationcited by 9
- 2021DeepSplit: Scalable Verification of Deep Neural Networks via Operator Splittingcited by 8
- 2021Fast BATLLNN: Fast Box Analysis of Two-Level Lattice Neural Networkscited by 8
- 2021Modeling Design and Control Problems Involving Neural Network Surrogatescited by 8
- 2023Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regionscited by 8
- 2021Recent Advances in Large Margin Learningcited by 7
- 2022Piecewise Linear Neural Networks and Deep Learningcited by 7
- 2022Invariance-Aware Randomized Smoothing Certificatescited by 7
- 2022Verified Probabilistic Policies for Deep Reinforcement Learningcited by 6
- 2022Certified Adversarial Robustness via Anisotropic Randomized Smoothingcited by 6
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systemscited by 6
- 2023Computational Tradeoffs of Optimization-Based Bound Tightening in ReLU Networkscited by 6
- 2024Certification of Speaker Recognition Models to Additive Perturbationscited by 6
- 2021Fast Training of Provably Robust Neural Networks by SinglePropcited by 5
- 2021Insta-RS: Instance-wise Randomized Smoothing for Improved Robustness and Accuracycited by 5
- 2022Are Transformers More Robust? Towards Exact Robustness Verification for Transformerscited by 5
- 2022BERN-NN: Tight Bound Propagation For Neural Networks Using Bernstein Polynomial Interval Arithmeticcited by 5
- 2022Probabilistic Verification of ReLU Neural Networks via Characteristic Functionscited by 5
- 2023A Certified Radius-Guided Attack Framework to Image Segmentation Modelscited by 5
50 most cited of 97 All 97 (JSON)
- 2026Input convex neural networks as surrogates in mathematical optimisation10 Aug 2026
- 2026Fast SDP certification of neural networks : towards large multi-class datasets3 Jul 2026
- 2026Characterizing the Discrete Geometry of ReLU Networks5 Jun 2026
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verification11 Dec 2025
- 2025Towards Strong Certified Defense with Universal Asymmetric Randomization22 Oct 2025
- 2025Efficient Neural Network Verification via Order Leading Exploration of Branch-and-Bound Trees23 Jul 2025
- 2025Neural Two-Stage Stochastic Optimization for Solving Unit Commitment Problem13 Jul 2025
- 2025Interior-Point Vanishing Problem in Semidefinite Relaxations for Neural Network Verification12 Jun 2025
- 2025Conformal Mixed-Integer Constraint Learning with Feasibility Guarantees4 Jun 2025
- 2025BenLOC: A Benchmark for Learning to Configure MIP Optimizers3 Jun 2025
- 2025Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogate4 May 2025
- 2025Adaptive Branch-and-Bound Tree Exploration for Neural Network Verification2 May 2025
38 more
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2025CeTAD: Towards Certified Toxicity-Aware Distance in Vision Language Models8 Mar 2025
- 2025Verification of Bit-Flip Attacks against Quantized Neural Networks22 Feb 2025
- 2025Formal Verification of Markov Processes with Learned Parameters27 Jan 2025
- 2024SAVER: A Toolbox for Sampling-Based, Probabilistic Verification of Neural Networks4 Dec 2024
- 2024Tightening convex relaxations of trained neural networks: a unified approach for convex and S-shaped activations30 Oct 2024
- 2024Detecting Brittle Decisions for Free: Leveraging Margin Consistency in Deep Robust Classifiers26 Jun 2024
- 2024Compact Proofs of Model Performance via Mechanistic Interpretability17 Jun 2024
- 2024Solving Probabilistic Verification Problems of Neural Networks using Branch and Bound27 May 2024
- 2024Certification of Speaker Recognition Models to Additive Perturbations29 Apr 2024
- 2024Estimating the Robustness Radius for Randomized Smoothing with 100× Sample Efficiency26 Apr 2024
- 2024A Survey of Neural Network Robustness Assessment in Image Recognition12 Apr 2024
- 2024Learning Minimal Neural Specifications6 Apr 2024
- 2024Adaptive Hierarchical Certification for Segmentation using Randomized Smoothing13 Feb 2024
- 2024Feed-Forward Neural Networks as a Mixed-Integer Program9 Feb 2024
- 2024Neur2BiLO: Neural Bilevel Optimization4 Feb 2024
- 2024Optimization Over Trained Neural Networks: Taking a Relaxing Walk7 Jan 2024
- 2024A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligence6 Jan 2024
- 2023Computational Tradeoffs of Optimization-Based Bound Tightening in ReLU Networks27 Dec 2023
- 2023Extending Neural Network Verification to a Larger Family of Piece-wise Linear Activation Functions16 Nov 2023
- 2023ABIGX: A Unified Framework for eXplainable Fault Detection and Classification9 Nov 2023
- 2023Deep Learning for Two-Stage Robust Integer Optimization6 Oct 2023
- 2023General Lipschitz: Certified Robustness Against Resolvable Semantic Transformations via Transformation-Dependent Randomized Smoothing17 Aug 2023
- 2023Safety Performance of Neural Networks in the Presence of Covariate Shift24 Jul 2023
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systems20 Jul 2023
- 2023Scaling Model Checking for DNN Analysis via State-Space Reduction and Input Segmentation (Extended Version)29 Jun 2023
- 2023When Deep Learning Meets Polyhedral Theory: A Survey29 Apr 2023
- 2023Certified Adversarial Robustness Within Multiple Perturbation Bounds20 Apr 2023
- 2023RNN-Guard: Certified Robustness Against Multi-frame Attacks for Recurrent Neural Networks17 Apr 2023
- 2023A Certified Radius-Guided Attack Framework to Image Segmentation Models5 Apr 2023
- 2023POLAR-Express: Efficient and Precise Formal Reachability Analysis of Neural-Network Controlled Systems31 Mar 2023
- 2023Tight Mixed-Integer Optimization Formulations for Prescriptive Trees28 Feb 2023
- 2023A Robust Optimisation Perspective on Counterexample-Guided Repair of Neural Networks26 Jan 2023
- 2023Learning To Dive In Branch And Bound24 Jan 2023
- 2023Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions19 Jan 2023
- 2022Optimized Symbolic Interval Propagation for Neural Network Verification15 Dec 2022
- 2022Automated Reachability Analysis of Neural Network-Controlled Systems via Adaptive Polytopes14 Dec 2022
- 2022QVIP: An ILP-based Formal Verification Approach for Quantized Neural Networks10 Dec 2022
50 newest of 97 All 97 (JSON)
- 2021Orthogonalizing Convolutional Layers with the Cayley Transformcited by 105
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 41
- 2021Learning a Large Neighborhood Search Algorithm for Mixed Integer Programscited by 41
- 2022Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspectivecited by 41
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 40
- 2021Partition-based formulations for mixed-integer optimization of trained ReLU neural networkscited by 39
- 2022How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspectivecited by 39
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 36
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2022An Abstraction-Refinement Approach to Verifying Convolutional Neural Networkscited by 24
- 2022Open- and Closed-Loop Neural Network Verification using Polynomial Zonotopescited by 24
12 most cited of 95 All 95 (JSON)
- 2026Input convex neural networks as surrogates in mathematical optimisation10 Aug 2026
- 2026Fast SDP certification of neural networks : towards large multi-class datasets3 Jul 2026
- 2026Characterizing the Discrete Geometry of ReLU Networks5 Jun 2026
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verification11 Dec 2025
- 2025Towards Strong Certified Defense with Universal Asymmetric Randomization22 Oct 2025
- 2025Efficient Neural Network Verification via Order Leading Exploration of Branch-and-Bound Trees23 Jul 2025
- 2025Neural Two-Stage Stochastic Optimization for Solving Unit Commitment Problem13 Jul 2025
- 2025Interior-Point Vanishing Problem in Semidefinite Relaxations for Neural Network Verification12 Jun 2025
- 2025Conformal Mixed-Integer Constraint Learning with Feasibility Guarantees4 Jun 2025
- 2025BenLOC: A Benchmark for Learning to Configure MIP Optimizers3 Jun 2025
- 2025Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogate4 May 2025
- 2025Adaptive Branch-and-Bound Tree Exploration for Neural Network Verification2 May 2025
12 newest of 95 All 95 (JSON)