A Domain-Theoretic Framework for Robustness Analysis of Neural Networks
Not on the map. Why?
Abstract (arXiv)
A domain-theoretic framework is presented for validated robustness analysis of neural networks. First, global robustness of a general class of networks is analyzed. Then, using the fact that Edalat's domain-theoretic L-derivative coincides with Clarke's generalized gradient, the framework is extended for attack-agnostic local robustness analysis. The proposed framework is ideal for designing algorithms which are correct by construction. This claim is exemplified by developing a validated algorithm for estimation of Lipschitz constant of feedforward regressors. The completeness of the algorithm is proved over differentiable networks, and also over general position ReLU networks. Computability results are obtained within the framework of effectively given domains. Using the proposed domain model, differentiable and non-differentiable networks can be analyzed uniformly. The validated algorithm is implemented using arbitrary-precision interval arithmetic, and the results of some experiments are presented. The software implementation is truly validated, as it handles floating-point errors as well.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 98 references that are in the map. First posted on arXiv 1 Mar 2022.
Builds on
26 of 98 references.
References · 26
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 564
- 2019Benign Overfitting in Linear Regressioncited by 544
- 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
- 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 290
- 2018Towards Fast Computation of Certified Robustness for ReLU Networkscited by 254
- 2018Formal Security Analysis of Neural Networks using Symbolic Intervalscited by 185
- 2017Formal Guarantees on the Robustness of a Classifier against Adversarial Manipulationcited by 182
- 2018Evaluating the Robustness of Neural Networks: An Extreme Value Theory Approachcited by 181
- 2021Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolationcited by 130
14 more
- 2019Harmless interpolation of noisy data in regressioncited by 121
- 2020Exactly Computing the Local Lipschitz Constant of ReLU Networkscited by 102
- 2020Training robust neural networks using Lipschitz boundscited by 98
- 2019Wasserstein Adversarial Examples via Projected Sinkhorn Iterationscited by 89
- 2020Lipschitz constant estimation of Neural Networks via sparse polynomial optimizationcited by 87
- 2019POPQORN: Quantifying Robustness of Recurrent Neural Networkscited by 36
- 2020Exploiting Verified Neural Networks via Floating Point Numerical Errorcited by 35
- 2020Abstraction based Output Range Analysis for Neural Networkscited by 34
- 2020Adversarial Examples on Object Recognition: A Comprehensive Surveycited by 23
- 2020Certifying Incremental Quadratic Constraints for Neural Networks via Convex Optimizationcited by 17
- 2021LipBaB: Computing exact Lipschitz constant of ReLU networkscited by 16
- 2020Abstract Neural Networkscited by 11
- 2021Provable Lipschitz Certification for Generative Modelscited by 7
- 2017Safe & Robust Reachability Analysis of Hybrid Systemscited by 2
Built on by
Not cited yet.