Certified and accurate computation of function space norms of deep neural networks
Not on the map. Why?
Abstract (arXiv)
Neural network methods for PDEs require reliable error control in function space norms. However, trained neural networks can typically only be probed at a finite number of point values. Without strong assumptions, point evaluations alone do not provide enough information to derive tight deterministic and guaranteed bounds on function space norms. In this work, we move beyond a purely black-box setting and exploit the neural network structure directly. We present a framework for the certified and accurate computation of integral quantities of neural networks, including Lebesgue and Sobolev norms, by combining interval arithmetic enclosures on axis-aligned boxes with adaptive marking/refinement and quadrature-based aggregation. On each box, we compute guaranteed lower and upper bounds for function values and derivatives, and propagate these local certificates to global lower and upper bounds for the target integrals. Our analysis provides a general convergence theorem for such certified adaptive quadrature procedures and instantiates it for function values, Jacobians, and Hessians, yielding certified computation of Lp, W1,p, and W2,p norms. We further show how these ingredients lead to practical certified bounds for PINN interior residuals. Numerical experiments illustrate the accuracy and practical behavior of the proposed methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 68 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
31 of 68 references.
References · 31
- 2017Spectrally-normalized margin bounds for neural networkscited by 686
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 567
- 2018Efficient Neural Network Robustness Certification with General Activation Functionscited by 445
- 2018On the Effectiveness of Interval Bound Propagation for Training Verifiably Robust Modelscited by 328
- 2017A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networkscited by 314
- 2015Norm-Based Capacity Control in Neural Networkscited by 299
- 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 293
- 2018Towards Fast Computation of Certified Robustness for ReLU Networkscited by 255
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 242
- 2018Formal Security Analysis of Neural Networks using Symbolic Intervalscited by 185
- 2019Deep ReLU Networks Have Surprisingly Few Activation Patternscited by 161
19 more
- 2019Branch and Bound for Piecewise Linear Neural Network Verificationcited by 138
- 2022General Cutting Planes for Bound-Propagation-Based Neural Network Verificationcited by 103
- 2019Error bounds for approximations with deep ReLU neural networks in Ws,p normscited by 95
- 2022Complete Verification via Multi-Neuron Relaxation Guided Branch-and-Boundcited by 92
- 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
- 2021Characterization of the Variation Spaces Corresponding to Shallow Neural Networkscited by 48
- 2024Neural Network Verification with Branch-and-Bound for General Nonlinearitiescited by 47
- 2022Efficiently Computing Local Lipschitz Constants of Neural Networks via Bound Propagationcited by 45
- 2020Second-Order Provable Defenses against Adversarial Attackscited by 40
- 2019The Barron Space and the Flow-induced Function Spaces for Neural Network Modelscited by 39
- 2021Proof of the Theory-to-Practice Gap in Deep Learning via Sampling Complexity bounds for Neural Network Approximation Spacescited by 30
- 2018RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applicationscited by 27
- 2021Probabilistic Verification of Neural Networks Against Group Fairnesscited by 17
- 2021Variational Physics Informed Neural Networks: the role of quadratures and test functionscited by 17
- 2022Certified machine learning: A posteriori error estimation for physics-informed neural networkscited by 15
- 2024Compositional Curvature Bounds for Deep Neural Networkscited by 4
- 2023Certified Invertibility in Neural Networks via Mixed-Integer Programmingcited by 3
- 2024Provable Bounds on the Hessian of Neural Networks: Derivative-Preserving Reachability Analysiscited by 3
- 2024Make Interval Bound Propagation great againcited by 1
Built on by
Not cited yet.