On Lipschitz Bounds of General Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
Many convolutional neural networks (CNNs) have a feed-forward structure. In this paper, a linear program that estimates the Lipschitz bound of such CNNs is proposed. Several CNNs, including the scattering networks, the AlexNet and the GoogleNet, are studied numerically and compared to the theoretical bounds. Next, concentration inequalities of the output distribution to a stationary random input signal expressed in terms of the Lipschitz bound are established. The Lipschitz bound is further used to establish a nonlinear discriminant analysis designed to measure the separation between features of different classes.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 5; 2023: 7; 2024: 3; 2025: 0; 2026: 3.
29 papers.
Sort:
- 2021Globally-Robust Neural Networkscited by 106
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021Learning Frequency Domain Approximation for Binary Neural Networkscited by 38
- 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
- 2022Group-invariant max filteringcited by 18
- 2021Convergence of Deep ReLU Networkscited by 14
- 2021Analytical bounds on the local Lipschitz constants of ReLU networkscited by 12
- 2021Connections between Numerical Algorithms for PDEs and Neural Networkscited by 10
- 2024Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibriumcited by 9
- 2023Importance of Smoothness Induced by Optimizers in FL4ASR: Towards Understanding Federated Learning for End-to-End ASRcited by 8
- 2021Convergence Guarantees for Deep Epsilon Greedy Policy Learningcited by 6
- 2021What training reveals about neural network complexitycited by 5
17 more
- 2023Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widthscited by 5
- 2023Multi-Grade Deep Learning for Partial Differential Equations with Applications to the Burgers Equationcited by 5
- 2022Stability of the scattering transform for deformations with minimal regularitycited by 3
- 2022On the sensitivity of pose estimation neural networks: rotation parameterizations, Lipschitz constants, and provable boundscited by 2
- 2022On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networkscited by 2
- 2023Uncertainty Estimation and Out-of-Distribution Detection for Deep Learning-Based Image Reconstruction using the Local Lipschitzcited by 2
- 2024Analyzing Neural Network Robustness Using Graph Curvaturecited by 2
- 2021Generalized moduli of continuity under irregular or random deformations via multiscale analysiscited by 1
- 2021GraN-GAN: Piecewise Gradient Normalization for Generative Adversarial Networkscited by 1
- 2023Transferability of Convolutional Neural Networks in Stationary Learning Taskscited by 1
- 2024Lipschitz-Driven Noise Robustness in VQ-AE for High-Frequency Texture Repair in ID-Specific Talking Headscited by 1
- 2026Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimizationcited by 1
- 2021On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversioncited by 0
- 2022Optimal Transport for Super Resolution Applied to Astronomy Imagingcited by 0
- 2023Promoting Fairness in GNNs: A Characterization of Stabilitycited by 0
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networkscited by 0
- 2026General Quantification of Covariate and Concept Shiftscited by 0
- 2026General Quantification of Covariate and Concept Shifts10 Sep 2026
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networks10 May 2026
- 2026Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization5 Feb 2026
- 2024Analyzing Neural Network Robustness Using Graph Curvature25 Oct 2024
- 2024Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibrium21 Oct 2024
- 2024Lipschitz-Driven Noise Robustness in VQ-AE for High-Frequency Texture Repair in ID-Specific Talking Heads1 Oct 2024
- 2023Importance of Smoothness Induced by Optimizers in FL4ASR: Towards Understanding Federated Learning for End-to-End ASR22 Sep 2023
- 2023Multi-Grade Deep Learning for Partial Differential Equations with Applications to the Burgers Equation14 Sep 2023
- 2023Promoting Fairness in GNNs: A Characterization of Stability7 Sep 2023
- 2023Transferability of Convolutional Neural Networks in Stationary Learning Tasks21 Jul 2023
- 2023Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widths2 Jun 2023
- 2023Uncertainty Estimation and Out-of-Distribution Detection for Deep Learning-Based Image Reconstruction using the Local Lipschitz12 May 2023
17 more
- 2023When Deep Learning Meets Polyhedral Theory: A Survey29 Apr 2023
- 2022On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networks19 Sep 2022
- 2022Group-invariant max filtering27 May 2022
- 2022Stability of the scattering transform for deformations with minimal regularity23 May 2022
- 2022On the sensitivity of pose estimation neural networks: rotation parameterizations, Lipschitz constants, and provable bounds16 Mar 2022
- 2022Optimal Transport for Super Resolution Applied to Astronomy Imaging10 Feb 2022
- 2021Convergence Guarantees for Deep Epsilon Greedy Policy Learning2 Dec 2021
- 2021On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion28 Nov 2021
- 2021GraN-GAN: Piecewise Gradient Normalization for Generative Adversarial Networks4 Nov 2021
- 2021Connections between Numerical Algorithms for PDEs and Neural Networks30 Jul 2021
- 2021Convergence of Deep ReLU Networks27 Jul 2021
- 2021What training reveals about neural network complexity8 Jun 2021
- 2021Analytical bounds on the local Lipschitz constants of ReLU networks29 Apr 2021
- 2021Generalized moduli of continuity under irregular or random deformations via multiscale analysis24 Apr 2021
- 2021CLIP: Cheap Lipschitz Training of Neural Networks23 Mar 2021
- 2021Learning Frequency Domain Approximation for Binary Neural Networks1 Mar 2021
- 2021Globally-Robust Neural Networks16 Feb 2021
- 2021Globally-Robust Neural Networkscited by 106
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021Learning Frequency Domain Approximation for Binary Neural Networkscited by 38
- 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
- 2022Group-invariant max filteringcited by 18
- 2021Convergence of Deep ReLU Networkscited by 14
- 2021Analytical bounds on the local Lipschitz constants of ReLU networkscited by 12
- 2021Connections between Numerical Algorithms for PDEs and Neural Networkscited by 10
- 2024Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibriumcited by 9
- 2023Importance of Smoothness Induced by Optimizers in FL4ASR: Towards Understanding Federated Learning for End-to-End ASRcited by 8
- 2021Convergence Guarantees for Deep Epsilon Greedy Policy Learningcited by 6
- 2021What training reveals about neural network complexitycited by 5
12 most cited of 29 All 29 (JSON)
- 2026General Quantification of Covariate and Concept Shifts10 Sep 2026
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networks10 May 2026
- 2026Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization5 Feb 2026
- 2024Analyzing Neural Network Robustness Using Graph Curvature25 Oct 2024
- 2024Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibrium21 Oct 2024
- 2024Lipschitz-Driven Noise Robustness in VQ-AE for High-Frequency Texture Repair in ID-Specific Talking Heads1 Oct 2024
- 2023Importance of Smoothness Induced by Optimizers in FL4ASR: Towards Understanding Federated Learning for End-to-End ASR22 Sep 2023
- 2023Multi-Grade Deep Learning for Partial Differential Equations with Applications to the Burgers Equation14 Sep 2023
- 2023Promoting Fairness in GNNs: A Characterization of Stability7 Sep 2023
- 2023Transferability of Convolutional Neural Networks in Stationary Learning Tasks21 Jul 2023
- 2023Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widths2 Jun 2023
- 2023Uncertainty Estimation and Out-of-Distribution Detection for Deep Learning-Based Image Reconstruction using the Local Lipschitz12 May 2023
12 newest of 29 All 29 (JSON)