Limitations of the Lipschitz constant as a defense against adversarial examples
Not on the map. Why?
Abstract (arXiv)
Several recent papers have discussed utilizing Lipschitz constants to limit the susceptibility of neural networks to adversarial examples. We analyze recently proposed methods for computing the Lipschitz constant. We show that the Lipschitz constant may indeed enable adversarially robust neural networks. However, the methods currently employed for computing it suffer from theoretical and practical limitations. We argue that addressing this shortcoming is a promising direction for future research into certified adversarial defenses.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 8; 2023: 11; 2024: 3; 2025: 3; 2026: 5.
48 papers.
Sort:
- 2021Globally-Robust Neural Networkscited by 106
- 2021Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networkscited by 73
- 2021Spectral Normalisation for Deep Reinforcement Learning: an Optimisation Perspectivecited by 64
- 2021Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Boundscited by 64
- 2022Rethinking Lipschitz Neural Networks and Certified Robustness: A Boolean Function Perspectivecited by 48
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
- 2021Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neuronscited by 40
- 2021On the Certified Robustness for Ensemble Models and Beyondcited by 40
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 40
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021Pay attention to your loss: understanding misconceptions about 1-Lipschitz neural networkscited by 30
- 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
36 more
- 2023Some Fundamental Aspects about Lipschitz Continuity of Neural Networkscited by 25
- 2021Boosting the Certified Robustness of L-infinity Distance Netscited by 24
- 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functionscited by 23
- 2022Approximation bounds for norm constrained neural networks with applications to regression and GANscited by 21
- 2021Learning Prediction Intervals for Regression: Generalization and Calibrationcited by 16
- 2021Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximationcited by 16
- 2022Approximation of Lipschitz Functions using Deep Spline Neural Networkscited by 15
- 2021Certifiably Robust Variational Autoencoderscited by 14
- 2025Probabilistic Stability Guarantees for Feature Attributionscited by 9
- 2023Expressive Monotonic Neural Networkscited by 7
- 2021Robust and Provably Monotonic Networkscited by 6
- 2024SpecFormer: Guarding Vision Transformer Robustness via Maximum Singular Value Penalizationcited by 5
- 2021On the Stochastic Stability of Deep Markov Modelscited by 4
- 2023Limitations of Piecewise Linearity for Efficient Robustness Certificationcited by 4
- 2023PDE+: Enhancing Generalization via PDE with Adaptive Distributional Diffusioncited by 3
- 2023Certified Robust Models with Slack Control and Large Lipschitz Constantscited by 3
- 2024A Wasserstein perspective of Vanilla GANscited by 3
- 2021Demotivate adversarial defense in remote sensingcited by 2
- 2023Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Controlcited by 2
- 2024Parseval Convolution Operators and Neural Networkscited by 2
- 2021ELF: Exact-Lipschitz Based Universal Density Approximator Flowcited by 1
- 2022Learning Distributions by Generative Adversarial Networks: Approximation and Generalizationcited by 1
- 2022Universal Time-Uniform Trajectory Approximation for Random Dynamical Systems with Recurrent Neural Networkscited by 1
- 2023Adversarial Sample Detection Through Neural Network Transport Dynamicscited by 1
- 2023Vacant Holes for Unsupervised Detection of the Outliers in Compact Latent Representationcited by 1
- 2023Resilient Graph Neural Networks: A Coupled Dynamical Systems Approachcited by 1
- 2025Deep P-Spline: Theory, Fast Tuning, and Applicationcited by 1
- 2025Stochastic Sample Approximations of (Local) Moduli of Continuitycited by 1
- 2026ExLipBaB: Exact Lipschitz Constant Computation for Piecewise Linear Neural Networkscited by 1
- 2021Approximating Probability Distributions by using Wasserstein Generative Adversarial Networkscited by 0
- 2022Sparse Polynomial Optimization: Theory and Practicecited by 0
- 2023On Continuity of Robust and Accurate Classifierscited by 0
- 2026Beyond Lipschitz: Data-Driven Robustness via Discrete Modulus of Continuitycited by 0
- 2026Robustness of neural networks to random noise perturbations of their inputscited by 0
- 2026LiD-GLM: Lipschitz-constrained Deep Generalized Linear Modelscited by 0
- 2026Error bounds in Sobolev norms for approximations with norm constrained ReLU neural networkscited by 0
- 2026Error bounds in Sobolev norms for approximations with norm constrained ReLU neural networks17 Sep 2026
- 2026LiD-GLM: Lipschitz-constrained Deep Generalized Linear Models17 Aug 2026
- 2026Robustness of neural networks to random noise perturbations of their inputs30 Jun 2026
- 2026Beyond Lipschitz: Data-Driven Robustness via Discrete Modulus of Continuity27 May 2026
- 2026ExLipBaB: Exact Lipschitz Constant Computation for Piecewise Linear Neural Networks17 Feb 2026
- 2025Stochastic Sample Approximations of (Local) Moduli of Continuity18 Sep 2025
- 2025Probabilistic Stability Guarantees for Feature Attributions18 Apr 2025
- 2025Deep P-Spline: Theory, Fast Tuning, and Application2 Jan 2025
- 2024Parseval Convolution Operators and Neural Networks19 Aug 2024
- 2024A Wasserstein perspective of Vanilla GANs22 Mar 2024
- 2024SpecFormer: Guarding Vision Transformer Robustness via Maximum Singular Value Penalization2 Jan 2024
- 2023Resilient Graph Neural Networks: A Coupled Dynamical Systems Approach12 Nov 2023
36 more
- 2023Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control5 Oct 2023
- 2023On Continuity of Robust and Accurate Classifiers29 Sep 2023
- 2023Certified Robust Models with Slack Control and Large Lipschitz Constants12 Sep 2023
- 2023Expressive Monotonic Neural Networks14 Jul 2023
- 2023Vacant Holes for Unsupervised Detection of the Outliers in Compact Latent Representation16 Jun 2023
- 2023Adversarial Sample Detection Through Neural Network Transport Dynamics7 Jun 2023
- 2023PDE+: Enhancing Generalization via PDE with Adaptive Distributional Diffusion25 May 2023
- 2023When Deep Learning Meets Polyhedral Theory: A Survey29 Apr 2023
- 2023Some Fundamental Aspects about Lipschitz Continuity of Neural Networks21 Feb 2023
- 2023Limitations of Piecewise Linearity for Efficient Robustness Certification21 Jan 2023
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problems22 Nov 2022
- 2022Universal Time-Uniform Trajectory Approximation for Random Dynamical Systems with Recurrent Neural Networks15 Nov 2022
- 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions28 Oct 2022
- 2022Rethinking Lipschitz Neural Networks and Certified Robustness: A Boolean Function Perspective4 Oct 2022
- 2022Sparse Polynomial Optimization: Theory and Practice23 Aug 2022
- 2022Learning Distributions by Generative Adversarial Networks: Approximation and Generalization25 May 2022
- 2022Approximation of Lipschitz Functions using Deep Spline Neural Networks13 Apr 2022
- 2022Approximation bounds for norm constrained neural networks with applications to regression and GANs24 Jan 2022
- 2021ELF: Exact-Lipschitz Based Universal Density Approximator Flow13 Dec 2021
- 2021Robust and Provably Monotonic Networks30 Nov 2021
- 2021On the Stochastic Stability of Deep Markov Models8 Nov 2021
- 2021Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds2 Nov 2021
- 2021Boosting the Certified Robustness of L-infinity Distance Nets13 Oct 2021
- 2021Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networks7 Oct 2021
- 2021Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximation27 Sep 2021
- 2021On the Certified Robustness for Ensemble Models and Beyond22 Jul 2021
- 2021Demotivate adversarial defense in remote sensing28 May 2021
- 2021Spectral Normalisation for Deep Reinforcement Learning: an Optimisation Perspective11 May 2021
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustness13 Apr 2021
- 2021Pay attention to your loss: understanding misconceptions about 1-Lipschitz neural networks11 Apr 2021
- 2021CLIP: Cheap Lipschitz Training of Neural Networks23 Mar 2021
- 2021Approximating Probability Distributions by using Wasserstein Generative Adversarial Networks18 Mar 2021
- 2021Learning Prediction Intervals for Regression: Generalization and Calibration26 Feb 2021
- 2021Globally-Robust Neural Networks16 Feb 2021
- 2021Certifiably Robust Variational Autoencoders15 Feb 2021
- 2021Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neurons10 Feb 2021
- 2021Globally-Robust Neural Networkscited by 106
- 2021Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networkscited by 73
- 2021Spectral Normalisation for Deep Reinforcement Learning: an Optimisation Perspectivecited by 64
- 2021Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Boundscited by 64
- 2022Rethinking Lipschitz Neural Networks and Certified Robustness: A Boolean Function Perspectivecited by 48
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
- 2021Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neuronscited by 40
- 2021On the Certified Robustness for Ensemble Models and Beyondcited by 40
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 40
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2021Pay attention to your loss: understanding misconceptions about 1-Lipschitz neural networkscited by 30
- 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
12 most cited of 48 All 48 (JSON)
- 2026Error bounds in Sobolev norms for approximations with norm constrained ReLU neural networks17 Sep 2026
- 2026LiD-GLM: Lipschitz-constrained Deep Generalized Linear Models17 Aug 2026
- 2026Robustness of neural networks to random noise perturbations of their inputs30 Jun 2026
- 2026Beyond Lipschitz: Data-Driven Robustness via Discrete Modulus of Continuity27 May 2026
- 2026ExLipBaB: Exact Lipschitz Constant Computation for Piecewise Linear Neural Networks17 Feb 2026
- 2025Stochastic Sample Approximations of (Local) Moduli of Continuity18 Sep 2025
- 2025Probabilistic Stability Guarantees for Feature Attributions18 Apr 2025
- 2025Deep P-Spline: Theory, Fast Tuning, and Application2 Jan 2025
- 2024Parseval Convolution Operators and Neural Networks19 Aug 2024
- 2024A Wasserstein perspective of Vanilla GANs22 Mar 2024
- 2024SpecFormer: Guarding Vision Transformer Robustness via Maximum Singular Value Penalization2 Jan 2024
- 2023Resilient Graph Neural Networks: A Coupled Dynamical Systems Approach12 Nov 2023
12 newest of 48 All 48 (JSON)