Lipschitz regularized Deep Neural Networks generalize and are adversarially robust
Not on the map. Why?
Abstract (arXiv)
In this work we study input gradient regularization of deep neural networks, and demonstrate that such regularization leads to generalization proofs and improved adversarial robustness. The proof of generalization does not overcome the curse of dimensionality, but it is independent of the number of layers in the networks. The adversarial robustness regularization combines adversarial training, which we show to be equivalent to Total Variation regularization, with Lipschitz regularization. We demonstrate empirically that the regularized models are more robust, and that gradient norms of images can be used for attack detection.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 3; 2023: 2; 2024: 5; 2025: 1.
19 papers.
Sort:
By area:
- 2022Learning Smooth Neural Functions via Lipschitz Regularizationcited by 86
- 2021On Linear Stability of SGD and Input-Smoothness of Neural Networkscited by 63
- 2021A Deep Value-network Based Approach for Multi-Driver Order Dispatchingcited by 45
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothnesscited by 38
- 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
- 2024LLM-Empowered State Representation for Reinforcement Learningcited by 28
- 2023Exploring Active 3D Object Detection from a Generalization Perspectivecited by 26
- 2022A Lagrangian Duality Approach to Active Learningcited by 24
- 2024Ferrari: Federated Feature Unlearning via Optimizing Feature Sensitivitycited by 11
- 2024End-to-End Cost-Effective Incentive Recommendation under Budget Constraint with Uplift Modelingcited by 10
- 2021What training reveals about neural network complexitycited by 5
- 2022Learning Globally Smooth Functions on Manifoldscited by 4
7 more
- 2024A Tunable Despeckling Neural Network Stabilized via Diffusion Equationcited by 2
- 2021Depthwise Separable Convolutions Allow for Fast and Memory-Efficient Spectral Normalizationcited by 1
- 2021A Neural Network Ensemble Approach to System Identificationcited by 1
- 2021Recoding latent sentence representations -- Dynamic gradient-based activation modification in RNNscited by 0
- 2023Open-CRB: Towards Open World Active Learning for 3D Object Detectioncited by 0
- 2024Enhancing robustness of data-driven SHM models: adversarial training with circle losscited by 0
- 2025GemiRec: Interest Quantization and Generation for Multi-Interest Recommendationcited by 0
- 2025GemiRec: Interest Quantization and Generation for Multi-Interest Recommendation16 Oct 2025
- 2024A Tunable Despeckling Neural Network Stabilized via Diffusion Equation24 Nov 2024
- 2024End-to-End Cost-Effective Incentive Recommendation under Budget Constraint with Uplift Modeling21 Aug 2024
- 2024LLM-Empowered State Representation for Reinforcement Learning18 Jul 2024
- 2024Enhancing robustness of data-driven SHM models: adversarial training with circle loss20 Jun 2024
- 2024Ferrari: Federated Feature Unlearning via Optimizing Feature Sensitivity23 May 2024
- 2023Open-CRB: Towards Open World Active Learning for 3D Object Detection16 Oct 2023
- 2023Exploring Active 3D Object Detection from a Generalization Perspective23 Jan 2023
- 2022Learning Globally Smooth Functions on Manifolds1 Oct 2022
- 2022Learning Smooth Neural Functions via Lipschitz Regularization16 Feb 2022
- 2022A Lagrangian Duality Approach to Active Learning8 Feb 2022
- 2021A Neural Network Ensemble Approach to System Identification15 Oct 2021
7 more
- 2021A Deep Value-network Based Approach for Multi-Driver Order Dispatching8 Jun 2021
- 2021What training reveals about neural network complexity8 Jun 2021
- 2021On Linear Stability of SGD and Input-Smoothness of Neural Networks27 May 2021
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothness1 Apr 2021
- 2021CLIP: Cheap Lipschitz Training of Neural Networks23 Mar 2021
- 2021Depthwise Separable Convolutions Allow for Fast and Memory-Efficient Spectral Normalization12 Feb 2021
- 2021Recoding latent sentence representations -- Dynamic gradient-based activation modification in RNNs3 Jan 2021
- 2022Learning Smooth Neural Functions via Lipschitz Regularizationcited by 86
- 2021On Linear Stability of SGD and Input-Smoothness of Neural Networkscited by 63
- 2021A Deep Value-network Based Approach for Multi-Driver Order Dispatchingcited by 45
- 2021TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothnesscited by 38
- 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
- 2024LLM-Empowered State Representation for Reinforcement Learningcited by 28
- 2023Exploring Active 3D Object Detection from a Generalization Perspectivecited by 26
- 2022A Lagrangian Duality Approach to Active Learningcited by 24
- 2024End-to-End Cost-Effective Incentive Recommendation under Budget Constraint with Uplift Modelingcited by 10
- 2021What training reveals about neural network complexitycited by 5
- 2022Learning Globally Smooth Functions on Manifoldscited by 4
- 2024A Tunable Despeckling Neural Network Stabilized via Diffusion Equationcited by 2
12 most cited of 18 All 18 (JSON)
- 2025GemiRec: Interest Quantization and Generation for Multi-Interest Recommendation16 Oct 2025
- 2024A Tunable Despeckling Neural Network Stabilized via Diffusion Equation24 Nov 2024
- 2024End-to-End Cost-Effective Incentive Recommendation under Budget Constraint with Uplift Modeling21 Aug 2024
- 2024LLM-Empowered State Representation for Reinforcement Learning18 Jul 2024
- 2024Enhancing robustness of data-driven SHM models: adversarial training with circle loss20 Jun 2024
- 2023Open-CRB: Towards Open World Active Learning for 3D Object Detection16 Oct 2023
- 2023Exploring Active 3D Object Detection from a Generalization Perspective23 Jan 2023
- 2022Learning Globally Smooth Functions on Manifolds1 Oct 2022
- 2022Learning Smooth Neural Functions via Lipschitz Regularization16 Feb 2022
- 2022A Lagrangian Duality Approach to Active Learning8 Feb 2022
- 2021A Neural Network Ensemble Approach to System Identification15 Oct 2021
- 2021A Deep Value-network Based Approach for Multi-Driver Order Dispatching8 Jun 2021
12 newest of 18 All 18 (JSON)