Jacobian Adversarially Regularized Networks for Robustness
Not on the map. Why?
Abstract (arXiv)
Adversarial examples are crafted with imperceptible perturbations with the intent to fool neural networks. Against such attacks, adversarial training and its variants stand as the strongest defense to date. Previous studies have pointed out that robust models that have undergone adversarial training tend to produce more salient and interpretable Jacobian matrices than their non-robust counterparts. A natural question is whether a model trained with an objective to produce salient Jacobian can result in better robustness. This paper answers this question with affirmative empirical results. We propose Jacobian Adversarially Regularized Networks (JARN) as a method to optimize the saliency of a classifier's Jacobian by adversarially regularizing the model's Jacobian to resemble natural training images. Image classifiers trained with JARN show improved robust accuracy compared to standard models on the MNIST, SVHN and CIFAR-10 datasets, uncovering a new angle to boost robustness without using adversarial training examples.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 14; 2023: 10; 2024: 3; 2025: 3; 2026: 3.
40 papers.
Sort:
By area:
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Fair Mixup: Fairness via Interpolationcited by 109
- 2022Robustness and Accuracy Could Be Reconcilable by (Proper) Definitioncited by 109
- 2022DISCO: Adversarial Defense with Local Implicit Functionscited by 33
- 2023Why Does Little Robustness Help? A Further Step Towards Understanding Adversarial Transferabilitycited by 32
- 2021Attacking Adversarial Attacks as A Defensecited by 31
- 2023Improving Generalization of Adversarial Training via Robust Critical Fine-Tuningcited by 23
- 2023Adversarial Training Should Be Cast as a Non-Zero-Sum Gamecited by 13
- 2024Gradient-Regularized Out-of-Distribution Detectioncited by 13
- 2022How Does Frequency Bias Affect the Robustness of Neural Image Classifiers against Common Corruption and Adversarial Perturbations?cited by 11
- 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoisercited by 11
- 2023Exact Count of Boundary Pieces of ReLU Classifiers: Towards the Proper Complexity Measure for Classificationcited by 11
28 more
- 2021Improving Model Robustness with Latent Distribution Locally and Globallycited by 9
- 2021Impact of Spatial Frequency Based Constraints on Adversarial Robustnesscited by 8
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunitiescited by 8
- 2024Machine Learning Robustness: A Primercited by 8
- 2022A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challengescited by 7
- 2023Towards Robust and Accurate Visual Promptingcited by 5
- 2021Get Fooled for the Right Reason: Improving Adversarial Robustness through a Teacher-guided Curriculum Learning Approachcited by 4
- 2022Toward Robust Diagnosis: A Contour Attention Preserving Adversarial Defense for COVID-19 Detectioncited by 3
- 2022Layer-wise Regularized Adversarial Training using Layers Sustainability Analysis (LSA) frameworkcited by 2
- 2022Training-Free Robust Multimodal Learning via Sample-Wise Jacobian Regularizationcited by 2
- 2022Jacobian Norm with Selective Input Gradient Regularization for Improved and Interpretable Adversarial Defensecited by 2
- 2022Data-free Defense of Black Box Models Against Adversarial Attackscited by 2
- 2025GrokAlign: Geometric Characterisation and Acceleration of Grokkingcited by 2
- 2022Bandwidth Selection for Gaussian Kernel Ridge Regression via Jacobian Controlcited by 1
- 2022DE-CROP: Data-efficient Certified Robustness for Pretrained Classifierscited by 1
- 2023Fourier Sensitivity and Regularization of Computer Vision Modelscited by 1
- 2023IRAD: Implicit Representation-driven Image Resampling against Adversarial Attackscited by 1
- 2024Adversarially robust generalization theory via Jacobian regularization for deep neural networkscited by 1
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)cited by 1
- 2021Noise Modulation: Let Your Model Interpret Itselfcited by 0
- 2022DAD: Data-free Adversarial Defense at Test Timecited by 0
- 2022Robust Few-shot Learning Without Using any Adversarial Samplescited by 0
- 2023DAD++: Improved Data-free Test Time Adversarial Defensecited by 0
- 2023Training Image Derivatives: Increased Accuracy and Universal Robustnesscited by 0
- 2025Exploring Visual Prompting: Robustness Inheritance and Beyondcited by 0
- 2026Quadratic Upper Bound for Boosting Robustnesscited by 0
- 2026On Adversarial Vulnerability of Vision-Language Models through the Lens of Intermediate Spectral Subspacescited by 0
- 2026Interleaved Noise Injection Improves Clean, Corrupted, and OOD Performancecited by 0
- 2026Interleaved Noise Injection Improves Clean, Corrupted, and OOD Performance16 Jul 2026
- 2026On Adversarial Vulnerability of Vision-Language Models through the Lens of Intermediate Spectral Subspaces8 Jul 2026
- 2026Quadratic Upper Bound for Boosting Robustness20 Jan 2026
- 2025GrokAlign: Geometric Characterisation and Acceleration of Grokking14 Jun 2025
- 2025Exploring Visual Prompting: Robustness Inheritance and Beyond7 Jun 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2024Adversarially robust generalization theory via Jacobian regularization for deep neural networks17 Dec 2024
- 2024Gradient-Regularized Out-of-Distribution Detection18 Apr 2024
- 2024Machine Learning Robustness: A Primer1 Apr 2024
- 2023Towards Robust and Accurate Visual Prompting18 Nov 2023
- 2023Training Image Derivatives: Increased Accuracy and Universal Robustness21 Oct 2023
- 2023IRAD: Implicit Representation-driven Image Resampling against Adversarial Attacks18 Oct 2023
28 more
- 2023DAD++: Improved Data-free Test Time Adversarial Defense10 Sep 2023
- 2023Improving Generalization of Adversarial Training via Robust Critical Fine-Tuning1 Aug 2023
- 2023Why Does Little Robustness Help? A Further Step Towards Understanding Adversarial Transferability15 Jul 2023
- 2023Adversarial Training Should Be Cast as a Non-Zero-Sum Game19 Jun 2023
- 2023Exact Count of Boundary Pieces of ReLU Classifiers: Towards the Proper Complexity Measure for Classification15 Jun 2023
- 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoiser13 Apr 2023
- 2023Fourier Sensitivity and Regularization of Computer Vision Models31 Jan 2023
- 2022DISCO: Adversarial Defense with Local Implicit Functions11 Dec 2022
- 2022Toward Robust Diagnosis: A Contour Attention Preserving Adversarial Defense for COVID-19 Detection30 Nov 2022
- 2022Robust Few-shot Learning Without Using any Adversarial Samples3 Nov 2022
- 2022Data-free Defense of Black Box Models Against Adversarial Attacks3 Nov 2022
- 2022DE-CROP: Data-efficient Certified Robustness for Pretrained Classifiers17 Oct 2022
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities17 Oct 2022
- 2022Jacobian Norm with Selective Input Gradient Regularization for Improved and Interpretable Adversarial Defense9 Jul 2022
- 2022Bandwidth Selection for Gaussian Kernel Ridge Regression via Jacobian Control24 May 2022
- 2022How Does Frequency Bias Affect the Robustness of Neural Image Classifiers against Common Corruption and Adversarial Perturbations?9 May 2022
- 2022A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challenges8 May 2022
- 2022Training-Free Robust Multimodal Learning via Sample-Wise Jacobian Regularization5 Apr 2022
- 2022DAD: Data-free Adversarial Defense at Test Time4 Apr 2022
- 2022Robustness and Accuracy Could Be Reconcilable by (Proper) Definition21 Feb 2022
- 2022Layer-wise Regularized Adversarial Training using Layers Sustainability Analysis (LSA) framework5 Feb 2022
- 2021Get Fooled for the Right Reason: Improving Adversarial Robustness through a Teacher-guided Curriculum Learning Approach30 Oct 2021
- 2021Advances in adversarial attacks and defenses in computer vision: A survey1 Aug 2021
- 2021Improving Model Robustness with Latent Distribution Locally and Globally8 Jul 2021
- 2021Attacking Adversarial Attacks as A Defense9 Jun 2021
- 2021Impact of Spatial Frequency Based Constraints on Adversarial Robustness26 Apr 2021
- 2021Noise Modulation: Let Your Model Interpret Itself19 Mar 2021
- 2021Fair Mixup: Fairness via Interpolation11 Mar 2021
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Fair Mixup: Fairness via Interpolationcited by 109
- 2022Robustness and Accuracy Could Be Reconcilable by (Proper) Definitioncited by 109
- 2022DISCO: Adversarial Defense with Local Implicit Functionscited by 33
- 2023Why Does Little Robustness Help? A Further Step Towards Understanding Adversarial Transferabilitycited by 32
- 2021Attacking Adversarial Attacks as A Defensecited by 31
- 2023Improving Generalization of Adversarial Training via Robust Critical Fine-Tuningcited by 23
- 2023Adversarial Training Should Be Cast as a Non-Zero-Sum Gamecited by 13
- 2024Gradient-Regularized Out-of-Distribution Detectioncited by 13
- 2022How Does Frequency Bias Affect the Robustness of Neural Image Classifiers against Common Corruption and Adversarial Perturbations?cited by 11
- 2023Certified Zeroth-order Black-Box Defense with Robust UNet Denoisercited by 11
- 2023Exact Count of Boundary Pieces of ReLU Classifiers: Towards the Proper Complexity Measure for Classificationcited by 11
12 most cited of 39 All 39 (JSON)
- 2026Interleaved Noise Injection Improves Clean, Corrupted, and OOD Performance16 Jul 2026
- 2026Quadratic Upper Bound for Boosting Robustness20 Jan 2026
- 2025GrokAlign: Geometric Characterisation and Acceleration of Grokking14 Jun 2025
- 2025Exploring Visual Prompting: Robustness Inheritance and Beyond7 Jun 2025
- 2025Adversarial Examples in Environment Perception for Automated Driving (Review)11 Apr 2025
- 2024Adversarially robust generalization theory via Jacobian regularization for deep neural networks17 Dec 2024
- 2024Gradient-Regularized Out-of-Distribution Detection18 Apr 2024
- 2024Machine Learning Robustness: A Primer1 Apr 2024
- 2023Towards Robust and Accurate Visual Prompting18 Nov 2023
- 2023Training Image Derivatives: Increased Accuracy and Universal Robustness21 Oct 2023
- 2023IRAD: Implicit Representation-driven Image Resampling against Adversarial Attacks18 Oct 2023
- 2023DAD++: Improved Data-free Test Time Adversarial Defense10 Sep 2023
12 newest of 39 All 39 (JSON)