Metric Learning for Adversarial Robustness
Not on the map. Why?
Abstract (arXiv)
Deep networks are well-known to be fragile to adversarial attacks. We conduct an empirical analysis of deep representations under the state-of-the-art attack method called PGD, and find that the attack causes the internal representation to shift closer to the "false" class. Motivated by this observation, we propose to regularize the representation space under attack with metric learning to produce more robust classifiers. By carefully sampling examples for metric learning, our learned representation not only increases robustness, but also detects previously unseen adversarial samples. Quantitative experiments show improvement of robustness accuracy by up to 4% and detection efficiency by up to 6% according to Area Under Curve score over prior work. The code of our work is available at https://github.com/columbia/Metric_Learning_Adversarial_Robustness.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 21; 2023: 21; 2024: 10; 2025: 2; 2026: 1.
77 papers.
Sort:
By area:
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 276
- 2023Better Diffusion Models Further Improve Adversarial Trainingcited by 207
- 2024Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Modelscited by 119
- 2022Understanding Zero-Shot Adversarial Robustness for Large-Scale Modelscited by 117
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 65
- 2021Exploring Memorization in Adversarial Trainingcited by 55
- 2021Adversarial Robustness under Long-Tailed Distributioncited by 50
- 2021Adversarial Attacks are Reversible with Natural Supervisioncited by 47
- 2021Online Adversarial Purification based on Self-Supervisioncited by 45
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
- 2022Enhancing Adversarial Training with Second-Order Statistics of Weightscited by 42
- 2022Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overviewcited by 37
38 more
- 2022DISCO: Adversarial Defense with Local Implicit Functionscited by 33
- 2023Randomized Adversarial Training via Taylor Expansioncited by 28
- 2023Language-Driven Anchors for Zero-Shot Adversarial Robustnesscited by 23
- 2022The Enemy of My Enemy is My Friend: Exploring Inverse Adversaries for Improving Adversarial Trainingcited by 22
- 2021SPADE: A Spectral Method for Black-Box Adversarial Robustness Evaluationcited by 16
- 2022Landscape Learning for Neural Network Inversioncited by 15
- 2021Two Coupled Rejection Metrics Can Tell Adversarial Examples Apartcited by 14
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applicationscited by 14
- 2024Preventing Catastrophic Overfitting in Fast Adversarial Training: A Bi-level Optimization Perspectivecited by 12
- 2024I Can Hear You: Selective Robust Training for Deepfake Audio Detectioncited by 12
- 2023Robust Nonparametric Regression under Poisoning Attackcited by 11
- 2021AGKD-BML: Defense Against Adversarial Attack by Attention Guided Knowledge Distillation and Bi-directional Metric Learningcited by 10
- 2021Improving Model Robustness by Adaptively Correcting Perturbation Levels with Active Queriescited by 9
- 2021Improving Model Robustness with Latent Distribution Locally and Globallycited by 9
- 2021MixACM: Mixup-Based Robustness Transfer via Distillation of Activated Channel Mapscited by 9
- 2022Spectral, Probabilistic, and Deep Metric Learning: Tutorial and Surveycited by 9
- 2022Robust Perception through Equivariancecited by 9
- 2021Understanding and Achieving Efficient Robustness with Adversarial Supervised Contrastive Learningcited by 8
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunitiescited by 8
- 2023Defense against Adversarial Cloud Attack on Remote Sensing Salient Object Detectioncited by 8
- 2024Machine Learning Robustness: A Primercited by 8
- 2021Real-Time Neural Voice Camouflagecited by 6
- 2022A Tale of Two Models: Constructing Evasive Attacks on Edge Modelscited by 6
- 2022Improving Adversarial Robustness with Self-Paced Hard-Class Pair Reweightingcited by 6
- 2023Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoffcited by 6
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Surveycited by 5
- 2021Exploring Adversarial Robustness of Deep Metric Learningcited by 4
- 2021Adversarially Robust Kernel Smoothingcited by 4
- 2023Test-time Detection and Repair of Adversarial Samples via Masked Autoencodercited by 4
- 2023Exploring Robust Features for Improving Adversarial Robustnesscited by 4
- 2024Exploring Adversarial Robustness of Deep State Space Modelscited by 4
- 2021Model-Agnostic Meta-Attack: Towards Reliable Evaluation of Adversarial Robustnesscited by 3
- 2022What Do Adversarially trained Neural Networks Focus: A Fourier Domain-based Studycited by 3
- 2023Enhance Diffusion to Improve Robust Generalizationcited by 3
- 2023Robust Proxy: Improving Adversarial Robustness by Robust Proxy Learningcited by 3
- 2024Learning Robust and Privacy-Preserving Representations via Information Theorycited by 3
- 2021Deep Repulsive Prototypes for Adversarial Robustnesscited by 2
- 2022Dual Graphs of Polyhedral Decompositions for the Detection of Adversarial Attackscited by 2
50 most cited of 77 All 77 (JSON)
- 2026Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness1 Jun 2026
- 2025Deep Positive-Negative Prototypes for Adversarially Robust Discriminative Prototypical Learning3 Apr 2025
- 2025Provably Safeguarding a Classifier from OOD and Adversarial Samples: an Extreme Value Theory Approach17 Jan 2025
- 2024Learning Robust and Privacy-Preserving Representations via Information Theory15 Dec 2024
- 2024I Can Hear You: Selective Robust Training for Deepfake Audio Detection31 Oct 2024
- 2024Distance-Preserving Representations for Genomic Spatial Reconstruction1 Aug 2024
- 2024Preventing Catastrophic Overfitting in Fast Adversarial Training: A Bi-level Optimization Perspective17 Jul 2024
- 2024Enhancing robustness of data-driven SHM models: adversarial training with circle loss20 Jun 2024
- 2024Exploring Adversarial Robustness of Deep State Space Models8 Jun 2024
- 2024TIMA: Text-Image Mutual Awareness for Balancing Zero-Shot Adversarial Robustness and Generalization Ability27 May 2024
- 2024Machine Learning Robustness: A Primer1 Apr 2024
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applications27 Feb 2024
38 more
- 2024Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Models19 Feb 2024
- 2023Topology-preserving Adversarial Training for Alleviating Natural Accuracy Degradation29 Nov 2023
- 2023Generalization Bounds for Robust Contrastive Learning: From Theory to Practice16 Nov 2023
- 2023F2AT: Feature-Focusing Adversarial Training via Disentanglement of Natural and Perturbed Patterns23 Oct 2023
- 2023IRAD: Implicit Representation-driven Image Resampling against Adversarial Attacks18 Oct 2023
- 2023Is Certifying ℓp Robustness Still Worthwhile?13 Oct 2023
- 2023GReAT: A Graph Regularized Adversarial Training Method9 Oct 2023
- 2023Language Guided Adversarial Purification19 Sep 2023
- 2023Exploring Robust Features for Improving Adversarial Robustness9 Sep 2023
- 2023Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff31 Aug 2023
- 2023Defense against Adversarial Cloud Attack on Remote Sensing Salient Object Detection30 Jun 2023
- 2023Robust Proxy: Improving Adversarial Robustness by Robust Proxy Learning27 Jun 2023
- 2023A Spectral Perspective towards Understanding and Improving Adversarial Robustness25 Jun 2023
- 2023Enhance Diffusion to Improve Robust Generalization5 Jun 2023
- 2023Robust Nonparametric Regression under Poisoning Attack26 May 2023
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defenses18 May 2023
- 2023Beyond Empirical Risk Minimization: Local Structure Preserving Regularization for Improving Adversarial Robustness29 Mar 2023
- 2023Test-time Detection and Repair of Adversarial Samples via Masked Autoencoder22 Mar 2023
- 2023Randomized Adversarial Training via Taylor Expansion19 Mar 2023
- 2023Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey11 Mar 2023
- 2023Better Diffusion Models Further Improve Adversarial Training9 Feb 2023
- 2023Language-Driven Anchors for Zero-Shot Adversarial Robustness30 Jan 2023
- 2022Understanding Zero-Shot Adversarial Robustness for Large-Scale Models14 Dec 2022
- 2022Adversarially Robust Video Perception by Seeing Motion13 Dec 2022
- 2022Robust Perception through Equivariance12 Dec 2022
- 2022DISCO: Adversarial Defense with Local Implicit Functions11 Dec 2022
- 2022Supervised Contrastive Prototype Learning: Augmentation Free Robust Neural Network26 Nov 2022
- 2022Dual Graphs of Polyhedral Decompositions for the Detection of Adversarial Attacks23 Nov 2022
- 2022Improving Adversarial Robustness to Sensitivity and Invariance Attacks with Deep Metric Learning4 Nov 2022
- 2022Isometric Representations in Neural Networks Improve Robustness2 Nov 2022
- 2022The Enemy of My Enemy is My Friend: Exploring Inverse Adversaries for Improving Adversarial Training1 Nov 2022
- 2022Improving Adversarial Robustness with Self-Paced Hard-Class Pair Reweighting26 Oct 2022
- 2022A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities17 Oct 2022
- 2022Landscape Learning for Neural Network Inversion17 Jun 2022
- 2022Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview15 Jun 2022
- 2022A Tale of Two Models: Constructing Evasive Attacks on Edge Models22 Apr 2022
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologies26 Mar 2022
- 2022Repairing Group-Level Errors for DNNs Using Weighted Regularization24 Mar 2022
50 newest of 77 All 77 (JSON)
- 2023Better Diffusion Models Further Improve Adversarial Trainingcited by 207
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 276
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 65
- 2021Exploring Memorization in Adversarial Trainingcited by 55
- 2021Adversarial Robustness under Long-Tailed Distributioncited by 50
- 2021Adversarial Attacks are Reversible with Natural Supervisioncited by 47
- 2021Online Adversarial Purification based on Self-Supervisioncited by 45
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
- 2022Enhancing Adversarial Training with Second-Order Statistics of Weightscited by 42
- 2022Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overviewcited by 37
- 2022DISCO: Adversarial Defense with Local Implicit Functionscited by 33
- 2023Randomized Adversarial Training via Taylor Expansioncited by 28
- 2023Language-Driven Anchors for Zero-Shot Adversarial Robustnesscited by 23
12 most cited of 74 All 74 (JSON)
- 2026Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness1 Jun 2026
- 2025Deep Positive-Negative Prototypes for Adversarially Robust Discriminative Prototypical Learning3 Apr 2025
- 2025Provably Safeguarding a Classifier from OOD and Adversarial Samples: an Extreme Value Theory Approach17 Jan 2025
- 2024Learning Robust and Privacy-Preserving Representations via Information Theory15 Dec 2024
- 2024I Can Hear You: Selective Robust Training for Deepfake Audio Detection31 Oct 2024
- 2024Distance-Preserving Representations for Genomic Spatial Reconstruction1 Aug 2024
- 2024Preventing Catastrophic Overfitting in Fast Adversarial Training: A Bi-level Optimization Perspective17 Jul 2024
- 2024Enhancing robustness of data-driven SHM models: adversarial training with circle loss20 Jun 2024
- 2024Exploring Adversarial Robustness of Deep State Space Models8 Jun 2024
- 2024TIMA: Text-Image Mutual Awareness for Balancing Zero-Shot Adversarial Robustness and Generalization Ability27 May 2024
- 2024Machine Learning Robustness: A Primer1 Apr 2024
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applications27 Feb 2024
12 newest of 74 All 74 (JSON)