mlsanityData to 14 Oct 2026

A Simple Approach to Adversarial Robustness in Few-shot Image Classification

arXiv 2204.05432 ↗First posted 11 Apr 2022cs.CV cs.AI cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Few-shot image classification, where the goal is to generalize to tasks with limited labeled data, has seen great progress over the years. However, the classifiers are vulnerable to adversarial examples, posing a question regarding their generalization capabilities. Recent works have tried to combine meta-learning approaches with adversarial training to improve the robustness of few-shot classifiers. We show that a simple transfer-learning based approach can be used to train adversarially robust few-shot classifiers. We also present a method for novel classification task based on calibrating the centroid of the few-shot category towards the base classes. We show that standard adversarial training on base categories along with calibrated centroid-based classifier in the novel categories, outperforms or is on-par with state-of-the-art advanced methods on standard benchmarks for few-shot learning. Our method is simple, easy to scale, and with little effort can lead to robust few-shot classifiers. Code is available here: urlhttps://github.com/UCDvision/Simplefewshot.git

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 53 of its 64 references that are in the map. First posted on arXiv 11 Apr 2022.

Builds on

53 of 64 references.

References · 53

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  5. 2016Densely Connected Convolutional Networkscited by 6,720
  6. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  7. 2013Intriguing properties of neural networkscited by 5,155
  8. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  10. 2016Wide Residual Networkscited by 3,070
  11. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  12. 2016Matching Networks for One Shot Learningcited by 2,255
38 more
  1. 2016Adversarial examples in the physical worldcited by 1,769
  2. 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
  3. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
  4. 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
  5. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
  6. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
  7. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  8. 2018Robustness May Be at Odds with Accuracycited by 880
  9. 2019A Closer Look at Few-shot Classificationcited by 684
  10. 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 678
  11. 2019Adversarial Training for Free!cited by 643
  12. 2016Learning to learn by gradient descent by gradient descentcited by 620
  13. 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 588
  14. 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 567
  15. 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 546
  16. 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
  17. 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
  18. 2018On the Effectiveness of Interval Bound Propagation for Training Verifiably Robust Modelscited by 328
  19. 2018Adversarially Robust Generalization Requires More Datacited by 318
  20. 2019A Baseline for Few-Shot Image Classificationcited by 298
  21. 2017Data Augmentation Generative Adversarial Networkscited by 278
  22. 2020Uncovering the Limits of Adversarial Training against Norm-Bounded Adversarial Examplescited by 278
  23. 2017Adversarial Examples for Semantic Segmentation and Object Detectioncited by 275
  24. 2017Detecting Adversarial Samples from Artifactscited by 245
  25. 2019Towards Stable and Efficient Training of Verifiably Robust Neural Networkscited by 205
  26. 2018Low-Shot Learning from Imaginary Datacited by 181
  27. 2018Semidefinite relaxations for certifying robustness to adversarial examplescited by 179
  28. 2021Free Lunch for Few-shot Learning: Distribution Calibrationcited by 165
  29. 2020Randomized Smoothing of All Shapes and Sizescited by 147
  30. 2018Scaling provable adversarial defensescited by 143
  31. 2016Learning feed-forward one-shot learnerscited by 93
  32. 2016Adversarial Examples Detection in Deep Networks with Convolutional Filter Statisticscited by 77
  33. 2020Learning Meta Face Recognition in Unseen Domainscited by 61
  34. 2020Tracking by Instance Detection: A Meta-Learning Approachcited by 61
  35. 2016Defensive Distillation is Not Robust to Adversarial Examplescited by 60
  36. 2019Few-Shot Learning with Embedded Class Models and Shot-Free Meta Trainingcited by 57
  37. 2018Few-Shot Learning with Metric-Agnostic Conditional Embeddingscited by 40
  38. 2021On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learningcited by 29

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1; 2024: 1.

3 papers.