mlsanityData to 7 Oct 2026

Unlocking Transfer Learning for Open-World Few-Shot Recognition

arXiv 2411.09986 ↗First posted 15 Nov 2024cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-Shot Open-Set Recognition (FSOSR) targets a critical real-world challenge, aiming to categorize inputs into known categories, termed closed-set classes, while identifying open-set inputs that fall outside these classes. Although transfer learning where a model is tuned to a given few-shot task has become a prominent paradigm in closed-world, we observe that it fails to expand to open-world. To unlock this challenge, we propose a two-stage method which consists of open-set aware meta-learning with open-set free transfer learning. In the open-set aware meta-learning stage, a model is trained to establish a metric space that serves as a beneficial starting point for the subsequent stage. During the open-set free transfer learning stage, the model is further adapted to a specific target task through transfer learning. Additionally, we introduce a strategy to simulate open-set examples by modifying the training dataset or generating pseudo open-set examples. The proposed method achieves state-of-the-art performance on two widely recognized benchmarks, miniImageNet and tieredImageNet, with only a 1.5% increase in training effort. Our work demonstrates the effectiveness of transfer learning in FSOSR.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 51 references that are in the map. First posted on arXiv 15 Nov 2024.

Builds on

38 of 51 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  6. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  7. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  8. 2016Matching Networks for One Shot Learningcited by 2,246
  9. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  10. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  11. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  12. 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
26 more
  1. 2019A Closer Look at Few-shot Classificationcited by 679
  2. 2018Born Again Neural Networkscited by 539
  3. 2015Towards Open Set Deep Networkscited by 533
  4. 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
  5. 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
  6. 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 435
  7. 2013DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognitioncited by 422
  8. 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
  9. 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 293
  10. 2018Probabilistic Model-Agnostic Meta-Learningcited by 254
  11. 2017Generative OpenMax for Multi-Class Open Set Classificationcited by 157
  12. 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
  13. 2018Classification-Reconstruction Learning for Open-Set Recognitioncited by 146
  14. 2019C2AE: Class Conditioned Auto-Encoder for Open-set Recognitioncited by 142
  15. 2021Learning Placeholders for Open-Set Recognitioncited by 121
  16. 2020Conditional Gaussian Distribution Learning for Open Set Recognitioncited by 104
  17. 2021Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learningcited by 56
  18. 2020Few-Shot Open-Set Recognition using Meta-Learningcited by 50
  19. 2020Self-supervised Knowledge Distillation for Few-shot Learningcited by 41
  20. 2021Few-shot Open-set Recognition by Transformation Consistencycited by 29
  21. 2018Metric Learning for Novelty and Anomaly Detectioncited by 21
  22. 2022POODLE: Improving Few-shot Learning via Penalizing Out-of-Distribution Samplescited by 15
  23. 2020Task-Adaptive Negative Envision for Few-Shot Open-Set Recognitioncited by 14
  24. 2021Label Hallucination for Few-Shot Classificationcited by 11
  25. 2023Glocal Energy-based Learning for Few-Shot Open-Set Recognitioncited by 10
  26. 2022Dummy Prototypical Networks for Few-Shot Open-Set Keyword Spottingcited by 7

Built on by

Not cited yet.