Unlocking Transfer Learning for Open-World Few-Shot Recognition
Not on the map. Why?
Abstract (arXiv)
Few-Shot Open-Set Recognition (FSOSR) targets a critical real-world challenge, aiming to categorize inputs into known categories, termed closed-set classes, while identifying open-set inputs that fall outside these classes. Although transfer learning where a model is tuned to a given few-shot task has become a prominent paradigm in closed-world, we observe that it fails to expand to open-world. To unlock this challenge, we propose a two-stage method which consists of open-set aware meta-learning with open-set free transfer learning. In the open-set aware meta-learning stage, a model is trained to establish a metric space that serves as a beneficial starting point for the subsequent stage. During the open-set free transfer learning stage, the model is further adapted to a specific target task through transfer learning. Additionally, we introduce a strategy to simulate open-set examples by modifying the training dataset or generating pseudo open-set examples. The proposed method achieves state-of-the-art performance on two widely recognized benchmarks, miniImageNet and tieredImageNet, with only a 1.5% increase in training effort. Our work demonstrates the effectiveness of transfer learning in FSOSR.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 51 references that are in the map. First posted on arXiv 15 Nov 2024.
Builds on
38 of 51 references.
References · 38
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
26 more
- 2019A Closer Look at Few-shot Classificationcited by 679
- 2018Born Again Neural Networkscited by 539
- 2015Towards Open Set Deep Networkscited by 533
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 435
- 2013DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognitioncited by 422
- 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
- 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 293
- 2018Probabilistic Model-Agnostic Meta-Learningcited by 254
- 2017Generative OpenMax for Multi-Class Open Set Classificationcited by 157
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2018Classification-Reconstruction Learning for Open-Set Recognitioncited by 146
- 2019C2AE: Class Conditioned Auto-Encoder for Open-set Recognitioncited by 142
- 2021Learning Placeholders for Open-Set Recognitioncited by 121
- 2020Conditional Gaussian Distribution Learning for Open Set Recognitioncited by 104
- 2021Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learningcited by 56
- 2020Few-Shot Open-Set Recognition using Meta-Learningcited by 50
- 2020Self-supervised Knowledge Distillation for Few-shot Learningcited by 41
- 2021Few-shot Open-set Recognition by Transformation Consistencycited by 29
- 2018Metric Learning for Novelty and Anomaly Detectioncited by 21
- 2022POODLE: Improving Few-shot Learning via Penalizing Out-of-Distribution Samplescited by 15
- 2020Task-Adaptive Negative Envision for Few-Shot Open-Set Recognitioncited by 14
- 2021Label Hallucination for Few-Shot Classificationcited by 11
- 2023Glocal Energy-based Learning for Few-Shot Open-Set Recognitioncited by 10
- 2022Dummy Prototypical Networks for Few-Shot Open-Set Keyword Spottingcited by 7
Built on by
Not cited yet.