BaseTransformers: Attention over base data-points for One Shot Learning
Not on the map. Why?
Abstract (arXiv)
Few shot classification aims to learn to recognize novel categories using only limited samples per category. Most current few shot methods use a base dataset rich in labeled examples to train an encoder that is used for obtaining representations of support instances for novel classes. Since the test instances are from a distribution different to the base distribution, their feature representations are of poor quality, degrading performance. In this paper we propose to make use of the well-trained feature representations of the base dataset that are closest to each support instance to improve its representation during meta-test time. To this end, we propose BaseTransformers, that attends to the most relevant regions of the base dataset feature space and improves support instance representations. Experiments on three benchmark data sets show that our method works well for several backbones and achieves state-of-the-art results in the inductive one shot setting. Code is available at github.com/mayug/BaseTransformers
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 46 references that are in the map. First posted on arXiv 5 Oct 2022.
Builds on
35 of 46 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2019A Closer Look at Few-shot Classificationcited by 679
- 2019Meta-Learning with Implicit Gradientscited by 523
- 2018Meta-Learning with Latent Embedding Optimizationcited by 476
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
23 more
- 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 377
- 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 293
- 2017Meta Networkscited by 268
- 2019Cross Attention Network for Few-shot Classificationcited by 218
- 2019SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learningcited by 194
- 2020CrossTransformers: spatially-aware few-shot transfercited by 174
- 2021Free Lunch for Few-shot Learning: Distribution Calibrationcited by 165
- 2019Boosting Few-Shot Visual Learning with Self-Supervisioncited by 140
- 2019Charting the Right Manifold: Manifold Mixup for Few-shot Learningcited by 135
- 2019Revisiting Local Descriptor based Image-to-Class Measure for Few-shot Learningcited by 121
- 2019TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learningcited by 90
- 2020Meta-Learning with Adaptive Hyperparameterscited by 79
- 2019When Does Self-supervision Improve Few-shot Learning?cited by 78
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2019Meta-Curvaturecited by 70
- 2019Associative Alignment for Few-shot Image Classificationcited by 58
- 2017Few-Shot Learning Through an Information Retrieval Lenscited by 51
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2021Learning Dynamic Alignment via Meta-filter for Few-shot Learningcited by 41
- 2021Partner-Assisted Learning for Few-Shot Image Classificationcited by 36
- 2019MetaFun: Meta-Learning with Iterative Functional Updatescited by 34
- 2019PARN: Position-Aware Relation Networks for Few-Shot Learningcited by 27
- 2019Relational Generalized Few-Shot Learningcited by 6
Built on by
Citing papers per year: 2023: 1.
1 paper.