Few-Shot Learning with Part Discovery and Augmentation from Unlabeled Images
Not on the map. Why?
Abstract (arXiv)
Few-shot learning is a challenging task since only few instances are given for recognizing an unseen class. One way to alleviate this problem is to acquire a strong inductive bias via meta-learning on similar tasks. In this paper, we show that such inductive bias can be learned from a flat collection of unlabeled images, and instantiated as transferable representations among seen and unseen classes. Specifically, we propose a novel part-based self-supervised representation learning scheme to learn transferable representations by maximizing the similarity of an image to its discriminative part. To mitigate the overfitting in few-shot classification caused by data scarcity, we further propose a part augmentation strategy by retrieving extra images from a base dataset. We conduct systematic studies on miniImageNet and tieredImageNet benchmarks. Remarkably, our method yields impressive results, outperforming the previous best unsupervised methods by 7.74% and 9.24% under 5-way 1-shot and 5-way 5-shot settings, which are comparable with state-of-the-art supervised methods.
Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Builds on 27 of its 34 references that are in the map. First posted on arXiv 25 May 2021.
Builds on
27 of 34 references.
References · 27
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,476
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,457
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,870
- 2017Prototypical Networks for Few-shot Learningcited by 3,011
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,850
- 2015Learning Deep Features for Discriminative Localizationcited by 2,434
- 2016Matching Networks for One Shot Learningcited by 2,251
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,590
- 2016Colorful Image Colorizationcited by 1,114
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,064
15 more
- 2018Meta-Learning with Latent Embedding Optimizationcited by 476
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 436
- 2019A Baseline for Few-Shot Image Classificationcited by 298
- 2018Low-Shot Learning from Imaginary Datacited by 181
- 2020CrossTransformers: spatially-aware few-shot transfercited by 174
- 2019Boosting Few-Shot Visual Learning with Self-Supervisioncited by 140
- 2018Delta-encoder: an effective sample synthesis method for few-shot object recognitioncited by 89
- 2018Unsupervised Learning via Meta-Learningcited by 81
- 2018Unsupervised Meta-Learning For Few-Shot Image Classificationcited by 74
- 2019Associative Alignment for Few-shot Image Classificationcited by 58
- 2019Image Deformation Meta-Networks for One-Shot Learningcited by 56
- 2020Spatial Contrastive Learning for Few-Shot Classificationcited by 17
- 2020A Self-supervised GAN for Unsupervised Few-shot Object Recognitioncited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 5; 2024: 2.
8 papers.
- 2023GeNIe: Generative Hard Negative Images Through Diffusioncited by 8
- 2024BECLR: Batch Enhanced Contrastive Few-Shot Learningcited by 6
- 2022Cross-Domain Cross-Set Few-Shot Learning via Learning Compact and Aligned Representationscited by 5
- 2023Contrastive Meta-Learning for Partially Observable Few-Shot Learningcited by 2
- 2023RAFIC: Retrieval-Augmented Few-shot Image Classificationcited by 1
- 2024MICM: Rethinking Unsupervised Pretraining for Enhanced Few-shot Learningcited by 1
- 2023Concept Discovery for Fast Adapatationcited by 0
- 2023Recent Advances of Local Mechanisms in Computer Vision: A Survey and Outlook of Recent Workcited by 0
- 2024MICM: Rethinking Unsupervised Pretraining for Enhanced Few-shot Learning23 Aug 2024
- 2024BECLR: Batch Enhanced Contrastive Few-Shot Learning4 Feb 2024
- 2023RAFIC: Retrieval-Augmented Few-shot Image Classification11 Dec 2023
- 2023GeNIe: Generative Hard Negative Images Through Diffusion5 Dec 2023
- 2023Recent Advances of Local Mechanisms in Computer Vision: A Survey and Outlook of Recent Work2 Jun 2023
- 2023Contrastive Meta-Learning for Partially Observable Few-Shot Learning30 Jan 2023
- 2023Concept Discovery for Fast Adapatation19 Jan 2023
- 2022Cross-Domain Cross-Set Few-Shot Learning via Learning Compact and Aligned Representations16 Jul 2022