Self-Supervised Class-Cognizant Few-Shot Classification
Not on the map. Why?
Abstract (arXiv)
Unsupervised learning is argued to be the dark matter of human intelligence. To build in this direction, this paper focuses on unsupervised learning from an abundance of unlabeled data followed by few-shot fine-tuning on a downstream classification task. To this aim, we extend a recent study on adopting contrastive learning for self-supervised pre-training by incorporating class-level cognizance through iterative clustering and re-ranking and by expanding the contrastive optimization loss to account for it. To our knowledge, our experimentation both in standard and cross-domain scenarios demonstrate that we set a new state-of-the-art (SoTA) in (5-way, 1 and 5-shot) settings of standard mini-ImageNet benchmark as well as the (5-way, 5 and 20-shot) settings of cross-domain CDFSL benchmark. Our code and experimentation can be found in our GitHub repository: https://github.com/ojss/c3lr.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 28 references that are in the map. First posted on arXiv 15 Feb 2022.
Builds on
22 of 28 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 437
- 2019A Baseline for Few-Shot Image Classificationcited by 298
- 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 294
- 2017Re-ranking Person Re-identification with k-reciprocal Encodingcited by 262
10 more
- 2016Using Deep Learning for Image-Based Plant Disease Detectioncited by 219
- 2018Unsupervised Learning via Meta-Learningcited by 82
- 2018Unsupervised Meta-Learning For Few-Shot Image Classificationcited by 75
- 2019Self-Supervised Learning For Few-Shot Image Classificationcited by 44
- 2020Rethinking Class Relations: Absolute-relative Supervised and Unsupervised Few-shot Learningcited by 31
- 2020Unsupervised Meta-Learning through Latent-Space Interpolation in Generative Modelscited by 26
- 2020Self-Supervised Prototypical Transfer Learning for Few-Shot Classificationcited by 26
- 2019Assume, Augment and Learn: Unsupervised Few-Shot Meta-Learning via Random Labels and Data Augmentationcited by 24
- 2019A Broader Study of Cross-Domain Few-Shot Learningcited by 10
- 2019Unsupervised Few-shot Learning via Self-supervised Trainingcited by 7
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1.
2 papers.
- 2024BECLR: Batch Enhanced Contrastive Few-Shot Learning4 Feb 2024
- 2022Self-Attention Message Passing for Contrastive Few-Shot Learning12 Oct 2022