Semantic-Anchored, Class Variance-Optimized Clustering for Robust Semi-Supervised Few-Shot Learning
Not on the map. Why?
Abstract (arXiv)
Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are available. Such unlabeled samples are generally cheaper to obtain and can be used to improve the few-shot learning performance of the model. Some of the recent methods for this setting rely on clustering to generate pseudo-labels for the unlabeled samples. Since the effectiveness of clustering heavily influences the labeling of the unlabeled samples, it can significantly affect the few-shot learning performance. In this paper, we focus on improving the representation learned by the model in order to improve the clustering and, consequently, the model performance. We propose an approach for semi-supervised few-shot learning that performs a class-variance optimized clustering coupled with a cluster separation tuner in order to improve the effectiveness of clustering the labeled and unlabeled samples in this setting. It also optimizes the clustering-based pseudo-labeling process using a restricted pseudo-labeling approach and performs semantic information injection in order to improve the semi-supervised few-shot learning performance of the model. We experimentally demonstrate that our proposed approach significantly outperforms recent state-of-the-art methods on the benchmark datasets. To further establish its robustness, we conduct extensive experiments under challenging conditions, showing that the model generalizes well to domain shifts and achieves new state-of-the-art performance in open-set settings with distractor classes, highlighting its effectiveness for real-world applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 56 references that are in the map. First posted on arXiv 24 Jan 2025.
Builds on
40 of 56 references.
References · 40
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
28 more
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 657
- 2018Meta-Learning with Latent Embedding Optimizationcited by 476
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
- 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 377
- 2018Meta-Transfer Learning for Few-Shot Learningcited by 306
- 2019Label Propagation for Deep Semi-supervised Learningcited by 287
- 2019Cross Attention Network for Few-shot Classificationcited by 218
- 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 208
- 2019Learning to Self-Train for Semi-Supervised Few-Shot Classificationcited by 83
- 2020Embedding Propagation: Smoother Manifold for Few-Shot Classificationcited by 79
- 2019Generating Classification Weights with GNN Denoising Autoencoders for Few-Shot Learningcited by 69
- 2020Instance Credibility Inference for Few-Shot Learningcited by 57
- 2018Few-Shot Learning with Metric-Agnostic Conditional Embeddingscited by 40
- 2020Iterative label cleaning for transductive and semi-supervised few-shot learningcited by 40
- 2019TransMatch: A Transfer-Learning Scheme for Semi-Supervised Few-Shot Learningcited by 39
- 2022Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficultycited by 37
- 2021Ranking Distance Calibration for Cross-Domain Few-Shot Learningcited by 27
- 2020PTN: A Poisson Transfer Network for Semi-supervised Few-shot Learningcited by 9
- 2017Efficient K-Shot Learning with Regularized Deep Networkscited by 7
- 2013Firefly Algorithm: Recent Advances and Applicationscited by 5
- 2022Pseudo-Labeling Based Practical Semi-Supervised Meta-Training for Few-Shot Learningcited by 4
Built on by
Not cited yet.