Dual Path Structural Contrastive Embeddings for Learning Novel Objects
Not on the map. Why?
Abstract (arXiv)
Learning novel classes from a very few labeled samples has attracted increasing attention in machine learning areas. Recent research on either meta-learning based or transfer-learning based paradigm demonstrates that gaining information on a good feature space can be an effective solution to achieve favorable performance on few-shot tasks. In this paper, we propose a simple but effective paradigm that decouples the tasks of learning feature representations and classifiers and only learns the feature embedding architecture from base classes via the typical transfer-learning training strategy. To maintain both the generalization ability across base and novel classes and discrimination ability within each class, we propose a dual path feature learning scheme that effectively combines structural similarity with contrastive feature construction. In this way, both inner-class alignment and inter-class uniformity can be well balanced, and result in improved performance. Experiments on three popular benchmarks show that when incorporated with a simple prototype based classifier, our method can still achieve promising results for both standard and generalized few-shot problems in either an inductive or transductive inference setting.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 69 references that are in the map. First posted on arXiv 23 Dec 2021.
Builds on
59 of 69 references.
References · 59
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2017Mask R-CNNcited by 7,277
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2020Supervised Contrastive Learningcited by 2,829
- 2016Matching Networks for One Shot Learningcited by 2,255
38 more
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2018On First-Order Meta-Learning Algorithmscited by 1,018
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2019A Closer Look at Few-shot Classificationcited by 684
- 2018Meta-Learning with Latent Embedding Optimizationcited by 476
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 437
- 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
- 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 379
- 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
- 2018Meta-Transfer Learning for Few-Shot Learningcited by 306
- 2019A Baseline for Few-Shot Image Classificationcited by 298
- 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 294
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
- 2017Data Augmentation Generative Adversarial Networkscited by 278
- 2019Cross Attention Network for Few-shot Classificationcited by 219
- 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 211
- 2018Low-Shot Learning from Imaginary Datacited by 181
- 2018Recasting Gradient-Based Meta-Learning as Hierarchical Bayescited by 180
- 2020CrossTransformers: spatially-aware few-shot transfercited by 174
- 2019Boosting Few-Shot Visual Learning with Self-Supervisioncited by 140
- 2020Few-shot Image Generation with Elastic Weight Consolidationcited by 122
- 2019Revisiting Local Descriptor based Image-to-Class Measure for Few-shot Learningcited by 121
- 2020Interventional Few-Shot Learningcited by 112
- 2020Adversarial Feature Hallucination Networks for Few-Shot Learningcited by 110
- 2020Laplacian Regularized Few-Shot Learningcited by 92
- 2019TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learningcited by 91
- 2018Delta-encoder: an effective sample synthesis method for few-shot object recognitioncited by 89
- 2019Learning to Self-Train for Semi-Supervised Few-Shot Classificationcited by 83
- 2020Boosting Few-Shot Learning With Adaptive Margin Losscited by 83
- 2020DPGN: Distribution Propagation Graph Network for Few-shot Learningcited by 79
- 2020Leveraging the Feature Distribution in Transfer-based Few-Shot Learningcited by 74
- 2020Instance Credibility Inference for Few-Shot Learningcited by 57
- 2019Dense Classification and Implanting for Few-Shot Learningcited by 56
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.