mlsanityData to 14 Oct 2026

Dual Path Structural Contrastive Embeddings for Learning Novel Objects

arXiv 2112.12359 ↗First posted 23 Dec 2021cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning novel classes from a very few labeled samples has attracted increasing attention in machine learning areas. Recent research on either meta-learning based or transfer-learning based paradigm demonstrates that gaining information on a good feature space can be an effective solution to achieve favorable performance on few-shot tasks. In this paper, we propose a simple but effective paradigm that decouples the tasks of learning feature representations and classifiers and only learns the feature embedding architecture from base classes via the typical transfer-learning training strategy. To maintain both the generalization ability across base and novel classes and discrimination ability within each class, we propose a dual path feature learning scheme that effectively combines structural similarity with contrastive feature construction. In this way, both inner-class alignment and inter-class uniformity can be well balanced, and result in improved performance. Experiments on three popular benchmarks show that when incorporated with a simple prototype based classifier, our method can still achieve promising results for both standard and generalized few-shot problems in either an inductive or transductive inference setting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 69 references that are in the map. First posted on arXiv 23 Dec 2021.

Builds on

59 of 69 references.

References · 59

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  7. 2017Mask R-CNNcited by 7,277
  8. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  9. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  10. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  11. 2020Supervised Contrastive Learningcited by 2,829
  12. 2016Matching Networks for One Shot Learningcited by 2,255
38 more
  1. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  2. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
  3. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  4. 2020Meta-Learning in Neural Networks: A Surveycited by 950
  5. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
  6. 2020Self-supervised Learning: Generative or Contrastivecited by 694
  7. 2019A Closer Look at Few-shot Classificationcited by 684
  8. 2018Meta-Learning with Latent Embedding Optimizationcited by 476
  9. 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
  10. 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
  11. 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 437
  12. 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
  13. 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 379
  14. 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
  15. 2018Meta-Transfer Learning for Few-Shot Learningcited by 306
  16. 2019A Baseline for Few-Shot Image Classificationcited by 298
  17. 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 294
  18. 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
  19. 2017Data Augmentation Generative Adversarial Networkscited by 278
  20. 2019Cross Attention Network for Few-shot Classificationcited by 219
  21. 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 211
  22. 2018Low-Shot Learning from Imaginary Datacited by 181
  23. 2018Recasting Gradient-Based Meta-Learning as Hierarchical Bayescited by 180
  24. 2020CrossTransformers: spatially-aware few-shot transfercited by 174
  25. 2019Boosting Few-Shot Visual Learning with Self-Supervisioncited by 140
  26. 2020Few-shot Image Generation with Elastic Weight Consolidationcited by 122
  27. 2019Revisiting Local Descriptor based Image-to-Class Measure for Few-shot Learningcited by 121
  28. 2020Interventional Few-Shot Learningcited by 112
  29. 2020Adversarial Feature Hallucination Networks for Few-Shot Learningcited by 110
  30. 2020Laplacian Regularized Few-Shot Learningcited by 92
  31. 2019TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learningcited by 91
  32. 2018Delta-encoder: an effective sample synthesis method for few-shot object recognitioncited by 89
  33. 2019Learning to Self-Train for Semi-Supervised Few-Shot Classificationcited by 83
  34. 2020Boosting Few-Shot Learning With Adaptive Margin Losscited by 83
  35. 2020DPGN: Distribution Propagation Graph Network for Few-shot Learningcited by 79
  36. 2020Leveraging the Feature Distribution in Transfer-based Few-Shot Learningcited by 74
  37. 2020Instance Credibility Inference for Few-Shot Learningcited by 57
  38. 2019Dense Classification and Implanting for Few-Shot Learningcited by 56

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.