mlsanityData to 7 Oct 2026

Strategic Base Representation Learning via Feature Augmentations for Few-Shot Class Incremental Learning

arXiv 2501.09361 ↗First posted 16 Jan 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Few-shot class incremental learning implies the model to learn new classes while retaining knowledge of previously learned classes with a small number of training instances. Existing frameworks typically freeze the parameters of the previously learned classes during the incorporation of new classes. However, this approach often results in suboptimal class separation of previously learned classes, leading to overlap between old and new classes. Consequently, the performance of old classes degrades on new classes. To address these challenges, we propose a novel feature augmentation driven contrastive learning framework designed to enhance the separation of previously learned classes to accommodate new classes. Our approach involves augmenting feature vectors and assigning proxy labels to these vectors. This strategy expands the feature space, ensuring seamless integration of new classes within the expanded space. Additionally, we employ a self-supervised contrastive loss to improve the separation between previous classes. We validate our framework through experiments on three FSCIL benchmark datasets: CIFAR100, miniImageNet, and CUB200. The results demonstrate that our Feature Augmentation driven Contrastive Learning framework significantly outperforms other approaches, achieving state-of-the-art performance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 16 Jan 2025.

Builds on

34 of 52 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2017Mask R-CNNcited by 7,259
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  7. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  8. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  9. 2020Supervised Contrastive Learningcited by 2,803
  10. 2016Learning without Forgettingcited by 2,465
  11. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  12. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
22 more
  1. 2016Matching Networks for One Shot Learningcited by 2,246
  2. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  3. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  4. 2018End-to-End Incremental Learningcited by 596
  5. 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
  6. 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
  7. 2020Few-Shot Class-Incremental Learningcited by 249
  8. 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 184
  9. 2018Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgettingcited by 127
  10. 2022Forward Compatible Few-Shot Class-Incremental Learningcited by 125
  11. 2021Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minimacited by 118
  12. 2023Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learningcited by 112
  13. 2020Continual Learning in Low-rank Orthogonal Subspacescited by 99
  14. 2021Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learningcited by 95
  15. 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 87
  16. 2022Few-Shot Class-Incremental Learning from an Open-Set Perspectivecited by 83
  17. 2020MgSvF: Multi-Grained Slow vs. Fast Framework for Few-Shot Class-Incremental Learningcited by 61
  18. 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
  19. 2023Few-Shot Class-Incremental Learning via Training-Free Prototype Calibrationcited by 44
  20. 2021Do Not Forget to Attend to Uncertainty while Mitigating Catastrophic Forgettingcited by 12
  21. 2024Enhanced Few-Shot Class-Incremental Learning via Ensemble Modelscited by 4
  22. 2024Towards Robust Few-shot Class Incremental Learning in Audio Classification using Contrastive Representationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.