mlsanityData to 13 Oct 2026

Embedding Space Allocation with Angle-Norm Joint Classifiers for Few-Shot Class-Incremental Learning

arXiv 2411.09250 ↗First posted 14 Nov 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-shot class-incremental learning (FSCIL) aims to continually learn new classes from only a few samples without forgetting previous ones, requiring intelligent agents to adapt to dynamic environments. FSCIL combines the characteristics and challenges of class-incremental learning and few-shot learning: (i) Current classes occupy the entire feature space, which is detrimental to learning new classes. (ii) The small number of samples in incremental rounds is insufficient for fully training. In existing mainstream virtual class methods, for addressing the challenge (i), they attempt to use virtual classes as placeholders. However, new classes may not necessarily align with the virtual classes. For the challenge (ii), they replace trainable fully connected layers with Nearest Class Mean (NCM) classifiers based on cosine similarity, but NCM classifiers do not account for sample imbalance issues. To address these issues in previous methods, we propose the class-center guided embedding Space Allocation with Angle-Norm joint classifiers (SAAN) learning framework, which provides balanced space for all classes and leverages norm differences caused by sample imbalance to enhance classification criteria. Specifically, for challenge (i), SAAN divides the feature space into multiple subspaces and allocates a dedicated subspace for each session by guiding samples with the pre-set category centers. For challenge (ii), SAAN establishes a norm distribution for each class and generates angle-norm joint logits. Experiments demonstrate that SAAN can achieve state-of-the-art performance and it can be directly embedded into other SOTA methods as a plug-in, further enhancing their performance.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 41 of its 60 references that are in the map. First posted on arXiv 14 Nov 2024.

Builds on

41 of 60 references.

References · 41

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,180
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,476
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
  6. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,467
  7. 2017Prototypical Networks for Few-shot Learningcited by 3,011
  8. 2016Learning without Forgettingcited by 2,479
  9. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,323
  10. 2016Matching Networks for One Shot Learningcited by 2,251
  11. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,141
  12. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,099
29 more
  1. 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
  2. 2018On First-Order Meta-Learning Algorithmscited by 1,010
  3. 2021Learning to Prompt for Continual Learningcited by 941
  4. 2019Large Scale Incremental Learningcited by 728
  5. 2018End-to-End Incremental Learningcited by 597
  6. 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
  7. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 448
  8. 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
  9. 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 281
  10. 2020Few-Shot Class-Incremental Learningcited by 251
  11. 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 187
  12. 2019Class-incremental Learning via Deep Model Consolidationcited by 172
  13. 2021Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Pathcited by 156
  14. 2015A Large-Scale Car Dataset for Fine-Grained Categorization and Verificationcited by 129
  15. 2020Negative Margin Matters: Understanding Margin in Few-shot Classificationcited by 129
  16. 2018Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgettingcited by 127
  17. 2022Forward Compatible Few-Shot Class-Incremental Learningcited by 127
  18. 2021Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learningcited by 115
  19. 2023Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learningcited by 115
  20. 2014word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding methodcited by 112
  21. 2022Neural Collapse: A Review on Modelling Principles and Generalizationcited by 95
  22. 2021Essentials for Class Incremental Learningcited by 57
  23. 2017Few-Shot Learning Through an Information Retrieval Lenscited by 51
  24. 2022Problems with Cosine as a Measure of Embedding Similarity for High Frequency Wordscited by 49
  25. 2021Meta-FDMixup: Cross-Domain Few-Shot Learning Guided by Labeled Target Datacited by 48
  26. 2020Self-supervised Knowledge Distillation for Few-shot Learningcited by 41
  27. 2024OrCo: Towards Better Generalization via Orthogonality and Contrast for Few-Shot Class-Incremental Learningcited by 26
  28. 2023S3C: Self-Supervised Stochastic Classifiers for Few-Shot Class-Incremental Learningcited by 23
  29. 2024EntAugment: Entropy-Driven Adaptive Data Augmentation Framework for Image Classificationcited by 13

Built on by

Not cited yet.