Embedding Space Allocation with Angle-Norm Joint Classifiers for Few-Shot Class-Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Few-shot class-incremental learning (FSCIL) aims to continually learn new classes from only a few samples without forgetting previous ones, requiring intelligent agents to adapt to dynamic environments. FSCIL combines the characteristics and challenges of class-incremental learning and few-shot learning: (i) Current classes occupy the entire feature space, which is detrimental to learning new classes. (ii) The small number of samples in incremental rounds is insufficient for fully training. In existing mainstream virtual class methods, for addressing the challenge (i), they attempt to use virtual classes as placeholders. However, new classes may not necessarily align with the virtual classes. For the challenge (ii), they replace trainable fully connected layers with Nearest Class Mean (NCM) classifiers based on cosine similarity, but NCM classifiers do not account for sample imbalance issues. To address these issues in previous methods, we propose the class-center guided embedding Space Allocation with Angle-Norm joint classifiers (SAAN) learning framework, which provides balanced space for all classes and leverages norm differences caused by sample imbalance to enhance classification criteria. Specifically, for challenge (i), SAAN divides the feature space into multiple subspaces and allocates a dedicated subspace for each session by guiding samples with the pre-set category centers. For challenge (ii), SAAN establishes a norm distribution for each class and generates angle-norm joint logits. Experiments demonstrate that SAAN can achieve state-of-the-art performance and it can be directly embedded into other SOTA methods as a plug-in, further enhancing their performance.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 41 of its 60 references that are in the map. First posted on arXiv 14 Nov 2024.
Builds on
41 of 60 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2015Distilling the Knowledge in a Neural Networkcited by 10,180
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,476
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,467
- 2017Prototypical Networks for Few-shot Learningcited by 3,011
- 2016Learning without Forgettingcited by 2,479
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,323
- 2016Matching Networks for One Shot Learningcited by 2,251
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,141
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,099
29 more
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
- 2018On First-Order Meta-Learning Algorithmscited by 1,010
- 2021Learning to Prompt for Continual Learningcited by 941
- 2019Large Scale Incremental Learningcited by 728
- 2018End-to-End Incremental Learningcited by 597
- 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 448
- 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
- 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 281
- 2020Few-Shot Class-Incremental Learningcited by 251
- 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 187
- 2019Class-incremental Learning via Deep Model Consolidationcited by 172
- 2021Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Pathcited by 156
- 2015A Large-Scale Car Dataset for Fine-Grained Categorization and Verificationcited by 129
- 2020Negative Margin Matters: Understanding Margin in Few-shot Classificationcited by 129
- 2018Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgettingcited by 127
- 2022Forward Compatible Few-Shot Class-Incremental Learningcited by 127
- 2021Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learningcited by 115
- 2023Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learningcited by 115
- 2014word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding methodcited by 112
- 2022Neural Collapse: A Review on Modelling Principles and Generalizationcited by 95
- 2021Essentials for Class Incremental Learningcited by 57
- 2017Few-Shot Learning Through an Information Retrieval Lenscited by 51
- 2022Problems with Cosine as a Measure of Embedding Similarity for High Frequency Wordscited by 49
- 2021Meta-FDMixup: Cross-Domain Few-Shot Learning Guided by Labeled Target Datacited by 48
- 2020Self-supervised Knowledge Distillation for Few-shot Learningcited by 41
- 2024OrCo: Towards Better Generalization via Orthogonality and Contrast for Few-Shot Class-Incremental Learningcited by 26
- 2023S3C: Self-Supervised Stochastic Classifiers for Few-Shot Class-Incremental Learningcited by 23
- 2024EntAugment: Entropy-Driven Adaptive Data Augmentation Framework for Image Classificationcited by 13
Built on by
Not cited yet.