mlsanityData to 14 Oct 2026

CALA: A Class-Aware Logit Adapter for Few-Shot Class-Incremental Learning

arXiv 2412.12654 ↗First posted 17 Dec 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Few-Shot Class-Incremental Learning (FSCIL) defines a practical but challenging task where models are required to continuously learn novel concepts with only a few training samples. Due to data scarcity, existing FSCIL methods resort to training a backbone with abundant base data and then keeping it frozen afterward. However, the above operation often causes the backbone to overfit to base classes while overlooking the novel ones, leading to severe confusion between them. To address this issue, we propose Class-Aware Logit Adapter (CALA). Our method involves a lightweight adapter that learns to rectify biased predictions through a pseudo-incremental learning paradigm. In the real FSCIL process, we use the learned adapter to dynamically generate robust balancing factors. These factors can adjust confused novel instances back to their true label space based on their similarity to base classes. Specifically, when confusion is more likely to occur in novel instances that closely resemble base classes, greater rectification is required. Notably, CALA operates on the classifier level, preserving the original feature space, thus it can be flexibly plugged into most of the existing FSCIL works for improved performance. Experiments on three benchmark datasets consistently validate the effectiveness and flexibility of CALA. Codes will be available upon acceptance.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 17 Dec 2024.

Builds on

36 of 47 references.

References · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2017Mask R-CNNcited by 7,277
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  8. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  9. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  10. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
  11. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
  12. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
24 more
  1. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 722
  2. 2020Long-tail learning via logit adjustmentcited by 618
  3. 2020Few-Shot Class-Incremental Learningcited by 251
  4. 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 187
  5. 2019Class-incremental Learning via Deep Model Consolidationcited by 173
  6. 2021Free Lunch for Few-shot Learning: Distribution Calibrationcited by 165
  7. 2022Forward Compatible Few-Shot Class-Incremental Learningcited by 127
  8. 2023Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learningcited by 116
  9. 2020Adversarial Feature Hallucination Networks for Few-Shot Learningcited by 110
  10. 2021Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learningcited by 96
  11. 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 88
  12. 2022Few-Shot Class-Incremental Learning from an Open-Set Perspectivecited by 84
  13. 2022A Theoretical Study on Solving Continual Learningcited by 80
  14. 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
  15. 2023Few-Shot Class-Incremental Learning via Training-Free Prototype Calibrationcited by 46
  16. 2023A Unified Perspective for Loss-Oriented Imbalanced Learning via Localizationcited by 24
  17. 2018Feature Space Transfer for Data Augmentationcited by 21
  18. 2021Margin Calibration for Long-Tailed Visual Recognitioncited by 17
  19. 2022Adaptive Distribution Calibration for Few-Shot Learning with Hierarchical Optimal Transportcited by 14
  20. 2020Unsupervised Model Personalization while Preserving Privacy and Scalability: An Open Problemcited by 13
  21. 2017Generative Adversarial Residual Pairwise Networks for One Shot Learningcited by 11
  22. 2023Adjusting Logit in Gaussian Form for Long-Tailed Visual Recognitioncited by 7
  23. 2023ScrollNet: Dynamic Weight Importance for Continual Learningcited by 4
  24. 2020Pseudo Rehearsal using non photo-realistic imagescited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.