mlsanityData to 14 Oct 2026

MoTiC: Momentum Tightness and Contrast for Few-Shot Class-Incremental Learning

arXiv 2509.19664 ↗First posted 24 Sep 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-Shot Class-Incremental Learning (FSCIL) must contend with the dual challenge of learning new classes from scarce samples while preserving old class knowledge. Existing methods use the frozen feature extractor and class-averaged prototypes to mitigate against catastrophic forgetting and overfitting. However, new-class prototypes suffer significant estimation bias due to extreme data scarcity, whereas base-class prototypes benefit from sufficient data. In this work, we theoretically demonstrate that aligning the new-class priors with old-class statistics via Bayesian analysis reduces variance and improves prototype accuracy. Furthermore, we propose large-scale contrastive learning to enforce cross-category feature tightness. To further enrich feature diversity and inject prior information for new-class prototypes, we integrate momentum self-supervision and virtual categories into the Momentum Tightness and Contrast framework (MoTiC), constructing a feature space with rich representations and enhanced interclass cohesion. Experiments on three FSCIL benchmarks produce state-of-the-art performances, particularly on the fine-grained task CUB-200, validating our method's ability to reduce estimation bias and improve incremental learning robustness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 50 references that are in the map. First posted on arXiv 24 Sep 2025.

Builds on

34 of 50 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  7. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  8. 2020Supervised Contrastive Learningcited by 2,829
  9. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  10. 2016Matching Networks for One Shot Learningcited by 2,255
  11. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  12. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
22 more
  1. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
  2. 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 719
  3. 2018Do Better ImageNet Models Transfer Better?cited by 565
  4. 2020Few-Shot Class-Incremental Learningcited by 251
  5. 2020How Well Do Self-Supervised Models Transfer?cited by 213
  6. 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 187
  7. 2020Negative Margin Matters: Understanding Margin in Few-shot Classificationcited by 129
  8. 2022Forward Compatible Few-Shot Class-Incremental Learningcited by 127
  9. 2021Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minimacited by 118
  10. 2023Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learningcited by 116
  11. 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 88
  12. 2022Few-Shot Class-Incremental Learning from an Open-Set Perspectivecited by 84
  13. 2021A Broad Study on the Transferability of Visual Representations with Contrastive Learningcited by 78
  14. 2020Why Do Better Loss Functions Lead to Less Transferable Features?cited by 73
  15. 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
  16. 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
  17. 2022Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting Mitigationcited by 45
  18. 2021Generalized and Incremental Few-Shot Learning by Explicit Learning and Calibration without Forgettingcited by 33
  19. 2024OrCo: Towards Better Generalization via Orthogonality and Contrast for Few-Shot Class-Incremental Learningcited by 26
  20. 2023Class Incremental Learning with Self-Supervised Pre-Training and Prototype Learningcited by 18
  21. 2024Compositional Few-Shot Class-Incremental Learningcited by 18
  22. 2024CLOSER: Towards Better Representation Learning for Few-Shot Class-Incremental Learningcited by 11

Built on by

Not cited yet.