When Classes Evolve: A Benchmark and Framework for Stage-Aware Class-Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Class-Incremental Learning (CIL) aims to sequentially learn new classes while mitigating catastrophic forgetting of previously learned knowledge. Conventional CIL approaches implicitly assume that classes are morphologically static, focusing primarily on preserving previously learned representations as new classes are introduced. In practice, however, instances of the same semantic class may undergo substantial morphological evolution, such as a larva turning into a butterfly. Consequently, a model must both discriminate between classes and adapt to evolving appearances within a single class. To systematically address this challenge, we formalize Stage-Aware CIL (Stage-CIL), a paradigm in which each class is learned progressively through distinct morphological stages. We further introduce Stage-Bench, a 10-domain, two-stage benchmark and protocol for evaluating both inter-class forgetting and stage-level degradation within classes. Finally, we propose STAGE, an evolution-aware reference baseline that disentangles semantic identity from evolution dynamics through a fixed-size memory pool, enabling stage-aware prediction of later morphological forms from earlier representations. Extensive experiments show that conventional CIL reductions and existing continual-learning baselines remain insufficient under Stage-CIL, while STAGE consistently outperforms strong competitors, demonstrating the promise of explicit evolution-aware modeling for this new setting.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 45 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
25 of 45 references.
References · 25
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2016Progressive Neural Networkscited by 1,332
- 2021Learning to Prompt for Continual Learningcited by 938
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2022S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learningcited by 246
13 more
- 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 183
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
- 2024Continual Learning with Pre-Trained Models: A Surveycited by 151
- 2024Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learningcited by 115
- 2023Learning without Forgetting for Vision-Language Modelscited by 79
- 2023PILOT: A Pre-Trained Model-Based Continual Learning Toolboxcited by 64
- 2021Continual Learning for Real-World Autonomous Systems: Algorithms, Challenges and Frameworkscited by 56
- 2025Overcoming catastrophic forgetting in neural networkscited by 52
- 2025Integrating Task-Specific and Universal Adapters for Pre-Trained Model-based Class-Incremental Learningcited by 19
- 2024DSLR: Diversity Enhancement and Structure Learning for Rehearsal-based Graph Continual Learningcited by 14
- 2025Addressing Imbalanced Domain-Incremental Learning through Dual-Balance Collaborative Expertscited by 12
- 2024CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learningcited by 11
- 2025BOFA: Bridge-Layer Orthogonal Low-Rank Fusion for CLIP-Based Class-Incremental Learningcited by 6
Built on by
Not cited yet.