Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping
Not on the map. Why?
Abstract (arXiv)
Class Incremental Learning (CIL) aims to enable models to learn new classes sequentially while retaining knowledge of previous ones. Although current methods have alleviated catastrophic forgetting (CF), recent studies highlight that the performance of CIL models is highly sensitive to the order of class arrival, particularly when sequentially introduced classes exhibit high inter-class similarity. To address this critical yet understudied challenge of class order sensitivity, we first extend existing CIL frameworks through theoretical analysis, proving that grouping classes with lower pairwise similarity during incremental phases significantly improves model robustness to order variations. Building on this insight, we propose Graph-Driven Dynamic Similarity Grouping (GDDSG), a novel method that employs graph coloring algorithms to dynamically partition classes into similarity-constrained groups. Each group trains an isolated CIL sub-model and constructs meta-features for class group identification. Experimental results demonstrate that our method effectively addresses the issue of class order sensitivity while achieving optimal performance in both model accuracy and anti-forgetting capability. Our code is available at https://github.com/AIGNLAI/GDDSG.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 48 of its 65 references that are in the map. First posted on arXiv 27 Feb 2025.
Builds on
48 of 65 references.
References · 48
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Learning without Forgettingcited by 2,465
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2022Visual Prompt Tuningcited by 1,674
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2021Learning to Prompt for Continual Learningcited by 938
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 511
36 more
- 2019Surprises in High-Dimensional Ridgeless Least Squares Interpolationcited by 508
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 369
- 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 292
- 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 228
- 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 183
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
- 2024Continual Learning with Pre-Trained Models: A Surveycited by 151
- 2019Scalable and Order-robust Continual Learning with Additive Parameter Decompositioncited by 125
- 2023A Unified Continual Learning Framework with General Parameter-Efficient Tuningcited by 124
- 2019Harmless interpolation of noisy data in regressioncited by 121
- 2023Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimalitycited by 121
- 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
- 2024Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learningcited by 115
- 2023Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Modelscited by 112
- 2020Generative Feature Replay For Class-Incremental Learningcited by 109
- 2021Achieving Forgetting Prevention and Knowledge Transfer in Continual Learningcited by 91
- 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
- 2020GAN Memory with No Forgettingcited by 84
- 2023Learning without Forgetting for Vision-Language Modelscited by 79
- 2023Theory on Forgetting and Generalization of Continual Learningcited by 69
- 2023PILOT: A Pre-Trained Model-Based Continual Learning Toolboxcited by 64
- 2020MgSvF: Multi-Grained Slow vs. Fast Framework for Few-Shot Class-Incremental Learningcited by 61
- 2021Continual Learning via Local Module Compositioncited by 61
- 2023First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learningcited by 46
- 2022Isolation and Impartial Aggregation: A Paradigm of Incremental Learning without Interferencecited by 44
- 2022CoSCL: Cooperation of Small Continual Learners is Stronger than a Big Onecited by 43
- 2023Incorporating Neuro-Inspired Adaptability for Continual Learning in Artificial Intelligencecited by 43
- 2022Benchmarking Omni-Vision Representation through the Lens of Visual Realmscited by 38
- 2021Curriculum-Meta Learning for Order-Robust Continual Relation Extractioncited by 34
- 2022The Effect of Task Ordering in Continual Learningcited by 30
- 2023Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Modelscited by 18
- 2023Learning to Prompt Knowledge Transfer for Open-World Continual Learningcited by 15
- 2024Order parameters and phase transitions of continual learning in deep neural networkscited by 13
- 2019Forward and Backward Knowledge Transfer for Sentiment Classificationcited by 9
- 2023Hessian Aware Low-Rank Perturbation for Order-Robust Continual Learningcited by 2
Built on by
Citing papers per year: 2025: 5; 2026: 2.
7 papers.
- 2025AFCL: Analytic Federated Continual Learning for Spatio-Temporal Invariance of Non-IID Datacited by 3
- 2025ErrorEraser: Unlearning Data Bias for Improved Continual Learningcited by 3
- 2025HERMAN: Hierarchical Representation Matching for CLIP-based Class-Incremental Learningcited by 3
- 2025Hierarchical Semantic Tree Anchoring for CLIP-Based Class-Incremental Learningcited by 3
- 2025The Lie of the Average: How Class Incremental Learning Evaluation Deceives You?cited by 2
- 2026MOSAIC: Modality-Specific Adaptation for Incremental Continual Learning in Parkinson's Disease Gait Assessmentcited by 0
- 2026Task-Anchored Representation Shaping for Pre-Trained Model-Based Continual Learningcited by 0
- 2026Task-Anchored Representation Shaping for Pre-Trained Model-Based Continual Learning17 Aug 2026
- 2026MOSAIC: Modality-Specific Adaptation for Incremental Continual Learning in Parkinson's Disease Gait Assessment11 Jun 2026
- 2025Hierarchical Semantic Tree Anchoring for CLIP-Based Class-Incremental Learning19 Nov 2025
- 2025HERMAN: Hierarchical Representation Matching for CLIP-based Class-Incremental Learning26 Sep 2025
- 2025The Lie of the Average: How Class Incremental Learning Evaluation Deceives You?26 Sep 2025
- 2025ErrorEraser: Unlearning Data Bias for Improved Continual Learning11 Jun 2025
- 2025AFCL: Analytic Federated Continual Learning for Spatio-Temporal Invariance of Non-IID Data18 May 2025