mlsanityData to 7 Oct 2026

Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping

arXiv 2502.20032 ↗First posted 27 Feb 2025cs.LG cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Class Incremental Learning (CIL) aims to enable models to learn new classes sequentially while retaining knowledge of previous ones. Although current methods have alleviated catastrophic forgetting (CF), recent studies highlight that the performance of CIL models is highly sensitive to the order of class arrival, particularly when sequentially introduced classes exhibit high inter-class similarity. To address this critical yet understudied challenge of class order sensitivity, we first extend existing CIL frameworks through theoretical analysis, proving that grouping classes with lower pairwise similarity during incremental phases significantly improves model robustness to order variations. Building on this insight, we propose Graph-Driven Dynamic Similarity Grouping (GDDSG), a novel method that employs graph coloring algorithms to dynamically partition classes into similarity-constrained groups. Each group trains an isolated CIL sub-model and constructs meta-features for class group identification. Experimental results demonstrate that our method effectively addresses the issue of class order sensitivity while achieving optimal performance in both model accuracy and anti-forgetting capability. Our code is available at https://github.com/AIGNLAI/GDDSG.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 48 of its 65 references that are in the map. First posted on arXiv 27 Feb 2025.

Builds on

48 of 65 references.

References · 48

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  2. 2016Learning without Forgettingcited by 2,465
  3. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  4. 2022Visual Prompt Tuningcited by 1,674
  5. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  6. 2017Continual Learning with Deep Generative Replaycited by 1,152
  7. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  8. 2021Learning to Prompt for Continual Learningcited by 938
  9. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  10. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
  11. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  12. 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 511
36 more
  1. 2019Surprises in High-Dimensional Ridgeless Least Squares Interpolationcited by 508
  2. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  3. 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 369
  4. 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 292
  5. 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 228
  6. 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 183
  7. 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
  8. 2024Continual Learning with Pre-Trained Models: A Surveycited by 151
  9. 2019Scalable and Order-robust Continual Learning with Additive Parameter Decompositioncited by 125
  10. 2023A Unified Continual Learning Framework with General Parameter-Efficient Tuningcited by 124
  11. 2019Harmless interpolation of noisy data in regressioncited by 121
  12. 2023Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimalitycited by 121
  13. 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
  14. 2024Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learningcited by 115
  15. 2023Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Modelscited by 112
  16. 2020Generative Feature Replay For Class-Incremental Learningcited by 109
  17. 2021Achieving Forgetting Prevention and Knowledge Transfer in Continual Learningcited by 91
  18. 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
  19. 2020GAN Memory with No Forgettingcited by 84
  20. 2023Learning without Forgetting for Vision-Language Modelscited by 79
  21. 2023Theory on Forgetting and Generalization of Continual Learningcited by 69
  22. 2023PILOT: A Pre-Trained Model-Based Continual Learning Toolboxcited by 64
  23. 2020MgSvF: Multi-Grained Slow vs. Fast Framework for Few-Shot Class-Incremental Learningcited by 61
  24. 2021Continual Learning via Local Module Compositioncited by 61
  25. 2023First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learningcited by 46
  26. 2022Isolation and Impartial Aggregation: A Paradigm of Incremental Learning without Interferencecited by 44
  27. 2022CoSCL: Cooperation of Small Continual Learners is Stronger than a Big Onecited by 43
  28. 2023Incorporating Neuro-Inspired Adaptability for Continual Learning in Artificial Intelligencecited by 43
  29. 2022Benchmarking Omni-Vision Representation through the Lens of Visual Realmscited by 38
  30. 2021Curriculum-Meta Learning for Order-Robust Continual Relation Extractioncited by 34
  31. 2022The Effect of Task Ordering in Continual Learningcited by 30
  32. 2023Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Modelscited by 18
  33. 2023Learning to Prompt Knowledge Transfer for Open-World Continual Learningcited by 15
  34. 2024Order parameters and phase transitions of continual learning in deep neural networkscited by 13
  35. 2019Forward and Backward Knowledge Transfer for Sentiment Classificationcited by 9
  36. 2023Hessian Aware Low-Rank Perturbation for Order-Robust Continual Learningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 2.

7 papers.