mlsanityData to 7 Oct 2026

LibContinual: A Comprehensive Library towards Realistic Continual Learning

arXiv 2512.22029 ↗First posted 26 Dec 2025cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

A fundamental challenge in Continual Learning (CL) is catastrophic forgetting, where adapting to new tasks degrades the performance on previous ones. While the field has evolved with diverse methods, this rapid surge in diverse methodologies has culminated in a fragmented research landscape. The lack of a unified framework, including inconsistent implementations, conflicting dependencies, and varying evaluation protocols, makes fair comparison and reproducible research increasingly difficult. To address this challenge, we propose LibContinual, a comprehensive and reproducible library designed to serve as a foundational platform for realistic CL. Built upon a high-cohesion, low-coupling modular architecture, LibContinual integrates 19 representative algorithms across five major methodological categories, providing a standardized execution environment. Meanwhile, leveraging this unified framework, we systematically identify and investigate three implicit assumptions prevalent in mainstream evaluation: (1) offline data accessibility, (2) unregulated memory resources, and (3) intra-task semantic homogeneity. We argue that these assumptions often overestimate the real-world applicability of CL methods. Through our comprehensive analysis using strict online CL settings, a novel unified memory budget protocol, and a proposed category-randomized setting, we reveal significant performance drops in many representative CL methods when subjected to these real-world constraints. Our study underscores the necessity of resource-aware and semantically robust CL strategies, and offers LibContinual as a foundational toolkit for future research in realistic continual learning. The source code is available from hrefhttps://github.com/RL-VIG/LibContinualhttps://github.com/RL-VIG/LibContinual.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 62 of its 81 references that are in the map. First posted on arXiv 26 Dec 2025.

Builds on

62 of 81 references.

References · 62

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2017Neural Discrete Representation Learningcited by 4,650
  6. 2016Learning without Forgettingcited by 2,465
  7. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  8. 2017Continual Learning with Deep Generative Replaycited by 1,152
  9. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  10. 2021Learning to Prompt for Continual Learningcited by 938
  11. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  12. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
38 more
  1. 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
  2. 2019Large Scale Incremental Learningcited by 727
  3. 2017Lifelong Learning with Dynamically Expandable Networkscited by 689
  4. 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 672
  5. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  6. 2018End-to-End Incremental Learningcited by 596
  7. 2019Gradient based sample selection for online continual learningcited by 568
  8. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
  9. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  10. 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 369
  11. 2019Orthogonal Gradient Descent for Continual Learningcited by 361
  12. 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
  13. 2021Gradient Projection Memory for Continual Learningcited by 338
  14. 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 281
  15. 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
  16. 2019Continual learning with hypernetworkscited by 267
  17. 2021Co2L: Contrastive Continual Learningcited by 243
  18. 2020Mnemonics Training: Multi-Class Incremental Learning without Forgettingcited by 220
  19. 2021New Insights on Reducing Abrupt Representation Change in Online Continual Learningcited by 215
  20. 2023Class-Incremental Learning: A Surveycited by 209
  21. 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
  22. 2019REMIND Your Neural Network to Prevent Catastrophic Forgettingcited by 197
  23. 2024InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learningcited by 189
  24. 2019Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learningcited by 181
  25. 2018Continual Learning of Context-dependent Processing in Neural Networkscited by 178
  26. 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 178
  27. 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
  28. 2024Continual Learning with Pre-Trained Models: A Surveycited by 151
  29. 2020Adversarial Continual Learningcited by 140
  30. 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 139
  31. 2021Avalanche: an End-to-End Library for Continual Learningcited by 124
  32. 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
  33. 2018Don't forget, there is more than forgetting: new metrics for Continual Learningcited by 113
  34. 2023Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Modelscited by 112
  35. 2020Memory-Efficient Incremental Learning Through Feature Adaptationcited by 107
  36. 2017Encoder Based Lifelong Learningcited by 102
  37. 2020GAN Memory with No Forgettingcited by 84
  38. 2021RECALL: Replay-based Continual Learning in Semantic Segmentationcited by 83

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.