LibContinual: A Comprehensive Library towards Realistic Continual Learning
Not on the map. Why?
Abstract (arXiv)
A fundamental challenge in Continual Learning (CL) is catastrophic forgetting, where adapting to new tasks degrades the performance on previous ones. While the field has evolved with diverse methods, this rapid surge in diverse methodologies has culminated in a fragmented research landscape. The lack of a unified framework, including inconsistent implementations, conflicting dependencies, and varying evaluation protocols, makes fair comparison and reproducible research increasingly difficult. To address this challenge, we propose LibContinual, a comprehensive and reproducible library designed to serve as a foundational platform for realistic CL. Built upon a high-cohesion, low-coupling modular architecture, LibContinual integrates 19 representative algorithms across five major methodological categories, providing a standardized execution environment. Meanwhile, leveraging this unified framework, we systematically identify and investigate three implicit assumptions prevalent in mainstream evaluation: (1) offline data accessibility, (2) unregulated memory resources, and (3) intra-task semantic homogeneity. We argue that these assumptions often overestimate the real-world applicability of CL methods. Through our comprehensive analysis using strict online CL settings, a novel unified memory budget protocol, and a proposed category-randomized setting, we reveal significant performance drops in many representative CL methods when subjected to these real-world constraints. Our study underscores the necessity of resource-aware and semantically robust CL strategies, and offers LibContinual as a foundational toolkit for future research in realistic continual learning. The source code is available from hrefhttps://github.com/RL-VIG/LibContinualhttps://github.com/RL-VIG/LibContinual.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 62 of its 81 references that are in the map. First posted on arXiv 26 Dec 2025.
Builds on
62 of 81 references.
References · 62
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2017Neural Discrete Representation Learningcited by 4,650
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2021Learning to Prompt for Continual Learningcited by 938
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
38 more
- 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
- 2019Large Scale Incremental Learningcited by 727
- 2017Lifelong Learning with Dynamically Expandable Networkscited by 689
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 672
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2018End-to-End Incremental Learningcited by 596
- 2019Gradient based sample selection for online continual learningcited by 568
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 369
- 2019Orthogonal Gradient Descent for Continual Learningcited by 361
- 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
- 2021Gradient Projection Memory for Continual Learningcited by 338
- 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 281
- 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
- 2019Continual learning with hypernetworkscited by 267
- 2021Co2L: Contrastive Continual Learningcited by 243
- 2020Mnemonics Training: Multi-Class Incremental Learning without Forgettingcited by 220
- 2021New Insights on Reducing Abrupt Representation Change in Online Continual Learningcited by 215
- 2023Class-Incremental Learning: A Surveycited by 209
- 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
- 2019REMIND Your Neural Network to Prevent Catastrophic Forgettingcited by 197
- 2024InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learningcited by 189
- 2019Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learningcited by 181
- 2018Continual Learning of Context-dependent Processing in Neural Networkscited by 178
- 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 178
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
- 2024Continual Learning with Pre-Trained Models: A Surveycited by 151
- 2020Adversarial Continual Learningcited by 140
- 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 139
- 2021Avalanche: an End-to-End Library for Continual Learningcited by 124
- 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
- 2018Don't forget, there is more than forgetting: new metrics for Continual Learningcited by 113
- 2023Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Modelscited by 112
- 2020Memory-Efficient Incremental Learning Through Feature Adaptationcited by 107
- 2017Encoder Based Lifelong Learningcited by 102
- 2020GAN Memory with No Forgettingcited by 84
- 2021RECALL: Replay-based Continual Learning in Semantic Segmentationcited by 83
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.