mlsanityData to 7 Oct 2026

Don't forget, there is more than forgetting: new metrics for Continual Learning

arXiv 1810.13166 ↗First posted 31 Oct 2018cs.AI cs.CV cs.LGcited by 113

Not on the map. Why?

Abstract (arXiv)

Continual learning consists of algorithms that learn from a stream of data/tasks continuously and adaptively thought time, enabling the incremental development of ever more complex knowledge and skills. The lack of consensus in evaluating continual learning algorithms and the almost exclusive focus on forgetting motivate us to propose a more comprehensive set of implementation independent metrics accounting for several factors we believe have practical implications worth considering in the deployment of real AI systems that learn continually: accuracy or performance over time, backward and forward knowledge transfer, memory overhead as well as computational efficiency. Drawing inspiration from the standard Multi-Attribute Value Theory (MAVT) we further propose to fuse these metrics into a single score for ranking purposes and we evaluate our proposal with five continual learning strategies on the iCIFAR-100 continual learning benchmark.

Key facts. Cited by 113 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Oct 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 19; 2022: 15; 2023: 23; 2024: 17; 2025: 21; 2026: 18.

113 papers.

Sort:

By area:

  1. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  2. 2021Avalanche: an End-to-End Library for Continual Learningcited by 124
  3. 2021Continual World: A Robotic Benchmark For Continual Reinforcement Learningcited by 112
  4. 2022The CLEAR Benchmark: Continual LEArning on Real-World Imagerycited by 92
  5. 2021AFEC: Active Forgetting of Negative Transfer in Continual Learningcited by 73
  6. 2024Continual Learning and Catastrophic Forgettingcited by 73
  7. 2023LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discoverycited by 63
  8. 2021Model Zoo: A Growing "Brain" That Learns Continuallycited by 53
  9. 2023Create Your World: Lifelong Text-to-Image Diffusioncited by 46
  10. 2023TiC-CLIP: Continual Training of CLIP Modelscited by 38
  11. 2023Test-Time Training on Video Streamscited by 37
  12. 2021CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agentscited by 36
38 more
  1. 2021Continual Learning of Knowledge Graph Embeddingscited by 35
  2. 2024LeanAgent: Lifelong Learning for Formal Theorem Provingcited by 34
  3. 2021Continuum: Simple Management of Complex Continual Learning Scenarioscited by 33
  4. 2021CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and Comparabilitycited by 28
  5. 2021Is Class-Incremental Enough for Continual Learning?cited by 22
  6. 2022Unsupervised Continual Semantic Adaptation through Neural Renderingcited by 22
  7. 2023A Survey on Continual Semantic Segmentation: Theory, Challenge, Method and Applicationcited by 21
  8. 2021Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognitioncited by 19
  9. 2022Practical Recommendations for Replay-based Continual Learning Methodscited by 16
  10. 2023Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuningcited by 16
  11. 2026CLARE: Continual Learning for Vision-Language-Action Models via Autonomous Adapter Routing and Expansioncited by 14
  12. 2023A Domain-Agnostic Approach for Characterization of Lifelong Learning Systemscited by 13
  13. 2025Federated Continual Learning: Concepts, Challenges, and Solutionscited by 13
  14. 2025Continually Evolving Skill Knowledge in Vision Language Action Modelcited by 13
  15. 2021Selective Replay Enhances Learning in Online Continual Analogical Reasoningcited by 12
  16. 2023When Meta-Learning Meets Online and Continual Learning: A Surveycited by 12
  17. 2021Towards a theory of out-of-distribution learningcited by 11
  18. 2022Continual Learning from Demonstration of Robotics Skillscited by 11
  19. 2022Continual Hippocampus Segmentation with Transformerscited by 11
  20. 2022Beyond Supervised Continual Learning: a Reviewcited by 11
  21. 2024Continual Learning on Graphs: A Surveycited by 11
  22. 2025Parameter-Efficient Continual Fine-Tuning: A Surveycited by 11
  23. 2025Self-Composing Policies for Scalable Continual Reinforcement Learningcited by 10
  24. 2021Studying Catastrophic Forgetting in Neural Ranking Modelscited by 9
  25. 2021ModelCI-e: Enabling Continual Learning in Deep Learning Serving Systemscited by 9
  26. 2022Continual Learning Approaches for Anomaly Detectioncited by 9
  27. 2023Design Principles for Lifelong Learning AI Acceleratorscited by 9
  28. 2021Self-Attention Meta-Learner for Continual Learningcited by 8
  29. 2023Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insightscited by 8
  30. 2023Continual Learning with Dynamic Sparse Training: Exploring Algorithms for Effective Model Updatescited by 8
  31. 2025Dynamic Mixture of Progressive Parameter-Efficient Expert Library for Lifelong Robot Learningcited by 8
  32. 2021Continual Learning for Unsupervised Anomaly Detection in Continuous Auditing of Financial Accounting Datacited by 7
  33. 2025Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-trainingcited by 7
  34. 2025Continual Learning in Vision-Language Models via Aligned Model Mergingcited by 7
  35. 2022CL2R: Compatible Lifelong Learning Representationscited by 6
  36. 2023From MNIST to ImageNet and Back: Benchmarking Continual Curriculum Learningcited by 6
  37. 2023Online Distillation with Continual Learning for Cyclic Domain Shiftscited by 6
  38. 2023Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Modelcited by 6

50 most cited of 113 All 113 (JSON)