mlsanityData to 14 Oct 2026

Enhancing Generative Class Incremental Learning Performance with Model Forgetting Approach

arXiv 2403.18258 ↗First posted 27 Mar 2024cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This study presents a novel approach to Generative Class Incremental Learning (GCIL) by introducing the forgetting mechanism, aimed at dynamically managing class information for better adaptation to streaming data. GCIL is one of the hot topics in the field of computer vision, and this is considered one of the crucial tasks in society, specifically the continual learning of generative models. The ability to forget is a crucial brain function that facilitates continual learning by selectively discarding less relevant information for humans. However, in the field of machine learning models, the concept of intentionally forgetting has not been extensively investigated. In this study we aim to bridge this gap by incorporating the forgetting mechanisms into GCIL, thereby examining their impact on the models' ability to learn in continual learning. Through our experiments, we have found that integrating the forgetting mechanisms significantly enhances the models' performance in acquiring new knowledge, underscoring the positive role that strategic forgetting plays in the process of continual learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 27 Mar 2024.

Builds on

17 of 26 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  5. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  6. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  7. 2017Continual Learning with Deep Generative Replaycited by 1,158
  8. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
  9. 2018Task-Free Continual Learningcited by 221
  10. 2023Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Modelscited by 177
  11. 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
  12. 2020Generative Feature Replay For Class-Incremental Learningcited by 109
5 more
  1. 2021Class-Incremental Learning with Generative Classifierscited by 39
  2. 2020Empirical Risk Minimization in the Non-interactive Local Model of Differential Privacycited by 16
  3. 2020Class Clown: Data Redaction in Machine Unlearning at Enterprise Scalecited by 10
  4. 2019Incremental Concept Learning via Online Generative Memory Recallcited by 6
  5. 2022Union-set Multi-source Model Adaptation for Semantic Segmentationcited by 3

Built on by

Not cited yet.