mlsanityData to 7 Oct 2026

Exploiting Fine-Grained Prototype Distribution for Boosting Unsupervised Class Incremental Learning

arXiv 2408.10046 ↗First posted 19 Aug 2024cs.LG cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The dynamic nature of open-world scenarios has attracted more attention to class incremental learning (CIL). However, existing CIL methods typically presume the availability of complete ground-truth labels throughout the training process, an assumption rarely met in practical applications. Consequently, this paper explores a more challenging problem of unsupervised class incremental learning (UCIL). The essence of addressing this problem lies in effectively capturing comprehensive feature representations and discovering unknown novel classes. To achieve this, we first model the knowledge of class distribution by exploiting fine-grained prototypes. Subsequently, a granularity alignment technique is introduced to enhance the unsupervised class discovery. Additionally, we proposed a strategy to minimize overlap between novel and existing classes, thereby preserving historical knowledge and mitigating the phenomenon of catastrophic forgetting. Extensive experiments on the five datasets demonstrate that our approach significantly outperforms current state-of-the-art methods, indicating the effectiveness of the proposed method.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 19 Aug 2024.

Builds on

38 of 49 references.

References · 38

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  4. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  5. 2016Learning without Forgettingcited by 2,465
  6. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  7. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  8. 2018Experience Replay for Continual Learningcited by 1,074
  9. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
  10. 2021Learning to Prompt for Continual Learningcited by 938
  11. 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 672
  12. 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
26 more
  1. 2018Deep Face Recognition: A Surveycited by 275
  2. 2020Semantic Drift Compensation for Class-Incremental Learningcited by 241
  3. 2019Learning to Discover Novel Visual Categories via Deep Transfer Clusteringcited by 223
  4. 2020Mnemonics Training: Multi-Class Incremental Learning without Forgettingcited by 220
  5. 2022Generalized Category Discoverycited by 209
  6. 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 178
  7. 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
  8. 2021A Unified Objective for Novel Class Discoverycited by 161
  9. 2020Automatically Discovering and Learning New Visual Categories with Ranking Statisticscited by 141
  10. 2019Functional Regularisation for Continual Learning with Gaussian Processescited by 121
  11. 2022Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidationcited by 113
  12. 2023Dynamic Conceptional Contrastive Learning for Generalized Category Discoverycited by 90
  13. 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
  14. 2022Class-Incremental Learning with Strong Pre-trained Modelscited by 60
  15. 2019The Herbarium Challenge 2019 Datasetcited by 59
  16. 2022Open-environment Machine Learningcited by 48
  17. 2023Dense Network Expansion for Class Incremental Learningcited by 45
  18. 2022Class-incremental Novel Class Discoverycited by 42
  19. 2023MetaGCD: Learning to Continually Learn in Generalized Category Discoverycited by 40
  20. 2022Novel Class Discovery without Forgettingcited by 39
  21. 2021Open-world Machine Learning: Applications, Challenges, and Opportunitiescited by 34
  22. 2023Class-Incremental Learning using Diffusion Model for Distillation and Replaycited by 31
  23. 2022Towards Realistic Semi-Supervised Learningcited by 27
  24. 2023Open-world Semi-supervised Novel Class Discoverycited by 15
  25. 2023Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discoverycited by 11
  26. 2021Information Maximization Clustering via Multi-View Self-Labellingcited by 10

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.