mlsanityData to 7 Oct 2026

TACLE: Task and Class-aware Exemplar-free Semi-supervised Class Incremental Learning

arXiv 2407.08041 ↗First posted 10 Jul 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We propose a novel TACLE (TAsk and CLass-awarE) framework to address the relatively unexplored and challenging problem of exemplar-free semi-supervised class incremental learning. In this scenario, at each new task, the model has to learn new classes from both (few) labeled and unlabeled data without access to exemplars from previous classes. In addition to leveraging the capabilities of pre-trained models, TACLE proposes a novel task-adaptive threshold, thereby maximizing the utilization of the available unlabeled data as incremental learning progresses. Additionally, to enhance the performance of the under-represented classes within each task, we propose a class-aware weighted cross-entropy loss. We also exploit the unlabeled data for classifier alignment, which further enhances the model performance. Extensive experiments on benchmark datasets, namely CIFAR10, CIFAR100, and ImageNet-Subset100 demonstrate the effectiveness of the proposed TACLE framework. We further showcase its effectiveness when the unlabeled data is imbalanced and also for the extreme case of one labeled example per class.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 66 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

50 of 66 references.

References · 50

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  4. 2016Learning without Forgettingcited by 2,465
  5. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  6. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
  7. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  8. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  9. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
  10. 2016Progressive Neural Networkscited by 1,332
  11. 2019Contrastive Multiview Codingcited by 1,297
  12. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
38 more
  1. 2018Experience Replay for Continual Learningcited by 1,074
  2. 2018Efficient Lifelong Learning with A-GEMcited by 1,044
  3. 2021Learning to Prompt for Continual Learningcited by 938
  4. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
  5. 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
  6. 2019Large Scale Incremental Learningcited by 727
  7. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
  8. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 691
  9. 2017Lifelong Learning with Dynamically Expandable Networkscited by 689
  10. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  11. 2019Three scenarios for continual learningcited by 610
  12. 2021ImageNet-21K Pretraining for the Massescited by 607
  13. 2018End-to-End Incremental Learningcited by 596
  14. 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 537
  15. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  16. 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
  17. 2019ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoringcited by 349
  18. 2020Semantic Drift Compensation for Class-Incremental Learningcited by 241
  19. 2018Selective Experience Replay for Lifelong Learningcited by 239
  20. 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
  21. 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 228
  22. 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 178
  23. 2021Self-Supervised Models are Continual Learnerscited by 149
  24. 2021An Empirical Investigation of the Role of Pre-training in Lifelong Learningcited by 134
  25. 2023SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learningcited by 133
  26. 2022Class-Incremental Continual Learning into the eXtended DER-versecited by 121
  27. 2022FeTrIL: Feature Translation for Exemplar-Free Class-Incremental Learningcited by 120
  28. 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
  29. 2021Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samplescited by 114
  30. 2022Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidationcited by 113
  31. 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
  32. 2021ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual Learningcited by 68
  33. 2022R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learningcited by 59
  34. 2021How Well Does Self-Supervised Pre-Training Perform with Streaming Data?cited by 29
  35. 2023Boosting Semi-Supervised Learning by Exploiting All Unlabeled Datacited by 26
  36. 2021Continual Semi-Supervised Learning through Contrastive Interpolation Consistencycited by 25
  37. 2022A soft nearest-neighbor framework for continual semi-supervised learningcited by 17
  38. 2018Efficient Data Perturbation for Privacy Preserving and Accurate Data Stream Miningcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.