TACLE: Task and Class-aware Exemplar-free Semi-supervised Class Incremental Learning
Not on the map. Why?
Abstract (arXiv)
We propose a novel TACLE (TAsk and CLass-awarE) framework to address the relatively unexplored and challenging problem of exemplar-free semi-supervised class incremental learning. In this scenario, at each new task, the model has to learn new classes from both (few) labeled and unlabeled data without access to exemplars from previous classes. In addition to leveraging the capabilities of pre-trained models, TACLE proposes a novel task-adaptive threshold, thereby maximizing the utilization of the available unlabeled data as incremental learning progresses. Additionally, to enhance the performance of the under-represented classes within each task, we propose a class-aware weighted cross-entropy loss. We also exploit the unlabeled data for classifier alignment, which further enhances the model performance. Extensive experiments on benchmark datasets, namely CIFAR10, CIFAR100, and ImageNet-Subset100 demonstrate the effectiveness of the proposed TACLE framework. We further showcase its effectiveness when the unlabeled data is imbalanced and also for the extreme case of one labeled example per class.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 66 references that are in the map. First posted on arXiv 10 Jul 2024.
Builds on
50 of 66 references.
References · 50
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2016Progressive Neural Networkscited by 1,332
- 2019Contrastive Multiview Codingcited by 1,297
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
38 more
- 2018Experience Replay for Continual Learningcited by 1,074
- 2018Efficient Lifelong Learning with A-GEMcited by 1,044
- 2021Learning to Prompt for Continual Learningcited by 938
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
- 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
- 2019Large Scale Incremental Learningcited by 727
- 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 691
- 2017Lifelong Learning with Dynamically Expandable Networkscited by 689
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2019Three scenarios for continual learningcited by 610
- 2021ImageNet-21K Pretraining for the Massescited by 607
- 2018End-to-End Incremental Learningcited by 596
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 537
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
- 2019ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoringcited by 349
- 2020Semantic Drift Compensation for Class-Incremental Learningcited by 241
- 2018Selective Experience Replay for Lifelong Learningcited by 239
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 228
- 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 178
- 2021Self-Supervised Models are Continual Learnerscited by 149
- 2021An Empirical Investigation of the Role of Pre-training in Lifelong Learningcited by 134
- 2023SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learningcited by 133
- 2022Class-Incremental Continual Learning into the eXtended DER-versecited by 121
- 2022FeTrIL: Feature Translation for Exemplar-Free Class-Incremental Learningcited by 120
- 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
- 2021Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samplescited by 114
- 2022Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidationcited by 113
- 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
- 2021ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual Learningcited by 68
- 2022R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learningcited by 59
- 2021How Well Does Self-Supervised Pre-Training Perform with Streaming Data?cited by 29
- 2023Boosting Semi-Supervised Learning by Exploiting All Unlabeled Datacited by 26
- 2021Continual Semi-Supervised Learning through Contrastive Interpolation Consistencycited by 25
- 2022A soft nearest-neighbor framework for continual semi-supervised learningcited by 17
- 2018Efficient Data Perturbation for Privacy Preserving and Accurate Data Stream Miningcited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.