MAGIC-SSCIL: Manifold Anchoring and Geometric Incremental Calibration for Semi-Supervised Class Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Semi-supervised Class Incremental Learning (SSCIL) is a severe challenge for neural networks, and it is hardest in the exemplar-free setting where no past data may be stored. Existing methods forget catastrophically due to feature drift, and their pseudo-labels become increasingly unreliable as the label space grows. In this paper, we propose MAGIC (Manifold Anchoring and Geometric Incremental Calibration), a framework that stabilizes plasticity without storing exemplars. MAGIC's design centers on two components. The first is Soft-Weighted Geometry Calibration (SWGC), which uses graph-based label propagation on the learner's plastic feature space to weight and calibrate class means and variances computed on the frozen backbone; from these calibrated Gaussians, we sample phantom features that stand in for data from previous tasks. The second is a Geometric Structural Alignment (GSA) objective that preserves representation topology by matching the relational structure of student and teacher heads and aligning feature anchors with the fixed classifier prototypes, locking the orientation of the feature space. Together, these constraints keep the adapter from drifting, so geometric relations between classes remain stable as new classes arrive. We implement MAGIC with a frozen ResNet-18 backbone and a learnable plastic adapter. Across CIFAR-100, CUB-200, and ImageNet-R, at label ratios of 1%, 5%, and 10%, MAGIC improves average incremental accuracy over most of the supervised CIL methods equipped with FixMatch and native SSCIL baselines; the largest gains occur in the fine-grained, low-label setting, where confidence thresholding fails most clearly.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 67 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
36 of 67 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2016Progressive Neural Networkscited by 1,332
24 more
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2019Relational Knowledge Distillationcited by 873
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
- 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
- 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 292
- 2019Label Propagation for Deep Semi-supervised Learningcited by 287
- 2023Class-Incremental Learning: A Surveycited by 209
- 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 208
- 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 183
- 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 178
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
- 2021Self-Supervised Models are Continual Learnerscited by 149
- 2022FeTrIL: Feature Translation for Exemplar-Free Class-Incremental Learningcited by 120
- 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
- 2021ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual Learningcited by 68
- 2021Continually Learning Self-Supervised Representations with Projected Functional Regularizationcited by 38
- 2024Exemplar-free Continual Representation Learning via Learnable Drift Compensationcited by 30
- 2022A soft nearest-neighbor framework for continual semi-supervised learningcited by 17
- 2023Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learningcited by 8
- 2025Divide-and-Conquer for Enhancing Unlabeled Learning, Stability, and Plasticity in Semi-supervised Continual Learningcited by 3
- 2024Towards Non-Exemplar Semi-Supervised Class-Incremental Learningcited by 1
- 2024TACLE: Task and Class-aware Exemplar-free Semi-supervised Class Incremental Learningcited by 1
Built on by
Not cited yet.