Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Continual learning (CL) seeks models that acquire new skills without erasing prior knowledge. In exemplar-free class-incremental learning (EFCIL), this challenge is amplified because past data cannot be stored, making representation drift for old classes particularly harmful. Prototype-based EFCIL is attractive for its efficiency, yet prototypes drift as the embedding space evolves; therefore, projection-based drift compensation has become a popular remedy. We show, however, that existing one-directional projections introduce systematic bias: they either retroactively distort the current feature geometry or align past classes only locally, leaving cycle inconsistencies that accumulate across tasks. We introduce BiCyc, a bidirectional projector alignment approach with a cycle-consistency objective. BiCyc jointly optimizes two maps, old-to-new and new-to-old, with stop-gradient gating so that transport and representation co-evolve. Analytically, we show that the cycle loss contracts the singular spectrum toward unity in whitened space, and that improved transport of class means and covariances yields smaller perturbations of classification log-odds, preserving old-class decisions and mitigating catastrophic forgetting. Empirically, across standard EFCIL benchmarks, BiCyc substantially reduces forgetting and improves accuracy in from-scratch settings, while remaining competitive in the pretrained fine-grained regime.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
31 of 40 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2016Learning without Forgettingcited by 2,496
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 681
- 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 521
- 2018Progress & Compress: A scalable framework for continual learningcited by 520
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
- 2021Gradient Projection Memory for Continual Learningcited by 348
- 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
19 more
- 2021Co2L: Contrastive Continual Learningcited by 244
- 2020Semantic Drift Compensation for Class-Incremental Learningcited by 241
- 2021New Insights on Reducing Abrupt Representation Change in Online Continual Learningcited by 219
- 2022FeTrIL: Feature Translation for Exemplar-Free Class-Incremental Learningcited by 121
- 2021PyCIL: A Python Toolbox for Class-Incremental Learningcited by 83
- 2021Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learningcited by 72
- 2022CoSCL: Cooperation of Small Continual Learners is Stronger than a Big Onecited by 43
- 2024Elastic Feature Consolidation for Cold Start Exemplar-Free Incremental Learningcited by 37
- 2023A Unified Approach to Domain Incremental Learning with Memory: Theory and Algorithmcited by 33
- 2024Resurrecting Old Classes with New Data for Exemplar-Free Continual Learningcited by 33
- 2024Exemplar-free Continual Representation Learning via Learnable Drift Compensationcited by 31
- 2024A Unified and General Framework for Continual Learningcited by 20
- 2023DualHSIC: HSIC-Bottleneck and Alignment for Continual Learningcited by 15
- 2022Meta-Learning with Less Forgetting on Large-Scale Non-Stationary Task Distributionscited by 14
- 2024Task-recency bias strikes back: Adapting covariances in Exemplar-Free Class Incremental Learningcited by 14
- 2021Dataset Knowledge Transfer for Class-Incremental Learning without Memorycited by 8
- 2025Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learningcited by 7
- 2019A Normality Test for High-dimensional Data based on a Nearest Neighbor Approachcited by 3
- 2025EFC++: Elastic Feature Consolidation with Prototype Re-balancing for Cold Start Exemplar-free Incremental Learningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.