mlsanityData to 14 Oct 2026

Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning

arXiv 2606.05675 ↗First posted 4 Jun 2026cs.LG cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Continual learning (CL) seeks models that acquire new skills without erasing prior knowledge. In exemplar-free class-incremental learning (EFCIL), this challenge is amplified because past data cannot be stored, making representation drift for old classes particularly harmful. Prototype-based EFCIL is attractive for its efficiency, yet prototypes drift as the embedding space evolves; therefore, projection-based drift compensation has become a popular remedy. We show, however, that existing one-directional projections introduce systematic bias: they either retroactively distort the current feature geometry or align past classes only locally, leaving cycle inconsistencies that accumulate across tasks. We introduce BiCyc, a bidirectional projector alignment approach with a cycle-consistency objective. BiCyc jointly optimizes two maps, old-to-new and new-to-old, with stop-gradient gating so that transport and representation co-evolve. Analytically, we show that the cycle loss contracts the singular spectrum toward unity in whitened space, and that improved transport of class means and covariances yields smaller perturbations of classification log-odds, preserving old-class decisions and mitigating catastrophic forgetting. Empirically, across standard EFCIL benchmarks, BiCyc substantially reduces forgetting and improves accuracy in from-scratch settings, while remaining competitive in the pretrained fine-grained regime.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

31 of 40 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  3. 2016Learning without Forgettingcited by 2,496
  4. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  5. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
  6. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
  7. 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 681
  8. 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 521
  9. 2018Progress & Compress: A scalable framework for continual learningcited by 520
  10. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
  11. 2021Gradient Projection Memory for Continual Learningcited by 348
  12. 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
19 more
  1. 2021Co2L: Contrastive Continual Learningcited by 244
  2. 2020Semantic Drift Compensation for Class-Incremental Learningcited by 241
  3. 2021New Insights on Reducing Abrupt Representation Change in Online Continual Learningcited by 219
  4. 2022FeTrIL: Feature Translation for Exemplar-Free Class-Incremental Learningcited by 121
  5. 2021PyCIL: A Python Toolbox for Class-Incremental Learningcited by 83
  6. 2021Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learningcited by 72
  7. 2022CoSCL: Cooperation of Small Continual Learners is Stronger than a Big Onecited by 43
  8. 2024Elastic Feature Consolidation for Cold Start Exemplar-Free Incremental Learningcited by 37
  9. 2023A Unified Approach to Domain Incremental Learning with Memory: Theory and Algorithmcited by 33
  10. 2024Resurrecting Old Classes with New Data for Exemplar-Free Continual Learningcited by 33
  11. 2024Exemplar-free Continual Representation Learning via Learnable Drift Compensationcited by 31
  12. 2024A Unified and General Framework for Continual Learningcited by 20
  13. 2023DualHSIC: HSIC-Bottleneck and Alignment for Continual Learningcited by 15
  14. 2022Meta-Learning with Less Forgetting on Large-Scale Non-Stationary Task Distributionscited by 14
  15. 2024Task-recency bias strikes back: Adapting covariances in Exemplar-Free Class Incremental Learningcited by 14
  16. 2021Dataset Knowledge Transfer for Class-Incremental Learning without Memorycited by 8
  17. 2025Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learningcited by 7
  18. 2019A Normality Test for High-dimensional Data based on a Nearest Neighbor Approachcited by 3
  19. 2025EFC++: Elastic Feature Consolidation with Prototype Re-balancing for Cold Start Exemplar-free Incremental Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.