mlsanityData to 14 Oct 2026

Breaking the Synthetic-Real Domain Shortcut for Training-Free Generative Replay-based Class Incremental Learning

arXiv 2607.22994 ↗First posted 25 Jul 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Class-incremental learning (CIL) requires models to continuously acquire new knowledge while avoiding catastrophic forgetting. While exemplar replay is effective, it raises concerns regarding privacy and storage. Thus, generative replay has emerged as a viable alternative, synthesizing old data using frozen pretrained text-to-image (T2I) models without any extra training. However, we observe that directly mixing synthetic old-class data with real new-class data during incremental training leads to significant performance degradation. This issue stems from a "domain shortcut", where models rely on domain-discriminative features instead of semantic class cues. To address this, we propose DREAM (underlineDomain-underlineRegularized underlineExemplar-free underlineAlignment underlineModel), which uses a training-free generator to synthesize old-class data and eliminates domain shortcut via subspace rectification and orthogonal projection, while reinforcing semantic alignment through real-anchored prototype regularization. Extensive experiments on 4 datasets demonstrate that DREAM outperforms existing exemplar-free CIL methods and achieves state-of-the-art performance. Our source code is available at https://github.com/Light-ZhangTao/DREAM.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

31 of 49 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  7. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  8. 2016Learning without Forgettingcited by 2,496
  9. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  10. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
  11. 2017Continual Learning with Deep Generative Replaycited by 1,158
  12. 2025Qwen-Image Technical Reportcited by 1,044
19 more
  1. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 722
  2. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
  3. 2019Orthogonal Gradient Descent for Continual Learningcited by 369
  4. 2021Gradient Projection Memory for Continual Learningcited by 348
  5. 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learnerscited by 177
  6. 2021Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learningcited by 131
  7. 2022FeTrIL: Feature Translation for Exemplar-Free Class-Incremental Learningcited by 121
  8. 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
  9. 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
  10. 2023Scaling Laws of Synthetic Images for Model Training ... for Nowcited by 108
  11. 2021PyCIL: A Python Toolbox for Class-Incremental Learningcited by 83
  12. 2022R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learningcited by 59
  13. 2021Model Zoo: A Growing "Brain" That Learns Continuallycited by 54
  14. 2023Training on Thin Air: Improve Image Classification with Generated Datacited by 50
  15. 2024Divide and not forget: Ensemble of selectively trained experts in Continual Learningcited by 38
  16. 2024DiffClass: Diffusion-Based Class Incremental Learningcited by 23
  17. 2024Advances in Diffusion Models for Image Data Augmentation: A Review of Methods, Models, Evaluation Metrics and Future Research Directionscited by 14
  18. 2024Diffusion Model Meets Non-Exemplar Class-Incremental Learning and Beyondcited by 4
  19. 2025Autoencoder-Based Hybrid Replay for Class-Incremental Learningcited by 4

Built on by

Not cited yet.