Diffusion-Classifier Synergy: Reward-Aligned Learning via Mutual Boosting Loop for FSCIL
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Few-Shot Class-Incremental Learning (FSCIL) challenges models to sequentially learn new classes from minimal examples without forgetting prior knowledge, a task complicated by the stability-plasticity dilemma and data scarcity. Current FSCIL methods often struggle with generalization due to their reliance on limited datasets. While diffusion models offer a path for data augmentation, their direct application can lead to semantic misalignment or ineffective guidance. This paper introduces Diffusion-Classifier Synergy (DCS), a novel framework that establishes a mutual boosting loop between diffusion model and FSCIL classifier. DCS utilizes a reward-aligned learning strategy, where a dynamic, multi-faceted reward function derived from the classifier's state directs the diffusion model. This reward system operates at two levels: the feature level ensures semantic coherence and diversity using prototype-anchored maximum mean discrepancy and dimension-wise variance matching, while the logits level promotes exploratory image generation and enhances inter-class discriminability through confidence recalibration and cross-session confusion-aware mechanisms. This co-evolutionary process, where generated images refine the classifier and an improved classifier state yields better reward signals, demonstrably achieves state-of-the-art performance on FSCIL benchmarks, significantly enhancing both knowledge retention and new class learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 61 of its 82 references that are in the map. First posted on arXiv 4 Oct 2025.
Builds on
61 of 82 references.
Closest ancestors · 7
Same direction, newest first
- 2025Multi-Perspective Data Augmentation for Few-shot Object Detection25 Feb
- 2024GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editing3 Dec
- 2024Enhance Image Classification via Inter-Class Image Mixup with Diffusion Model28 Mar
- 2024DreamDA: Generative Data Augmentation with Diffusion Models19 Mar
- 2023Readout Guidance: Learning Control from Diffusion Features4 Dec
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classification17 Apr
- 2023Effective Data Augmentation With Diffusion Models7 Feb
Other references · 54
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
- 2023Universal Guidance for Diffusion Modelscited by 437
38 more
- 2019Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgettingcited by 302
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
- 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 283
- 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
- 2020Few-Shot Class-Incremental Learningcited by 251
- 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 229
- 2023Class-Incremental Learning: A Surveycited by 209
- 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 187
- 2018Reinforced Continual Learningcited by 186
- 2023Manifold Preserving Guided Diffusioncited by 157
- 2022A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learningcited by 154
- 2020Continual Prototype Evolution: Learning Online from Non-Stationary Data Streamscited by 144
- 2022Forward Compatible Few-Shot Class-Incremental Learningcited by 127
- 2023Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learningcited by 116
- 2022Constrained Few-shot Class-incremental Learningcited by 94
- 2025Test-time Alignment of Diffusion Models without Reward Over-optimizationcited by 93
- 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 88
- 2022Few-Shot Class-Incremental Learning from an Open-Set Perspectivecited by 84
- 2021ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual Learningcited by 68
- 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
- 2020Memory Efficient Class-Incremental Learning for Image Classificationcited by 50
- 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
- 2023Few-Shot Class-Incremental Learning via Training-Free Prototype Calibrationcited by 46
- 2020Continual Learning with Extended Kronecker-factored Approximate Curvaturecited by 39
- 2022On the Soft-Subnetwork for Few-shot Class Incremental Learningcited by 37
- 2024Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learnerscited by 36
- 2024OrCo: Towards Better Generalization via Orthogonality and Contrast for Few-Shot Class-Incremental Learningcited by 26
- 2024Measuring Diversity in Co-creative Image Generationcited by 15
- 2024Rethinking Few-shot Class-incremental Learning: Learning from Yourselfcited by 14
- 2024Learning Prompt with Distribution-Based Feature Replay for Few-Shot Class-Incremental Learningcited by 12
- 2024Advancing Fine-Grained Classification by Structure and Subject Preserving Augmentationcited by 12
- 2021Learnable Expansion-and-Compression Network for Few-shot Class-Incremental Learningcited by 11
- 2024CLOSER: Towards Better Representation Learning for Few-Shot Class-Incremental Learningcited by 11
- 2024GenOL: Generating Diverse Examples for Name-only Online Learningcited by 9
- 2024GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learningcited by 9
- 2025Adaptive Decision Boundary for Few-Shot Class-Incremental Learningcited by 6
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Synthetic Replays: Turning Diffusion Features into Few-Shot Class-Incremental Learning Knowledge
- 2025Tripartite Weight-Space Ensemble for Few-Shot Class-Incremental Learning
- 2025Breaking Forgetting: Training-Free Few-Shot Class-Incremental Learning via Conditional Diffusion
- 2026Learning to Curate What You Generate for Generalizable Few-Shot Class-Incremental Learning
- 2025Diffusion Classifiers Understand Compositionality, but Conditions Apply
- 2026Steering Diffusion Models via Class-Contrastive Influence for Few-Shot Medical Classification
- 2026Feature-Space Generative Models for One-Shot Class-Incremental Learning
- 2023Class-Incremental Learning using Diffusion Model for Distillation and Replay