mlsanityData to 14 Oct 2026

Diffusion-Classifier Synergy: Reward-Aligned Learning via Mutual Boosting Loop for FSCIL

arXiv 2510.03608 ↗First posted 4 Oct 2025cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Few-Shot Class-Incremental Learning (FSCIL) challenges models to sequentially learn new classes from minimal examples without forgetting prior knowledge, a task complicated by the stability-plasticity dilemma and data scarcity. Current FSCIL methods often struggle with generalization due to their reliance on limited datasets. While diffusion models offer a path for data augmentation, their direct application can lead to semantic misalignment or ineffective guidance. This paper introduces Diffusion-Classifier Synergy (DCS), a novel framework that establishes a mutual boosting loop between diffusion model and FSCIL classifier. DCS utilizes a reward-aligned learning strategy, where a dynamic, multi-faceted reward function derived from the classifier's state directs the diffusion model. This reward system operates at two levels: the feature level ensures semantic coherence and diversity using prototype-anchored maximum mean discrepancy and dimension-wise variance matching, while the logits level promotes exploratory image generation and enhances inter-class discriminability through confidence recalibration and cross-session confusion-aware mechanisms. This co-evolutionary process, where generated images refine the classifier and an improved classifier state yields better reward signals, demonstrably achieves state-of-the-art performance on FSCIL benchmarks, significantly enhancing both knowledge retention and new class learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 61 of its 82 references that are in the map. First posted on arXiv 4 Oct 2025.

Builds on

61 of 82 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Multi-Perspective Data Augmentation for Few-shot Object Detection25 Feb
  2. 2024GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editing3 Dec
  3. 2024Enhance Image Classification via Inter-Class Image Mixup with Diffusion Model28 Mar
  4. 2024DreamDA: Generative Data Augmentation with Diffusion Models19 Mar
  5. 2023Readout Guidance: Learning Control from Diffusion Features4 Dec
  6. 2023Synthetic Data from Diffusion Models Improves ImageNet Classification17 Apr
  7. 2023Effective Data Augmentation With Diffusion Models7 Feb

Other references · 54

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2016Matching Networks for One Shot Learningcited by 2,255
  8. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  9. 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
  10. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
  11. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
  12. 2023Universal Guidance for Diffusion Modelscited by 437
38 more
  1. 2019Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgettingcited by 302
  2. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  3. 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
  4. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  5. 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 283
  6. 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
  7. 2020Few-Shot Class-Incremental Learningcited by 251
  8. 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 229
  9. 2023Class-Incremental Learning: A Surveycited by 209
  10. 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 187
  11. 2018Reinforced Continual Learningcited by 186
  12. 2023Manifold Preserving Guided Diffusioncited by 157
  13. 2022A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learningcited by 154
  14. 2020Continual Prototype Evolution: Learning Online from Non-Stationary Data Streamscited by 144
  15. 2022Forward Compatible Few-Shot Class-Incremental Learningcited by 127
  16. 2023Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learningcited by 116
  17. 2022Constrained Few-shot Class-incremental Learningcited by 94
  18. 2025Test-time Alignment of Diffusion Models without Reward Over-optimizationcited by 93
  19. 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 88
  20. 2022Few-Shot Class-Incremental Learning from an Open-Set Perspectivecited by 84
  21. 2021ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual Learningcited by 68
  22. 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
  23. 2020Memory Efficient Class-Incremental Learning for Image Classificationcited by 50
  24. 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
  25. 2023Few-Shot Class-Incremental Learning via Training-Free Prototype Calibrationcited by 46
  26. 2020Continual Learning with Extended Kronecker-factored Approximate Curvaturecited by 39
  27. 2022On the Soft-Subnetwork for Few-shot Class Incremental Learningcited by 37
  28. 2024Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learnerscited by 36
  29. 2024OrCo: Towards Better Generalization via Orthogonality and Contrast for Few-Shot Class-Incremental Learningcited by 26
  30. 2024Measuring Diversity in Co-creative Image Generationcited by 15
  31. 2024Rethinking Few-shot Class-incremental Learning: Learning from Yourselfcited by 14
  32. 2024Learning Prompt with Distribution-Based Feature Replay for Few-Shot Class-Incremental Learningcited by 12
  33. 2024Advancing Fine-Grained Classification by Structure and Subject Preserving Augmentationcited by 12
  34. 2021Learnable Expansion-and-Compression Network for Few-shot Class-Incremental Learningcited by 11
  35. 2024CLOSER: Towards Better Representation Learning for Few-Shot Class-Incremental Learningcited by 11
  36. 2024GenOL: Generating Diverse Examples for Name-only Online Learningcited by 9
  37. 2024GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learningcited by 9
  38. 2025Adaptive Decision Boundary for Few-Shot Class-Incremental Learningcited by 6

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Synthetic Replays: Turning Diffusion Features into Few-Shot Class-Incremental Learning Knowledge
  2. 2025Tripartite Weight-Space Ensemble for Few-Shot Class-Incremental Learning
  3. 2025Breaking Forgetting: Training-Free Few-Shot Class-Incremental Learning via Conditional Diffusion
  4. 2026Learning to Curate What You Generate for Generalizable Few-Shot Class-Incremental Learning
  5. 2025Diffusion Classifiers Understand Compositionality, but Conditions Apply
  6. 2026Steering Diffusion Models via Class-Contrastive Influence for Few-Shot Medical Classification
  7. 2026Feature-Space Generative Models for One-Shot Class-Incremental Learning
  8. 2023Class-Incremental Learning using Diffusion Model for Distillation and Replay