mlsanityData to 7 Oct 2026

Class-Balancing Diffusion Models

arXiv 2305.00562 ↗First posted 30 Apr 2023cs.CV cs.LGcited by 47

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion-based models have shown the merits of generating high-quality visual data while preserving better diversity in recent studies. However, such observation is only justified with curated data distribution, where the data samples are nicely pre-processed to be uniformly distributed in terms of their labels. In practice, a long-tailed data distribution appears more common and how diffusion models perform on such class-imbalanced data remains unknown. In this work, we first investigate this problem and observe significant degradation in both diversity and fidelity when the diffusion model is trained on datasets with class-imbalanced distributions. Especially in tail classes, the generations largely lose diversity and we observe severe mode-collapse issues. To tackle this problem, we set from the hypothesis that the data distribution is not class-balanced, and propose Class-Balancing Diffusion Models (CBDM) that are trained with a distribution adjustment regularizer as a solution. Experiments show that images generated by CBDM exhibit higher diversity and quality in both quantitative and qualitative ways. Our method benchmarked the generation results on CIFAR100/CIFAR100LT dataset and shows outstanding performance on the downstream recognition task.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 45 of its 55 references that are in the map. First posted on arXiv 30 Apr 2023.

Builds on

45 of 55 references.

Closest ancestors · 10

Same direction, newest first

  1. 2022Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model16 Aug
  2. 2022Classifier-Free Diffusion Guidance26 Jul
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  4. 2022Few-Shot Diffusion Models30 May
  5. 2022Generating High Fidelity Data from Low-density Regions using Diffusion Models31 Mar
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  7. 2021Score-based Generative Modeling in Latent Space10 Jun
  8. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  9. 2020Denoising Diffusion Implicit Models6 Oct
  10. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 35

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  5. 2016Improved Techniques for Training GANscited by 2,938
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  7. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  8. 2022Video Diffusion Modelscited by 2,280
  9. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  10. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  11. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  12. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 987
23 more
  1. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  2. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
  3. 2020Long-tail learning via logit adjustmentcited by 605
  4. 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 604
  5. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  6. 2018Assessing Generative Models via Precision and Recallcited by 401
  7. 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 361
  8. 2017WebVision Database: Visual Learning and Understanding from Web Datacited by 262
  9. 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 156
  10. 2020Feature Space Augmentation for Long-Tailed Datacited by 136
  11. 2020M2m: Imbalanced Classification via Major-to-minor Translationcited by 134
  12. 2020Deep Representation Learning on Long-tailed Data: A Learnable Embedding Augmentation Perspectivecited by 120
  13. 2017Stabilizing Training of Generative Adversarial Networks through Regularizationcited by 118
  14. 2018Generative Modeling using the Sliced Wasserstein Distancecited by 108
  15. 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
  16. 2020Adversarial score matching and improved sampling for image generationcited by 95
  17. 2021RSG: A Simple but Effective Module for Learning Imbalanced Datasetscited by 61
  18. 2016Factors in Finetuning Deep Model for object detectioncited by 53
  19. 2022Long-Tailed Classification of Thorax Diseases on Chest X-Ray: A New Benchmark Studycited by 45
  20. 2022Guided Diffusion Model for Adversarial Purification from Random Noisecited by 34
  21. 2021Class Balancing GAN with a Classifier in the Loopcited by 17
  22. 2022Improving GANs for Long-Tailed Data through Group Spectral Regularizationcited by 14
  23. 2022Learning Imbalanced Datasets with Maximum Margin Losscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 20; 2025: 16; 2026: 10.

47 papers.

Sort:

By area:

  1. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  2. 2024Image Generation Diversity Issues and How to Tame Themcited by 22
  3. 2024Self-Guided Generation of Minority Samples Using Diffusion Modelscited by 19
  4. 2024Minority-Focused Text-to-Image Generation via Prompt Optimizationcited by 18
  5. 2024Label-Noise Robust Diffusion Modelscited by 16
  6. 2024TabEBM: A Tabular Data Augmentation Method with Distinct Class-Specific Energy-Based Modelscited by 15
  7. 2024Latent-based Diffusion Model for Long-tailed Recognitioncited by 14
  8. 2024Bayesian Learning-driven Prototypical Contrastive Loss for Class-Incremental Learningcited by 13
  9. 2025DreamInsert: Zero-Shot Image-to-Video Object Insertion from A Single Imagecited by 6
  10. 2024Training Class-Imbalanced Diffusion Model Via Overlap Optimizationcited by 5
  11. 2024TabMDA: Tabular Manifold Data Augmentation for Any Classifier using Transformers with In-context Subsettingcited by 5
  12. 2025Boost-and-Skip: A Simple Guidance-Free Diffusion for Minority Generationcited by 5
35 more
  1. 2025CheXGenBench: A Unified Benchmark For Fidelity, Privacy and Utility of Synthetic Chest Radiographscited by 5
  2. 2025Calibrating Generative Models to Distributional Constraintscited by 5
  3. 2024Long Tail Image Generation Through Feature Space Augmentation and Iterated Learningcited by 4
  4. 2024FairSkin: Fair Diffusion for Skin Disease Image Generationcited by 4
  5. 2025TFG-Flow: Training-free Guidance in Multimodal Generative Flowcited by 4
  6. 2024DiffuLT: How to Make Diffusion Model Useful for Long-tail Recognitioncited by 3
  7. 2024Negative Token Merging: Image-based Adversarial Feature Guidancecited by 3
  8. 2025Score-based generative emulation of impact-relevant Earth system model outputscited by 3
  9. 2024An Ordinal Diffusion Model for Generating Medical Images with Different Severity Levelscited by 2
  10. 2024Large Generative Graph Modelscited by 2
  11. 2025PoGDiff: Product-of-Gaussians Diffusion Models for Imbalanced Text-to-Image Generationcited by 2
  12. 2025Causal Disentanglement for Robust Long-tail Medical Image Generationcited by 2
  13. 2025VAP-Diffusion: Enriching Descriptions with MLLMs for Enhanced Medical Image Generationcited by 2
  14. 2025Imbalance in Balance: Online Concept Balancing in Generation Modelscited by 2
  15. 2024GANsemble for Small and Imbalanced Data Sets: A Baseline for Synthetic Microplastics Datacited by 1
  16. 2025Offline Diffusion Policy for Multi-User Delay-Constrained Schedulingcited by 1
  17. 2025Language-Informed Hyperspectral Image Synthesis for Imbalanced-Small Sample Classification via Semi-Supervised Conditional Diffusion Modelcited by 1
  18. 2025Contrastive Conditional-Unconditional Alignment for Long-tailed Diffusion Modelcited by 1
  19. 2025Heavy-Tailed Class-Conditional Priors for Long-Tailed Generative Modelingcited by 1
  20. 2025Reweighted Flow Matching via Unbalanced OT for Label-free Long-tailed Generationcited by 1
  21. 2026Decision Boundary-aware Generation for Long-tailed Learningcited by 1
  22. 2026The Learnability Gap in Medical Latent Diffusioncited by 1
  23. 2024DiffAugment: Diffusion based Long-Tailed Visual Relationship Recognitioncited by 0
  24. 2024CFCPalsy: Facial Image Synthesis with Cross-Fusion Cycle Diffusion Model for Facial Paralysis Individualscited by 0
  25. 2024Anisotropic Diffusion Probabilistic Model for Imbalanced Image Classificationcited by 0
  26. 2024D-Cube: Exploiting Hyper-Features of Diffusion Model for Robust Medical Classificationcited by 0
  27. 2025NS-Pep: De novo Peptide Design with Non-Standard Amino Acidscited by 0
  28. 2026Mitigating Long-Tail Bias via Prompt-Controlled Diffusion Augmentationcited by 0
  29. 2026Synthetic Data Generation for Long-Tail Medical Image Classification: A Case Study in Skin Lesionscited by 0
  30. 2026Flow Matching with Optimized Subclass Priors for Medical Image Augmentationcited by 0
  31. 2026FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesiscited by 0
  32. 2026Class-frequency Guided Noise Schedule for Diffusion Modelscited by 0
  33. 2026Demographically-Conditioned Synthetic Medical Images for Bias Mitigation and Bias Detection in Disease Classifierscited by 0
  34. 2026MGDiff: Multi-Interest Sequence Recommendation with Masking GNN-Guided Diffusioncited by 0
  35. 2026DiVid: Diagnosing Dimension-Specific Diversity Collapse in Video Generation Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Harnessing Diffusion-Generated Synthetic Images for Fair Image Classification
  2. 2025CORAL: Disentangling Latent Representations in Long-Tailed Diffusion
  3. 2023Discriminative Class Tokens for Text-to-Image Diffusion Models
  4. 2026The Interplay of Data Structure and Imbalance in the Learning Dynamics of Diffusion Models
  5. 2025Debiasing Diffusion Model: Enhancing Fairness through Latent Representation Learning in Stable Diffusion Model
  6. 2025Diffusion Models as Dataset Distillation Priors
  7. 2025DDB: Diffusion Driven Balancing to Address Spurious Correlations
  8. 2026Debias Anything: Fairness with Diversity without Supervision in Diffusion Models