mlsanityData to 14 Oct 2026

Anisotropic Diffusion Probabilistic Model for Imbalanced Image Classification

arXiv 2409.14313 ↗First posted 22 Sep 2024cs.CVcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Real-world data often has a long-tailed distribution, where the scarcity of tail samples significantly limits the model's generalization ability. Denoising Diffusion Probabilistic Models (DDPM) are generative models based on stochastic differential equation theory and have demonstrated impressive performance in image classification tasks. However, existing diffusion probabilistic models do not perform satisfactorily in classifying tail classes. In this work, we propose the Anisotropic Diffusion Probabilistic Model (ADPM) for imbalanced image classification problems. We utilize the data distribution to control the diffusion speed of different class samples during the forward process, effectively improving the classification accuracy of the denoiser in the reverse process. Specifically, we provide a theoretical strategy for selecting noise levels for different categories in the diffusion process based on error analysis theory to address the imbalanced classification problem. Furthermore, we integrate global and local image prior in the forward process to enhance the model's discriminative ability in the spatial dimension, while incorporate semantic-level contextual information in the reverse process to boost the model's discriminative power and robustness. Through comparisons with state-of-the-art methods on four medical benchmark datasets, we validate the effectiveness of the proposed method in handling long-tail data. Our results confirm that the anisotropic diffusion model significantly improves the classification accuracy of rare classes while maintaining the accuracy of head classes. On the skin lesion datasets, PAD-UFES and HAM10000, the F1-scores of our method improved by 4% and 3%, respectively compared to the original diffusion probabilistic model.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 47 of its 63 references that are in the map. First posted on arXiv 22 Sep 2024.

Builds on

47 of 63 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Latent-based Diffusion Model for Long-tailed Recognition6 Apr
  2. 2023Class-Balancing Diffusion Models30 Apr
  3. 2022CARD: Classification and Regression Diffusion Models15 Jun
  4. 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
  5. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  6. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 41

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2016Densely Connected Convolutional Networkscited by 6,720
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  10. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  11. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  12. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
29 more
  1. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
  2. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
  3. 2017Deep Learning Scaling is Predictable, Empiricallycited by 582
  4. 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 579
  5. 2019BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognitioncited by 403
  6. 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
  7. 2017Tversky loss function for image segmentation using 3D fully convolutional deep networkscited by 228
  8. 2020Rethinking the Value of Labels for Improving Class-Imbalanced Learningcited by 216
  9. 2019A Constructive Prediction of the Generalization Error Across Scalescited by 210
  10. 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Modelcited by 180
  11. 2020Remix: Rebalanced Mixupcited by 144
  12. 2020Rethinking Class-Balanced Methods for Long-Tailed Visual Recognition from a Domain Adaptation Perspectivecited by 143
  13. 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
  14. 2019A deep learning system for differential diagnosis of skin diseasescited by 118
  15. 2016Range Loss for Deep Face Recognition with Long-tailcited by 111
  16. 2021The Majority Can Help The Minority: Context-rich Minority Oversampling for Long-tailed Classificationcited by 100
  17. 2021Balanced-MixUp for Highly Imbalanced Medical Image Classificationcited by 46
  18. 2021Learning with Multiclass AUC: Theory and Algorithmscited by 35
  19. 2023DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classificationcited by 32
  20. 2022ProCo: Prototype-aware Contrastive Learning for Long-tailed Medical Image Classificationcited by 25
  21. 2022Class-Difficulty Based Methods for Long-Tailed Visual Recognitioncited by 23
  22. 2019The impact of patient clinical information on automated skin cancer detectioncited by 21
  23. 2024Crowdsourcing Dermatology Images with Google Search Ads: Creating a Real-World Skin Condition Datasetcited by 21
  24. 2023Synthesising Rare Cataract Surgery Samples with Guided Diffusion Modelscited by 14
  25. 2024Geometric Prior Guided Feature Representation Learning for Long-Tailed Classificationcited by 10
  26. 2020Distractor-Aware Neuron Intrinsic Learning for Generic 2D Medical Image Classificationscited by 7
  27. 2023A Novel Multi-Task Model Imitating Dermatologists for Accurate Differential Diagnosis of Skin Diseases in Clinical Imagescited by 6
  28. 2022Bioinspired random projections for robust, sparse classificationcited by 4
  29. 2018A Deep Multi-task Learning Approach to Skin Lesion Classificationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Training Class-Imbalanced Diffusion Model Via Overlap Optimization
  2. 2022Diffusion Models in Vision: A Survey
  3. 2025Learning What Matters: Steering Diffusion via Spectrally Anisotropic Forward Noise
  4. 2025Diffusion Models: A Mathematical Introduction
  5. 2020Denoising Diffusion Implicit Models
  6. 2022Enhancing Diffusion-Based Image Synthesis with Robust Classifier Guidance
  7. 2023UDPM: Upsampling Diffusion Probabilistic Models
  8. 2024An overview of diffusion models for generative artificial intelligence