mlsanityData to 14 Oct 2026

D-Cube: Exploiting Hyper-Features of Diffusion Model for Robust Medical Classification

arXiv 2411.11087 ↗First posted 17 Nov 2024cs.CVcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

The integration of deep learning technologies in medical imaging aims to enhance the efficiency and accuracy of cancer diagnosis, particularly for pancreatic and breast cancers, which present significant diagnostic challenges due to their high mortality rates and complex imaging characteristics. This paper introduces Diffusion-Driven Diagnosis (D-Cube), a novel approach that leverages hyper-features from a diffusion model combined with contrastive learning to improve cancer diagnosis. D-Cube employs advanced feature selection techniques that utilize the robust representational capabilities of diffusion models, enhancing classification performance on medical datasets under challenging conditions such as data imbalance and limited sample availability. The feature selection process optimizes the extraction of clinically relevant features, significantly improving classification accuracy and demonstrating resilience in imbalanced and limited data scenarios. Experimental results validate the effectiveness of D-Cube across multiple medical imaging modalities, including CT, MRI, and X-ray, showing superior performance compared to existing baseline models. D-Cube represents a new strategy in cancer detection, employing advanced deep learning techniques to achieve state-of-the-art diagnostic accuracy and efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 46 of its 67 references that are in the map. First posted on arXiv 17 Nov 2024.

Builds on

46 of 67 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023SP-DiffDose: A Conditional Diffusion Model for Radiation Dose Prediction Based on Multi-Scale Fusion of Anatomical Structures, Guided by SwinTransformer and Projector11 Dec
  2. 2023Improving Nonalcoholic Fatty Liver Disease Classification Performance With Latent Diffusion Models13 Jul
  3. 2023DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classification19 Mar
  4. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov
  5. 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model1 Nov
  6. 2021Label-Efficient Semantic Segmentation with Diffusion Models6 Dec

Other references · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  9. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  10. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  11. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  12. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
28 more
  1. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  2. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
  3. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
  4. 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
  5. 2019Big Transfer (BiT): General Visual Representation Learningcited by 769
  6. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
  7. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
  8. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
  9. 2020ResNeSt: Split-Attention Networkscited by 445
  10. 2021Rethinking Spatial Dimensions of Vision Transformerscited by 361
  11. 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
  12. 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
  13. 2022How Do Vision Transformers Work?cited by 307
  14. 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 306
  15. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  16. 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 214
  17. 2016Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learningcited by 209
  18. 2020Can AI help in screening Viral and COVID-19 pneumonia?cited by 200
  19. 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
  20. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
  21. 2023AM-RADIO: Agglomerative Vision Foundation Model -- Reduce All Domains Into Onecited by 169
  22. 2018An overview of deep learning in medical imaging focusing on MRIcited by 140
  23. 2023Class-Balancing Diffusion Modelscited by 48
  24. 2022Does Robustness on ImageNet Transfer to Downstream Tasks?cited by 20
  25. 2023DFormer: Diffusion-guided Transformer for Universal Image Segmentationcited by 19
  26. 2023Diffusion-based Radiotherapy Dose Prediction Guided by Inter-slice Aware Structure Encodingcited by 5
  27. 2017Deep Learning for identifying radiogenomic associations in breast cancercited by 4
  28. 2022Data variation-aware medical image segmentationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Conditional Diffusion Models are Medical Image Classifiers that Provide Explainability and Uncertainty for Free
  2. 2025Diffusion models applied to skin and oral cancer classification
  3. 2026DiffKD-DCIS: Predicting Upgrade of Ductal Carcinoma In Situ with Diffusion Augmentation and Knowledge Distillation
  4. 2024Multiscale Latent Diffusion Model for Enhanced Feature Extraction from Medical Images
  5. 2023Dissolving Is Amplifying: Towards Fine-Grained Anomaly Detection
  6. 2026DiffusionXRay: A Diffusion and GAN-Based Approach for Enhancing Digitally Reconstructed Chest Radiographs
  7. 2025Breast Cancer Detection in Thermographic Images via Diffusion-Based Augmentation and Nonlinear Feature Fusion
  8. 2024Diff3Dformer: Leveraging Slice Sequence Diffusion for Enhanced 3D CT Classification with Transformer Networks