mlsanityData to 7 Oct 2026

GenSelfDiff-HIS: Generative Self-Supervision Using Diffusion for Histopathological Image Segmentation

arXiv 2309.01487 ↗First posted 4 Sep 2023cs.CVcited by 3

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Histopathological image segmentation is a laborious and time-intensive task, often requiring analysis from experienced pathologists for accurate examinations. To reduce this burden, supervised machine-learning approaches have been adopted using large-scale annotated datasets for histopathological image analysis. However, in several scenarios, the availability of large-scale annotated data is a bottleneck while training such models. Self-supervised learning (SSL) is an alternative paradigm that provides some respite by constructing models utilizing only the unannotated data which is often abundant. The basic idea of SSL is to train a network to perform one or many pseudo or pretext tasks on unannotated data and use it subsequently as the basis for a variety of downstream tasks. It is seen that the success of SSL depends critically on the considered pretext task. While there have been many efforts in designing pretext tasks for classification problems, there haven't been many attempts on SSL for histopathological segmentation. Motivated by this, we propose an SSL approach for segmenting histopathological images via generative diffusion models in this paper. Our method is based on the observation that diffusion models effectively solve an image-to-image translation task akin to a segmentation task. Hence, we propose generative diffusion as the pretext task for histopathological image segmentation. We also propose a multi-loss function-based fine-tuning for the downstream task. We validate our method using several metrics on two publically available datasets along with a newly proposed head and neck (HN) cancer dataset containing hematoxylin and eosin (H&E) stained images along with annotations. Codes will be made public at https://github.com/suhas-srinath/GenSelfDiff-HIS.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 51 of its 85 references that are in the map. First posted on arXiv 4 Sep 2023.

Builds on

51 of 85 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023Ambiguous Medical Image Segmentation using Diffusion Models10 Apr
  2. 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformer19 Jan
  3. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov
  4. 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model1 Nov
  5. 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Images27 Sep
  6. 2021Diffusion Models for Implicit Image Segmentation Ensembles6 Dec
  7. 2021Label-Efficient Semantic Segmentation with Diffusion Models6 Dec
  8. 2021SegDiff: Image Segmentation with Diffusion Probabilistic Models1 Dec

Other references · 43

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  10. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  11. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  12. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
31 more
  1. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  2. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  3. 2016Colorful Image Colorizationcited by 1,113
  4. 2022Diffusion Models in Vision: A Surveycited by 1,008
  5. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  6. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  7. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
  8. 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
  9. 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
  10. 2022Perception Prioritized Training of Diffusion Modelscited by 301
  11. 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
  12. 2020A survey of loss functions for semantic segmentationcited by 216
  13. 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
  14. 2019Deep neural network models for computational histopathology: A surveycited by 165
  15. 2020Self supervised contrastive learning for digital histopathologycited by 146
  16. 2020Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotationscited by 89
  17. 2016DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentationcited by 84
  18. 2017Machine learning methods for histopathological image analysiscited by 79
  19. 2019Automated Gleason Grading of Prostate Biopsies using Deep Learningcited by 69
  20. 2022Diffusion Adversarial Representation Learning for Self-supervised Vessel Segmentationcited by 55
  21. 2021Self-supervised driven consistency training for annotation efficient histopathology image analysiscited by 39
  22. 2019PathologyGAN: Learning deep representations of cancer tissuecited by 32
  23. 2022The Fully Convolutional Transformer for Medical Image Segmentationcited by 31
  24. 2022Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysiscited by 29
  25. 2020Structure Preserving Stain Normalization of Histopathology Images Using Self-Supervised Semantic Guidancecited by 22
  26. 2020Divide-and-Rule: Self-Supervised Learning for Survival Analysis in Colorectal Cancercited by 17
  27. 2021Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applicationscited by 12
  28. 2022Magnification Prior: A Self-Supervised Method for Learning Representations on Breast Cancer Histopathological Imagescited by 9
  29. 2022From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathologycited by 9
  30. 2019Correlation Maximized Structural Similarity Loss for Semantic Segmentationcited by 8
  31. 2021Adversarial learning of cancer tissue representationscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025PixCell: A generative foundation model for digital histopathology images
  2. 2024Gen-SIS: Generative Self-augmentation Improves Self-supervised Learning
  3. 2025PathSegDiff: Pathology Segmentation using Diffusion model representations
  4. 2023Learned representation-guided diffusion models for large-image generation
  5. 2025Prototype-Guided Diffusion for Digital Pathology: Achieving Foundation Model Performance with Minimal Clinical Data
  6. 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditions
  7. 2024Unleashing the Potential of Synthetic Images: A Study on Histopathology Image Classification
  8. 2023PathLDM: Text conditioned Latent Diffusion Model for Histopathology