GenSelfDiff-HIS: Generative Self-Supervision Using Diffusion for Histopathological Image Segmentation
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Histopathological image segmentation is a laborious and time-intensive task, often requiring analysis from experienced pathologists for accurate examinations. To reduce this burden, supervised machine-learning approaches have been adopted using large-scale annotated datasets for histopathological image analysis. However, in several scenarios, the availability of large-scale annotated data is a bottleneck while training such models. Self-supervised learning (SSL) is an alternative paradigm that provides some respite by constructing models utilizing only the unannotated data which is often abundant. The basic idea of SSL is to train a network to perform one or many pseudo or pretext tasks on unannotated data and use it subsequently as the basis for a variety of downstream tasks. It is seen that the success of SSL depends critically on the considered pretext task. While there have been many efforts in designing pretext tasks for classification problems, there haven't been many attempts on SSL for histopathological segmentation. Motivated by this, we propose an SSL approach for segmenting histopathological images via generative diffusion models in this paper. Our method is based on the observation that diffusion models effectively solve an image-to-image translation task akin to a segmentation task. Hence, we propose generative diffusion as the pretext task for histopathological image segmentation. We also propose a multi-loss function-based fine-tuning for the downstream task. We validate our method using several metrics on two publically available datasets along with a newly proposed head and neck (HN) cancer dataset containing hematoxylin and eosin (H&E) stained images along with annotations. Codes will be made public at https://github.com/suhas-srinath/GenSelfDiff-HIS.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 51 of its 85 references that are in the map. First posted on arXiv 4 Sep 2023.
Builds on
51 of 85 references.
Closest ancestors · 8
Same direction, newest first
- 2023Ambiguous Medical Image Segmentation using Diffusion Models10 Apr
- 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformer19 Jan
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov
- 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model1 Nov
- 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Images27 Sep
- 2021Diffusion Models for Implicit Image Segmentation Ensembles6 Dec
- 2021Label-Efficient Semantic Segmentation with Diffusion Models6 Dec
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Models1 Dec
Other references · 43
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
31 more
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2016Colorful Image Colorizationcited by 1,113
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2020Self-supervised Learning: Generative or Contrastivecited by 693
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
- 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2022Perception Prioritized Training of Diffusion Modelscited by 301
- 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
- 2020A survey of loss functions for semantic segmentationcited by 216
- 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
- 2019Deep neural network models for computational histopathology: A surveycited by 165
- 2020Self supervised contrastive learning for digital histopathologycited by 146
- 2020Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotationscited by 89
- 2016DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentationcited by 84
- 2017Machine learning methods for histopathological image analysiscited by 79
- 2019Automated Gleason Grading of Prostate Biopsies using Deep Learningcited by 69
- 2022Diffusion Adversarial Representation Learning for Self-supervised Vessel Segmentationcited by 55
- 2021Self-supervised driven consistency training for annotation efficient histopathology image analysiscited by 39
- 2019PathologyGAN: Learning deep representations of cancer tissuecited by 32
- 2022The Fully Convolutional Transformer for Medical Image Segmentationcited by 31
- 2022Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysiscited by 29
- 2020Structure Preserving Stain Normalization of Histopathology Images Using Self-Supervised Semantic Guidancecited by 22
- 2020Divide-and-Rule: Self-Supervised Learning for Survival Analysis in Colorectal Cancercited by 17
- 2021Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applicationscited by 12
- 2022Magnification Prior: A Self-Supervised Method for Learning Representations on Breast Cancer Histopathological Imagescited by 9
- 2022From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathologycited by 9
- 2019Correlation Maximized Structural Similarity Loss for Semantic Segmentationcited by 8
- 2021Adversarial learning of cancer tissue representationscited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compressioncited by 6
- 2024Dynamic Entity-Masked Graph Diffusion Model for histopathological image Representation Learningcited by 0
- 2026Unsupervised Anatomical Feature Learning via Diffusion Models: Enhanced Medical Image Segmentation with Denoising Diffusion Probabilistic Modelscited by 0
- 2026Unsupervised Anatomical Feature Learning via Diffusion Models: Enhanced Medical Image Segmentation with Denoising Diffusion Probabilistic Models26 Aug 2026
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression19 Mar 2026
- 2024Dynamic Entity-Masked Graph Diffusion Model for histopathological image Representation Learning13 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2025PixCell: A generative foundation model for digital histopathology images
- 2024Gen-SIS: Generative Self-augmentation Improves Self-supervised Learning
- 2025PathSegDiff: Pathology Segmentation using Diffusion model representations
- 2023Learned representation-guided diffusion models for large-image generation
- 2025Prototype-Guided Diffusion for Digital Pathology: Achieving Foundation Model Performance with Minimal Clinical Data
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditions
- 2024Unleashing the Potential of Synthetic Images: A Study on Histopathology Image Classification
- 2023PathLDM: Text conditioned Latent Diffusion Model for Histopathology