mlsanityData to 7 Oct 2026

Consistency Regularisation in Varying Contexts and Feature Perturbations for Semi-Supervised Semantic Segmentation of Histology Images

arXiv 2301.13141 ↗First posted 30 Jan 2023cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Semantic segmentation of various tissue and nuclei types in histology images is fundamental to many downstream tasks in the area of computational pathology (CPath). In recent years, Deep Learning (DL) methods have been shown to perform well on segmentation tasks but DL methods generally require a large amount of pixel-wise annotated data. Pixel-wise annotation sometimes requires expert's knowledge and time which is laborious and costly to obtain. In this paper, we present a consistency based semi-supervised learning (SSL) approach that can help mitigate this challenge by exploiting a large amount of unlabelled data for model training thus alleviating the need for a large annotated dataset. However, SSL models might also be susceptible to changing context and features perturbations exhibiting poor generalisation due to the limited training data. We propose an SSL method that learns robust features from both labelled and unlabelled images by enforcing consistency against varying contexts and feature perturbations. The proposed method incorporates context-aware consistency by contrasting pairs of overlapping images in a pixel-wise manner from changing contexts resulting in robust and context invariant features. We show that cross-consistency training makes the encoder features invariant to different perturbations and improves the prediction confidence. Finally, entropy minimisation is employed to further boost the confidence of the final prediction maps from unlabelled data. We conduct an extensive set of experiments on two publicly available large datasets (BCSS and MoNuSeg) and show superior performance compared to the state-of-the-art methods.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 48 of its 87 references that are in the map. First posted on arXiv 30 Jan 2023.

Builds on

48 of 87 references.

References · 48

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  7. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  8. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  10. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  11. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  12. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
36 more
  1. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  2. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  3. 2016Pyramid Scene Parsing Networkcited by 2,472
  4. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  5. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
  6. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
  7. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  8. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
  9. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
  10. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
  11. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  12. 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
  13. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
  14. 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 462
  15. 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 375
  16. 2019ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoringcited by 349
  17. 2019Semi-supervised Domain Adaptation via Minimax Entropycited by 333
  18. 2017Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approachcited by 201
  19. 2019Asymmetric Non-local Neural Networks for Semantic Segmentationcited by 196
  20. 2020PseudoSeg: Designing Pseudo Labels for Semantic Segmentationcited by 180
  21. 2018Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi- Supervised Semantic Segmentationcited by 145
  22. 2019Domain Adaptation for Semantic Segmentation with Maximum Squares Losscited by 138
  23. 2020Guided Collaborative Training for Pixel-wise Semi-Supervised Learningcited by 120
  24. 2021Semi-supervised Semantic Segmentation with Directional Context-aware Consistencycited by 112
  25. 2020Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotationscited by 89
  26. 2018MILD-Net: Minimal Information Loss Dilated Network for Gland Instance Segmentation in Colon Histology Imagescited by 87
  27. 2022TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentationcited by 82
  28. 2021Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learningcited by 30
  29. 2018Fast and Accurate Tumor Segmentation of Histology Images using Persistent Homology and Deep Convolutional Featurescited by 28
  30. 2019Signet Ring Cell Detection With a Semi-supervised Learning Frameworkcited by 27
  31. 2021Stain-Robust Mitotic Figure Detection for the Mitosis Domain Generalization Challengecited by 14
  32. 2020Self-similarity Student for Partial Label Histopathology Image Segmentationcited by 11
  33. 2021Robust Interactive Semantic Segmentation of Pathology Images with Minimal User Inputcited by 8
  34. 2021Simultaneous Nuclear Instance and Layer Segmentation in Oral Epithelial Dysplasiacited by 8
  35. 2021A digital score of tumour-associated stroma infiltrating lymphocytes predicts survival in head and neck squamous cell carcinomacited by 3
  36. 2020HydraMix-Net: A Deep Multi-task Semi-supervised Learning Approach for Cell Detection and Classificationcited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 3; 2025: 2.

6 papers.