Improving Representation Learning for Histopathologic Images with Cluster Constraints
Not on the map. Why?
Abstract (arXiv)
Recent advances in whole-slide image (WSI) scanners and computational capabilities have significantly propelled the application of artificial intelligence in histopathology slide analysis. While these strides are promising, current supervised learning approaches for WSI analysis come with the challenge of exhaustively labeling high-resolution slides - a process that is both labor-intensive and time-consuming. In contrast, self-supervised learning (SSL) pretraining strategies are emerging as a viable alternative, given that they don't rely on explicit data annotations. These SSL strategies are quickly bridging the performance disparity with their supervised counterparts. In this context, we introduce an SSL framework. This framework aims for transferable representation learning and semantically meaningful clustering by synergizing invariance loss and clustering loss in WSI analysis. Notably, our approach outperforms common SSL methods in downstream classification and clustering tasks, as evidenced by tests on the Camelyon16 and a pancreatic cancer dataset.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 18 Oct 2023.
Builds on
30 of 46 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
18 more
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
- 2020SCAN: Learning to Classify Images without Labelscited by 351
- 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 324
- 2015Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classificationcited by 159
- 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 148
- 2016Deep Learning for Identifying Metastatic Breast Cancercited by 93
- 2017Detecting Cancer Metastases on Gigapixel Pathology Imagescited by 51
- 2020Weakly supervised multiple instance learning histopathological tumor segmentationcited by 46
- 2019Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networkscited by 43
- 2021Semantic annotation for computational pathology: Multidisciplinary experience and best practice recommendationscited by 13
- 2020Self-similarity Student for Partial Label Histopathology Image Segmentationcited by 11
- 2022ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology Imagescited by 11
- 2021Resolution-Based Distillation for Efficient Histology Image Classificationcited by 10
- 2022Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddingscited by 10
- 2021Unsupervised Representation Learning from Pathology Images with Multi-directional Contrastive Predictive Codingcited by 3
- 2022HistoPerm: A Permutation-Based View Generation Approach for Improving Histopathologic Feature Representation Learningcited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 4.
8 papers.
- 2025Self-Supervision Enhances Instance-based Multiple Instance Learning Methods in Digital Pathology: A Benchmark Studycited by 6
- 2024Learning Spatial-Preserving Hierarchical Representations for Digital Pathologycited by 1
- 2024Efficient Self-Supervised Barlow Twins from Limited Tissue Slide Cohorts for Colonic Pathology Diagnosticscited by 1
- 2026Exploiting Label-Independent Regularization from Spatial Dependencies for Whole Slide Image Analysiscited by 1
- 2026HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modelingcited by 1
- 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learningcited by 0
- 2026Prototype Instance-semantic Disentanglement with Low-rank Regularized Subspace Clustering for WSIs Explainable Recognitioncited by 0
- 2026MacNet: An End-to-End Manifold-Constrained Adaptive Clustering Network for Interpretable Whole Slide Image Classificationcited by 0
- 2026HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modeling12 Jun 2026
- 2026Exploiting Label-Independent Regularization from Spatial Dependencies for Whole Slide Image Analysis23 Feb 2026
- 2026MacNet: An End-to-End Manifold-Constrained Adaptive Clustering Network for Interpretable Whole Slide Image Classification16 Feb 2026
- 2026Prototype Instance-semantic Disentanglement with Low-rank Regularized Subspace Clustering for WSIs Explainable Recognition16 Feb 2026
- 2025Self-Supervision Enhances Instance-based Multiple Instance Learning Methods in Digital Pathology: A Benchmark Study2 May 2025
- 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learning7 Mar 2025
- 2024Efficient Self-Supervised Barlow Twins from Limited Tissue Slide Cohorts for Colonic Pathology Diagnostics8 Nov 2024
- 2024Learning Spatial-Preserving Hierarchical Representations for Digital Pathology13 Jun 2024