mlsanityData to 7 Oct 2026

Improving Representation Learning for Histopathologic Images with Cluster Constraints

arXiv 2310.12334 ↗First posted 18 Oct 2023cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Recent advances in whole-slide image (WSI) scanners and computational capabilities have significantly propelled the application of artificial intelligence in histopathology slide analysis. While these strides are promising, current supervised learning approaches for WSI analysis come with the challenge of exhaustively labeling high-resolution slides - a process that is both labor-intensive and time-consuming. In contrast, self-supervised learning (SSL) pretraining strategies are emerging as a viable alternative, given that they don't rely on explicit data annotations. These SSL strategies are quickly bridging the performance disparity with their supervised counterparts. In this context, we introduce an SSL framework. This framework aims for transferable representation learning and semantically meaningful clustering by synergizing invariance loss and clustering loss in WSI analysis. Notably, our approach outperforms common SSL methods in downstream classification and clustering tasks, as evidenced by tests on the Camelyon16 and a pancreatic cancer dataset.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 18 Oct 2023.

Builds on

30 of 46 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  7. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  9. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  10. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  11. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  12. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
18 more
  1. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
  2. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
  3. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
  4. 2020SCAN: Learning to Classify Images without Labelscited by 351
  5. 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 324
  6. 2015Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classificationcited by 159
  7. 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 148
  8. 2016Deep Learning for Identifying Metastatic Breast Cancercited by 93
  9. 2017Detecting Cancer Metastases on Gigapixel Pathology Imagescited by 51
  10. 2020Weakly supervised multiple instance learning histopathological tumor segmentationcited by 46
  11. 2019Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networkscited by 43
  12. 2021Semantic annotation for computational pathology: Multidisciplinary experience and best practice recommendationscited by 13
  13. 2020Self-similarity Student for Partial Label Histopathology Image Segmentationcited by 11
  14. 2022ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology Imagescited by 11
  15. 2021Resolution-Based Distillation for Efficient Histology Image Classificationcited by 10
  16. 2022Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddingscited by 10
  17. 2021Unsupervised Representation Learning from Pathology Images with Multi-directional Contrastive Predictive Codingcited by 3
  18. 2022HistoPerm: A Permutation-Based View Generation Approach for Improving Histopathologic Feature Representation Learningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 4.

8 papers.