HistoPerm: A Permutation-Based View Generation Approach for Improving Histopathologic Feature Representation Learning
Not on the map. Why?
Abstract (arXiv)
Deep learning has been effective for histology image analysis in digital pathology. However, many current deep learning approaches require large, strongly- or weakly-labeled images and regions of interest, which can be time-consuming and resource-intensive to obtain. To address this challenge, we present HistoPerm, a view generation method for representation learning using joint embedding architectures that enhances representation learning for histology images. HistoPerm permutes augmented views of patches extracted from whole-slide histology images to improve classification performance. We evaluated the effectiveness of HistoPerm on two histology image datasets for Celiac disease and Renal Cell Carcinoma, using three widely used joint embedding architecture-based representation learning methods: BYOL, SimCLR, and VICReg. Our results show that HistoPerm consistently improves patch- and slide-level classification performance in terms of accuracy, F1-score, and AUC. Specifically, for patch-level classification accuracy on the Celiac disease dataset, HistoPerm boosts BYOL and VICReg by 8% and SimCLR by 3%. On the Renal Cell Carcinoma dataset, patch-level classification accuracy is increased by 2% for BYOL and VICReg, and by 1% for SimCLR. In addition, on the Celiac disease dataset, models with HistoPerm outperform the fully-supervised baseline model by 6%, 5%, and 2% for BYOL, SimCLR, and VICReg, respectively. For the Renal Cell Carcinoma dataset, HistoPerm lowers the classification accuracy gap for the models up to 10% relative to the fully-supervised baseline. These findings suggest that HistoPerm can be a valuable tool for improving representation learning of histopathology features when access to labeled data is limited and can lead to whole-slide classification results that are comparable to or superior to fully-supervised methods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 47 of its 71 references that are in the map. First posted on arXiv 13 Sep 2022.
Builds on
47 of 71 references.
References · 47
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
35 more
- 2020Supervised Contrastive Learningcited by 2,803
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2020What Makes for Good Views for Contrastive Learning?cited by 843
- 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
- 2017Large Batch Training of Convolutional Networkscited by 529
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
- 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 324
- 2020Whitening for Self-Supervised Representation Learningcited by 278
- 2019Kornia: an Open Source Differentiable Computer Vision Library for PyTorchcited by 231
- 2020Self supervised contrastive learning for digital histopathologycited by 146
- 2020BYOL works even without batch statisticscited by 95
- 2020Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotationscited by 89
- 2017Detecting Cancer Metastases on Gigapixel Pathology Imagescited by 51
- 2022Self-Supervised Vision Transformers Learn Visual Concepts in Histopathologycited by 49
- 2020Weakly supervised multiple instance learning histopathological tumor segmentationcited by 46
- 2019Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networkscited by 43
- 2020Self-Supervision Closes the Gap Between Weak and Strong Supervision in Histologycited by 43
- 2021Mine Your Own vieW: Self-Supervised Learning Through Across-Sample Predictioncited by 36
- 2019Semi-Supervised Histology Classification using Deep Multiple Instance Learning and Contrastive Predictive Codingcited by 35
- 2022Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Imagescited by 32
- 2020Self-Supervised Nuclei Segmentation in Histopathological Images Using Attentioncited by 30
- 2018Attention-Based Deep Neural Networks for Detection of Cancerous and Precancerous Esophagus Tissue on Histopathological Slidescited by 29
- 2019Processing Megapixel Images with Deep Attention-Sampling Modelscited by 29
- 2017Deep-Learning for Classification of Colorectal Polyps on Whole-Slide Imagescited by 26
- 2020Development and Evaluation of a Deep Neural Network for Histologic Classification of Renal Cell Carcinoma on Biopsy and Surgical Resection Slidescited by 24
- 2019Self-Supervised Similarity Learning for Digital Pathologycited by 22
- 2021Improving Self-supervised Learning with Hardness-aware Dynamic Curriculum Learning: An Application to Digital Pathologycited by 13
- 2021Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applicationscited by 12
- 2019Automated detection of celiac disease on duodenal biopsy slides: a deep learning approachcited by 6
- 2020Breast Cancer Histopathology Image Classification and Localization using Multiple Instance Learningcited by 6
Built on by
Citing papers per year: 2023: 2.
2 papers.