Classification and Disease Localization in Histopathology Using Only Global Labels: A Weakly-Supervised Approach
Not on the map. Why?
Abstract (arXiv)
Analysis of histopathology slides is a critical step for many diagnoses, and in particular in oncology where it defines the gold standard. In the case of digital histopathological analysis, highly trained pathologists must review vast whole-slide-images of extreme digital resolution (100,0002 pixels) across multiple zoom levels in order to locate abnormal regions of cells, or in some cases single cells, out of millions. The application of deep learning to this problem is hampered not only by small sample sizes, as typical datasets contain only a few hundred samples, but also by the generation of ground-truth localized annotations for training interpretable classification and segmentation models. We propose a method for disease localization in the context of weakly supervised learning, where only image-level labels are available during training. Even without pixel-level annotations, we are able to demonstrate performance comparable with models trained with strong annotations on the Camelyon-16 lymph node metastases detection challenge. We accomplish this through the use of pre-trained deep convolutional networks, feature embedding, as well as learning via top instances and negative evidence, a multiple instance learning technique from the field of semantic segmentation and object detection.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 7; 2023: 5; 2024: 6; 2025: 6; 2026: 1.
33 papers.
Sort:
- 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 125
- 2021A Comprehensive Review of Computer-aided Whole-slide Image Analysis: from Datasets to Feature Extraction, Segmentation, Classification, and Detection Approachescited by 44
- 2021Self-Supervised Representation Learning using Visual Field Expansion on Digital Pathologycited by 25
- 2021Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancerscited by 23
- 2022Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learningcited by 22
- 2022Robust Medical Image Classification from Noisy Labeled Data with Global and Local Representation Guided Co-trainingcited by 21
- 2021Efficient Classification of Very Large Images with Tiny Objectscited by 17
- 2021Label Cleaning Multiple Instance Learning: Refining Coarse Annotations on Single Whole-Slide Imagescited by 13
- 2023CAMIL: Context-Aware Multiple Instance Learning for Cancer Detection and Subtyping in Whole Slide Imagescited by 13
- 2021WeGleNet: A Weakly-Supervised Convolutional Neural Network for the Semantic Segmentation of Gleason Grades in Prostate Histology Imagescited by 9
- 2024A Systematic Review of Generalization Research in Medical Image Classificationcited by 8
- 2024PathoTune: Adapting Visual Foundation Model to Pathological Specialistscited by 8
21 more
- 2021A State-of-the-art Survey of Artificial Neural Networks for Whole-slide Image Analysis:from Popular Convolutional Neural Networks to Potential Visual Transformerscited by 7
- 2021Gigapixel Histopathological Image Analysis using Attention-based Neural Networkscited by 6
- 2022Predicting microsatellite instability and key biomarkers in colorectal cancer from H&E-stained images: Achieving SOTA predictive performance with fewer data using Swin Transformercited by 6
- 2022Histopathological Image Classification based on Self-Supervised Vision Transformer and Weak Labelscited by 6
- 2023Attention2Minority: A salient instance inference-based multiple instance learning for classifying small lesions in whole slide imagescited by 5
- 2023Cross-attention-based saliency inference for predicting cancer metastasis on whole slide imagescited by 5
- 2022A robust and lightweight deep attention multiple instance learning algorithm for predicting genetic alterationscited by 4
- 2023SRATTA : Sample Re-ATTribution Attack of Secure Aggregation in Federated Learningcited by 3
- 2024CIMIL-CRC: a clinically-informed multiple instance learning framework for patient-level colorectal cancer molecular subtypes classification from H&E stained imagescited by 3
- 2022Colorectal cancer survival prediction using deep distribution based multiple-instance learningcited by 1
- 2024INSIGHT: Explainable Weakly-Supervised Medical Image Analysiscited by 1
- 2025IMILIA: interpretable multiple instance learning for inflammation prediction in IBD from H&E whole slide imagescited by 1
- 2023MesoGraph: Automatic Profiling of Malignant Mesothelioma Subtypes from Histological Imagescited by 0
- 2024CARMIL: Context-Aware Regularization on Multiple Instance Learning models for Whole Slide Imagescited by 0
- 2024Leveraging Transfer Learning and Multiple Instance Learning for HER2 Automatic Scoring of H&E Whole Slide Imagescited by 0
- 2025Robust sensitivity control in digital pathology via tile score distribution matchingcited by 0
- 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learningcited by 0
- 2025Histomorphology-Guided Prototypical Multi-Instance Learning for Breast Cancer WSI Classificationcited by 0
- 2025Cluster-Level Sparse Multi-Instance Learning for Whole-Slide Imagescited by 0
- 2025GAS-MIL: Group-Aggregative Selection Multi-Instance Learning for Ensemble of Foundation Models in Digital Pathology Image Analysiscited by 0
- 2026Multimodal Fusion of Histopathology Images and Electronic Health Records for Early Breast Cancer Diagnosiscited by 0
- 2026Multimodal Fusion of Histopathology Images and Electronic Health Records for Early Breast Cancer Diagnosis18 Apr 2026
- 2025IMILIA: interpretable multiple instance learning for inflammation prediction in IBD from H&E whole slide images15 Dec 2025
- 2025GAS-MIL: Group-Aggregative Selection Multi-Instance Learning for Ensemble of Foundation Models in Digital Pathology Image Analysis3 Oct 2025
- 2025Cluster-Level Sparse Multi-Instance Learning for Whole-Slide Images14 Sep 2025
- 2025Histomorphology-Guided Prototypical Multi-Instance Learning for Breast Cancer WSI Classification23 Mar 2025
- 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learning7 Mar 2025
- 2025Robust sensitivity control in digital pathology via tile score distribution matching27 Feb 2025
- 2024INSIGHT: Explainable Weakly-Supervised Medical Image Analysis2 Dec 2024
- 2024Leveraging Transfer Learning and Multiple Instance Learning for HER2 Automatic Scoring of H&E Whole Slide Images5 Nov 2024
- 2024CARMIL: Context-Aware Regularization on Multiple Instance Learning models for Whole Slide Images1 Aug 2024
- 2024PathoTune: Adapting Visual Foundation Model to Pathological Specialists25 Mar 2024
- 2024A Systematic Review of Generalization Research in Medical Image Classification18 Mar 2024
21 more
- 2024CIMIL-CRC: a clinically-informed multiple instance learning framework for patient-level colorectal cancer molecular subtypes classification from H&E stained images29 Jan 2024
- 2023Cross-attention-based saliency inference for predicting cancer metastasis on whole slide images18 Sep 2023
- 2023SRATTA : Sample Re-ATTribution Attack of Secure Aggregation in Federated Learning13 Jun 2023
- 2023CAMIL: Context-Aware Multiple Instance Learning for Cancer Detection and Subtyping in Whole Slide Images9 May 2023
- 2023MesoGraph: Automatic Profiling of Malignant Mesothelioma Subtypes from Histological Images23 Feb 2023
- 2023Attention2Minority: A salient instance inference-based multiple instance learning for classifying small lesions in whole slide images18 Jan 2023
- 2022Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learning17 Oct 2022
- 2022Histopathological Image Classification based on Self-Supervised Vision Transformer and Weak Labels17 Oct 2022
- 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settings10 Oct 2022
- 2022Predicting microsatellite instability and key biomarkers in colorectal cancer from H&E-stained images: Achieving SOTA predictive performance with fewer data using Swin Transformer22 Aug 2022
- 2022A robust and lightweight deep attention multiple instance learning algorithm for predicting genetic alterations31 May 2022
- 2022Robust Medical Image Classification from Noisy Labeled Data with Global and Local Representation Guided Co-training10 May 2022
- 2022Colorectal cancer survival prediction using deep distribution based multiple-instance learning24 Apr 2022
- 2021Label Cleaning Multiple Instance Learning: Refining Coarse Annotations on Single Whole-Slide Images22 Sep 2021
- 2021Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancers13 Sep 2021
- 2021Self-Supervised Representation Learning using Visual Field Expansion on Digital Pathology7 Sep 2021
- 2021Efficient Classification of Very Large Images with Tiny Objects4 Jun 2021
- 2021WeGleNet: A Weakly-Supervised Convolutional Neural Network for the Semantic Segmentation of Gleason Grades in Prostate Histology Images21 May 2021
- 2021A State-of-the-art Survey of Artificial Neural Networks for Whole-slide Image Analysis:from Popular Convolutional Neural Networks to Potential Visual Transformers13 Apr 2021
- 2021A Comprehensive Review of Computer-aided Whole-slide Image Analysis: from Datasets to Feature Extraction, Segmentation, Classification, and Detection Approaches21 Feb 2021
- 2021Gigapixel Histopathological Image Analysis using Attention-based Neural Networks25 Jan 2021
- 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 125
- 2021A Comprehensive Review of Computer-aided Whole-slide Image Analysis: from Datasets to Feature Extraction, Segmentation, Classification, and Detection Approachescited by 44
- 2021Self-Supervised Representation Learning using Visual Field Expansion on Digital Pathologycited by 25
- 2021Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancerscited by 23
- 2022Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learningcited by 22
- 2022Robust Medical Image Classification from Noisy Labeled Data with Global and Local Representation Guided Co-trainingcited by 21
- 2021Efficient Classification of Very Large Images with Tiny Objectscited by 17
- 2021Label Cleaning Multiple Instance Learning: Refining Coarse Annotations on Single Whole-Slide Imagescited by 13
- 2023CAMIL: Context-Aware Multiple Instance Learning for Cancer Detection and Subtyping in Whole Slide Imagescited by 13
- 2021WeGleNet: A Weakly-Supervised Convolutional Neural Network for the Semantic Segmentation of Gleason Grades in Prostate Histology Imagescited by 9
- 2024A Systematic Review of Generalization Research in Medical Image Classificationcited by 8
- 2024PathoTune: Adapting Visual Foundation Model to Pathological Specialistscited by 8
12 most cited of 33 All 33 (JSON)
- 2026Multimodal Fusion of Histopathology Images and Electronic Health Records for Early Breast Cancer Diagnosis18 Apr 2026
- 2025IMILIA: interpretable multiple instance learning for inflammation prediction in IBD from H&E whole slide images15 Dec 2025
- 2025GAS-MIL: Group-Aggregative Selection Multi-Instance Learning for Ensemble of Foundation Models in Digital Pathology Image Analysis3 Oct 2025
- 2025Cluster-Level Sparse Multi-Instance Learning for Whole-Slide Images14 Sep 2025
- 2025Histomorphology-Guided Prototypical Multi-Instance Learning for Breast Cancer WSI Classification23 Mar 2025
- 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learning7 Mar 2025
- 2025Robust sensitivity control in digital pathology via tile score distribution matching27 Feb 2025
- 2024INSIGHT: Explainable Weakly-Supervised Medical Image Analysis2 Dec 2024
- 2024Leveraging Transfer Learning and Multiple Instance Learning for HER2 Automatic Scoring of H&E Whole Slide Images5 Nov 2024
- 2024CARMIL: Context-Aware Regularization on Multiple Instance Learning models for Whole Slide Images1 Aug 2024
- 2024PathoTune: Adapting Visual Foundation Model to Pathological Specialists25 Mar 2024
- 2024A Systematic Review of Generalization Research in Medical Image Classification18 Mar 2024
12 newest of 33 All 33 (JSON)