Cross-scale Multi-instance Learning for Pathological Image Diagnosis
Not on the map. Why?
Abstract (arXiv)
Analyzing high resolution whole slide images (WSIs) with regard to information across multiple scales poses a significant challenge in digital pathology. Multi-instance learning (MIL) is a common solution for working with high resolution images by classifying bags of objects (i.e. sets of smaller image patches). However, such processing is typically performed at a single scale (e.g., 20x magnification) of WSIs, disregarding the vital inter-scale information that is key to diagnoses by human pathologists. In this study, we propose a novel cross-scale MIL algorithm to explicitly aggregate inter-scale relationships into a single MIL network for pathological image diagnosis. The contribution of this paper is three-fold: (1) A novel cross-scale MIL (CS-MIL) algorithm that integrates the multi-scale information and the inter-scale relationships is proposed; (2) A toy dataset with scale-specific morphological features is created and released to examine and visualize differential cross-scale attention; (3) Superior performance on both in-house and public datasets is demonstrated by our simple cross-scale MIL strategy. The official implementation is publicly available at https://github.com/hrlblab/CS-MIL.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 1 Apr 2023.
Builds on
19 of 42 references.
References · 19
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
- 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 254
- 2020Whole Slide Images based Cancer Survival Prediction using Attention Guided Deep Multiple Instance Learning Networkscited by 178
- 2015Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classificationcited by 159
- 2016Deep Learning for Identifying Metastatic Breast Cancercited by 93
- 2020Multi-scale Domain-adversarial Multiple-instance CNN for Cancer Subtype Classification with Unannotated Histopathological Imagescited by 81
- 2019Deep Learning for Whole Slide Image Analysis: An Overviewcited by 51
- 2020Self-Supervision Closes the Gap Between Weak and Strong Supervision in Histologycited by 43
- 2019Adaptive Weighting Multi-Field-of-View CNN for Semantic Segmentation in Pathologycited by 36
7 more
- 2021UniToPatho, a labeled histopathological dataset for colorectal polyps classification and adenoma dysplasia gradingcited by 33
- 2020RMDL: Recalibrated multi-instance deep learning for whole slide gastric image classificationcited by 28
- 2023Diagnose Like a Pathologist: Transformer-Enabled Hierarchical Attention-Guided Multiple Instance Learning for Whole Slide Image Classificationcited by 27
- 2018Negative Log Likelihood Ratio Loss for Deep Neural Network Classificationcited by 17
- 2020SOS: Selective Objective Switch for Rapid Immunofluorescence Whole Slide Image Classificationcited by 12
- 2020AMINN: Autoencoder-based Multiple Instance Neural Network Improves Outcome Prediction of Multifocal Liver Metastasescited by 8
- 2022Cross-scale Attention Guided Multi-instance Learning for Crohn's Disease Diagnosis with Pathological Imagescited by 4
Built on by
Citing papers per year: 2024: 2; 2025: 7; 2026: 2.
11 papers.
- 2025Self-Supervision Enhances Instance-based Multiple Instance Learning Methods in Digital Pathology: A Benchmark Studycited by 6
- 2025DPsurv: Dual-Prototype Evidential Fusion for Uncertainty-Aware and Interpretable Whole-Slide Image Survival Predictioncited by 6
- 2024Histopathological Image Classification with Cell Morphology Aware Deep Neural Networkscited by 4
- 2024Large-vocabulary forensic pathological analyses via prototypical cross-modal contrastive learningcited by 2
- 2025IPGPhormer: Interpretable Pathology Graph-Transformer for Survival Analysiscited by 1
- 2025MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classificationcited by 1
- 2025CrossFusion: A Multi-Scale Cross-Attention Convolutional Fusion Model for Cancer Survival Predictioncited by 0
- 2025Fourier Transform Multiple Instance Learning for Whole Slide Image Classificationcited by 0
- 2025Cross-modal ultra-scale learning with tri-modalities of renal biopsy images for glomerular multi-disease auxiliary diagnosiscited by 0
- 2026Enabling Progressive Whole-slide Image Analysis with Multi-scale Pyramidal Networkcited by 0
- 2026Clinical-Injection Transformer with Domain-Adapted MAE for Lupus Nephritis Prognosis Predictioncited by 0
- 2026Clinical-Injection Transformer with Domain-Adapted MAE for Lupus Nephritis Prognosis Prediction4 Mar 2026
- 2026Enabling Progressive Whole-slide Image Analysis with Multi-scale Pyramidal Network2 Feb 2026
- 2025Cross-modal ultra-scale learning with tri-modalities of renal biopsy images for glomerular multi-disease auxiliary diagnosis17 Dec 2025
- 2025Fourier Transform Multiple Instance Learning for Whole Slide Image Classification16 Oct 2025
- 2025MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classification30 Sep 2025
- 2025DPsurv: Dual-Prototype Evidential Fusion for Uncertainty-Aware and Interpretable Whole-Slide Image Survival Prediction28 Sep 2025
- 2025IPGPhormer: Interpretable Pathology Graph-Transformer for Survival Analysis17 Aug 2025
- 2025Self-Supervision Enhances Instance-based Multiple Instance Learning Methods in Digital Pathology: A Benchmark Study2 May 2025
- 2025CrossFusion: A Multi-Scale Cross-Attention Convolutional Fusion Model for Cancer Survival Prediction3 Mar 2025
- 2024Large-vocabulary forensic pathological analyses via prototypical cross-modal contrastive learning20 Jul 2024
- 2024Histopathological Image Classification with Cell Morphology Aware Deep Neural Networks11 Jul 2024