Differentiable Zooming for Multiple Instance Learning on Whole-Slide Images
Not on the map. Why?
Abstract (arXiv)
Multiple Instance Learning (MIL) methods have become increasingly popular for classifying giga-pixel sized Whole-Slide Images (WSIs) in digital pathology. Most MIL methods operate at a single WSI magnification, by processing all the tissue patches. Such a formulation induces high computational requirements, and constrains the contextualization of the WSI-level representation to a single scale. A few MIL methods extend to multiple scales, but are computationally more demanding. In this paper, inspired by the pathological diagnostic process, we propose ZoomMIL, a method that learns to perform multi-level zooming in an end-to-end manner. ZoomMIL builds WSI representations by aggregating tissue-context information from multiple magnifications. The proposed method outperforms the state-of-the-art MIL methods in WSI classification on two large datasets, while significantly reducing the computational demands with regard to Floating-Point Operations (FLOPs) and processing time by up to 40x.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Builds on 31 of its 46 references that are in the map. First posted on arXiv 26 Apr 2022.
Builds on
31 of 46 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 555
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
- 2019Lookahead Optimizer: k steps forward, 1 step backcited by 336
- 2020Whole Slide Images based Cancer Survival Prediction using Attention Guided Deep Multiple Instance Learning Networkscited by 178
- 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 132
- 2020Deep Learning-based Computational Pathology Predicts Origins for Cancers of Unknown Primarycited by 89
- 2020Multi-scale Domain-adversarial Multiple-instance CNN for Cancer Subtype Classification with Unannotated Histopathological Imagescited by 81
19 more
- 2021Differentiable Patch Selection for Image Recognitioncited by 68
- 2018Neural Image Compression for Gigapixel Histopathology Image Analysiscited by 65
- 2021Hierarchical Graph Representations in Digital Pathologycited by 59
- 2017Constrained Deep Weak Supervision for Histopathology Image Segmentationcited by 51
- 2020Representation Learning of Histopathology Images using Graph Neural Networkscited by 40
- 2019Context-Aware Convolutional Neural Network for Grading of Colorectal Cancer Histology Imagescited by 39
- 2019Adaptive Weighting Multi-Field-of-View CNN for Semantic Segmentation in Pathologycited by 36
- 2020A Multi-resolution Model for Histopathology Image Classification and Localization with Multiple Instance Learningcited by 35
- 2021Accounting for Dependencies in Deep Learning Based Multiple Instance Learning for Whole Slide Imagingcited by 31
- 2019Processing Megapixel Images with Deep Attention-Sampling Modelscited by 29
- 2019Deep Multi-Magnification Networks for Multi-Class Breast Cancer Image Segmentationcited by 22
- 2021Learning Whole-Slide Segmentation from Inexact and Incomplete Labels using Tissue Graphscited by 22
- 2021HistoCartography: A Toolkit for Graph Analytics in Digital Pathologycited by 20
- 2021Efficient Classification of Very Large Images with Tiny Objectscited by 17
- 2019Learning Where to See: A Novel Attention Model for Automated Immunohistochemical Scoringcited by 14
- 2018Reinforced Auto-Zoom Net: Towards Accurate and Fast Breast Cancer Segmentation in Whole-slide Imagescited by 11
- 2021SparseConvMIL: Sparse Convolutional Context-Aware Multiple Instance Learning for Whole Slide Image Classificationcited by 10
- 2018Improving Whole Slide Segmentation Through Visual Context - A Systematic Studycited by 9
- 2017Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology imagescited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 13; 2024: 10; 2025: 10; 2026: 8.
43 papers.
Sort:
By area:
- 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 134
- 2023Artificial Intelligence for Digital and Computational Pathologycited by 108
- 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 72
- 2022Multiple Instance Learning for Digital Pathology: A Review on the State-of-the-Art, Limitations & Future Potentialcited by 54
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 27
- 2023SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathologycited by 25
- 2023Reproducibility in Multiple Instance Learning: A Case For Algorithmic Unit Testscited by 11
- 2023Weakly Supervised Joint Whole-Slide Segmentation and Classification in Prostate Cancercited by 10
- 2023MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Featurescited by 8
- 2025Label-free Concept Based Multiple Instance Learning for Gigapixel Histopathologycited by 8
- 2025GECKO: Gigapixel Vision-Concept Contrastive Pretraining in Histopathologycited by 8
- 2024PATHS: A Hierarchical Transformer for Efficient Whole Slide Image Analysiscited by 7
31 more
- 2022Multi-Scale Relational Graph Convolutional Network for Multiple Instance Learning in Histopathology Imagescited by 6
- 2023Multi-scale Feature Alignment for Continual Learning of Unlabeled Domainscited by 6
- 2024Clinical-grade Multi-Organ Pathology Report Generation for Multi-scale Whole Slide Images via a Semantically Guided Medical Text Foundation Modelcited by 6
- 2023Dual Attention Model with Reinforcement Learning for Classification of Histology Whole-Slide Imagescited by 5
- 2024GRASP: GRAph-Structured Pyramidal Whole Slide Image Representationcited by 5
- 2024Gen-SIS: Generative Self-augmentation Improves Self-supervised Learningcited by 5
- 2023Towards Hierarchical Regional Transformer-based Multiple Instance Learningcited by 4
- 2023BROW: Better featuRes fOr Whole slide image based on self-distillationcited by 4
- 2023Unsupervised Mutual Transformer Learning for Multi-Gigapixel Whole Slide Image Classificationcited by 3
- 2025ModalTune: Fine-Tuning Slide-Level Foundation Models with Multi-Modal Information for Multi-task Learning in Digital Pathologycited by 2
- 2025Sequential Attention-based Sampling for Histopathological Analysiscited by 2
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysiscited by 2
- 2026Thinking in Scales: Accelerating Gigapixel Pathology Image Analysis via Adaptive Continuous Reasoningcited by 2
- 2024Learning Spatial-Preserving Hierarchical Representations for Digital Pathologycited by 1
- 2025MExD: An Expert-Infused Diffusion Model for Whole-Slide Image Classificationcited by 1
- 2025One-Shot Neural Architecture Search with Network Similarity Directed Initialization for Pathological Image Classificationcited by 1
- 2023The Whole Pathological Slide Classification via Weakly Supervised Learningcited by 0
- 2023On the detection of Out-Of-Distribution samples in Multiple Instance Learningcited by 0
- 2024Towards Efficient Information Fusion: Concentric Dual Fusion Attention Based Multiple Instance Learning for Whole Slide Imagescited by 0
- 2024Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Pathology Analysiscited by 0
- 2024SEW: Self-calibration Enhanced Whole Slide Pathology Image Analysiscited by 0
- 2024On the Generalizability of Iterative Patch Selection for Memory-Efficient High-Resolution Image Classificationcited by 0
- 2025CrossFusion: A Multi-Scale Cross-Attention Convolutional Fusion Model for Cancer Survival Predictioncited by 0
- 2025Histomorphology-Guided Prototypical Multi-Instance Learning for Breast Cancer WSI Classificationcited by 0
- 2025Fourier Transform Multiple Instance Learning for Whole Slide Image Classificationcited by 0
- 2026PAIR-Former: Budgeted Relational Multi-Instance Learning for Functional miRNA Target Predictioncited by 0
- 2026Enabling Progressive Whole-slide Image Analysis with Multi-scale Pyramidal Networkcited by 0
- 2026Domain Adaptation Without the Compute Burden for Efficient Whole Slide Image Analysiscited by 0
- 2026LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classificationcited by 0
- 2026Learning Where to Focus: Self-Supervised Multi-Scale ViTs for Histopathologycited by 0
- 2026Nonparametric Distribution Matching for Self-Supervised Whole-Slide Image Condensationcited by 0
- 2026Nonparametric Distribution Matching for Self-Supervised Whole-Slide Image Condensation30 Sep 2026
- 2026Learning Where to Focus: Self-Supervised Multi-Scale ViTs for Histopathology16 Sep 2026
- 2026LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classification5 Jun 2026
- 2026Thinking in Scales: Accelerating Gigapixel Pathology Image Analysis via Adaptive Continuous Reasoning19 May 2026
- 2026Domain Adaptation Without the Compute Burden for Efficient Whole Slide Image Analysis16 Mar 2026
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysis2 Mar 2026
- 2026Enabling Progressive Whole-slide Image Analysis with Multi-scale Pyramidal Network2 Feb 2026
- 2026PAIR-Former: Budgeted Relational Multi-Instance Learning for Functional miRNA Target Prediction31 Jan 2026
- 2025Fourier Transform Multiple Instance Learning for Whole Slide Image Classification16 Oct 2025
- 2025Sequential Attention-based Sampling for Histopathological Analysis7 Jul 2025
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathology26 Jun 2025
- 2025One-Shot Neural Architecture Search with Network Similarity Directed Initialization for Pathological Image Classification17 Jun 2025
31 more
- 2025GECKO: Gigapixel Vision-Concept Contrastive Pretraining in Histopathology1 Apr 2025
- 2025Histomorphology-Guided Prototypical Multi-Instance Learning for Breast Cancer WSI Classification23 Mar 2025
- 2025ModalTune: Fine-Tuning Slide-Level Foundation Models with Multi-Modal Information for Multi-task Learning in Digital Pathology21 Mar 2025
- 2025MExD: An Expert-Infused Diffusion Model for Whole-Slide Image Classification16 Mar 2025
- 2025CrossFusion: A Multi-Scale Cross-Attention Convolutional Fusion Model for Cancer Survival Prediction3 Mar 2025
- 2025Label-free Concept Based Multiple Instance Learning for Gigapixel Histopathology6 Jan 2025
- 2024On the Generalizability of Iterative Patch Selection for Memory-Efficient High-Resolution Image Classification15 Dec 2024
- 2024SEW: Self-calibration Enhanced Whole Slide Pathology Image Analysis14 Dec 2024
- 2024Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Pathology Analysis12 Dec 2024
- 2024Gen-SIS: Generative Self-augmentation Improves Self-supervised Learning2 Dec 2024
- 2024PATHS: A Hierarchical Transformer for Efficient Whole Slide Image Analysis27 Nov 2024
- 2024Clinical-grade Multi-Organ Pathology Report Generation for Multi-scale Whole Slide Images via a Semantically Guided Medical Text Foundation Model23 Sep 2024
- 2024Learning Spatial-Preserving Hierarchical Representations for Digital Pathology13 Jun 2024
- 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathology19 May 2024
- 2024Towards Efficient Information Fusion: Concentric Dual Fusion Attention Based Multiple Instance Learning for Whole Slide Images21 Mar 2024
- 2024GRASP: GRAph-Structured Pyramidal Whole Slide Image Representation6 Feb 2024
- 2023SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathology22 Dec 2023
- 2023Artificial Intelligence for Digital and Computational Pathology13 Dec 2023
- 2023MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Features20 Nov 2023
- 2023Reproducibility in Multiple Instance Learning: A Case For Algorithmic Unit Tests27 Oct 2023
- 2023BROW: Better featuRes fOr Whole slide image based on self-distillation15 Sep 2023
- 2023On the detection of Out-Of-Distribution samples in Multiple Instance Learning11 Sep 2023
- 2023Towards Hierarchical Regional Transformer-based Multiple Instance Learning24 Aug 2023
- 2023The Whole Pathological Slide Classification via Weakly Supervised Learning12 Jul 2023
- 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Images13 Jun 2023
- 2023Unsupervised Mutual Transformer Learning for Multi-Gigapixel Whole Slide Image Classification3 May 2023
- 2023Dual Attention Model with Reinforcement Learning for Classification of Histology Whole-Slide Images19 Feb 2023
- 2023Multi-scale Feature Alignment for Continual Learning of Unlabeled Domains2 Feb 2023
- 2023Weakly Supervised Joint Whole-Slide Segmentation and Classification in Prostate Cancer7 Jan 2023
- 2022Multi-Scale Relational Graph Convolutional Network for Multiple Instance Learning in Histopathology Images17 Dec 2022
- 2022Multiple Instance Learning for Digital Pathology: A Review on the State-of-the-Art, Limitations & Future Potential9 Jun 2022
- 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 134
- 2023Artificial Intelligence for Digital and Computational Pathologycited by 108
- 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 72
- 2022Multiple Instance Learning for Digital Pathology: A Review on the State-of-the-Art, Limitations & Future Potentialcited by 54
- 2023SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathologycited by 25
- 2023Reproducibility in Multiple Instance Learning: A Case For Algorithmic Unit Testscited by 11
- 2023Weakly Supervised Joint Whole-Slide Segmentation and Classification in Prostate Cancercited by 10
- 2023MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Featurescited by 8
- 2025Label-free Concept Based Multiple Instance Learning for Gigapixel Histopathologycited by 8
- 2025GECKO: Gigapixel Vision-Concept Contrastive Pretraining in Histopathologycited by 8
- 2024PATHS: A Hierarchical Transformer for Efficient Whole Slide Image Analysiscited by 7
- 2022Multi-Scale Relational Graph Convolutional Network for Multiple Instance Learning in Histopathology Imagescited by 6
12 most cited of 37 All 37 (JSON)
- 2026Nonparametric Distribution Matching for Self-Supervised Whole-Slide Image Condensation30 Sep 2026
- 2026Learning Where to Focus: Self-Supervised Multi-Scale ViTs for Histopathology16 Sep 2026
- 2026Thinking in Scales: Accelerating Gigapixel Pathology Image Analysis via Adaptive Continuous Reasoning19 May 2026
- 2026Domain Adaptation Without the Compute Burden for Efficient Whole Slide Image Analysis16 Mar 2026
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysis2 Mar 2026
- 2026Enabling Progressive Whole-slide Image Analysis with Multi-scale Pyramidal Network2 Feb 2026
- 2026PAIR-Former: Budgeted Relational Multi-Instance Learning for Functional miRNA Target Prediction31 Jan 2026
- 2025Fourier Transform Multiple Instance Learning for Whole Slide Image Classification16 Oct 2025
- 2025Sequential Attention-based Sampling for Histopathological Analysis7 Jul 2025
- 2025One-Shot Neural Architecture Search with Network Similarity Directed Initialization for Pathological Image Classification17 Jun 2025
- 2025GECKO: Gigapixel Vision-Concept Contrastive Pretraining in Histopathology1 Apr 2025
- 2025Histomorphology-Guided Prototypical Multi-Instance Learning for Breast Cancer WSI Classification23 Mar 2025
12 newest of 37 All 37 (JSON)