SGPMIL: Sparse Gaussian Process Multiple Instance Learning
Not on the map. Why?
Abstract (arXiv)
Multiple Instance Learning (MIL) offers a natural solution for settings where only coarse, bag-level labels are available, without having access to instance-level annotations. This is usually the case in digital pathology, which consists of gigapixel-sized images. While deterministic attention-based MIL approaches achieve strong bag-level performance, they often overlook the uncertainty inherent in instance relevance. In this paper, we address the lack of uncertainty quantification in instance-level attention scores by introducing SGPMIL, a new probabilistic attention-based MIL framework grounded in Sparse Gaussian Processes (SGP). By learning a posterior distribution over attention scores, SGPMIL enables principled uncertainty estimation, resulting in more reliable and calibrated instance relevance maps. Our approach not only preserves competitive bag-level performance but also significantly improves the quality and interpretability of instance-level predictions under uncertainty. SGPMIL extends prior work by introducing feature scaling in the SGP predictive mean function, leading to faster training, improved efficiency, and enhanced instance-level performance. Extensive experiments on multiple well-established digital pathology datasets highlight the effectiveness of our approach across both bag- and instance-level evaluations. Our code is available at https://github.com/mandlos/SGPMIL.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 33 of its 61 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
33 of 61 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2020Quantifying Attention Flow in Transformerscited by 775
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2017Deep Neural Networks as Gaussian Processescited by 622
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 609
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 555
- 2015Variational Dropout and the Local Reparameterization Trickcited by 490
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
- 2019Measuring Calibration in Deep Learningcited by 446
21 more
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 431
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 388
- 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 371
- 2017Variational Dropout Sparsifies Deep Neural Networkscited by 265
- 2014Scalable Variational Gaussian Process Classificationcited by 228
- 2017Concrete Dropoutcited by 227
- 2020Efficient and Scalable Bayesian Neural Nets with Rank-1 Factorscited by 171
- 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 132
- 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 72
- 2025Accelerating Data Processing and Benchmarking of AI Models for Pathologycited by 65
- 2025Molecular-driven Foundation Model for Oncologic Pathologycited by 55
- 20242DMamba: Efficient State Space Model for Image Representation with Applications on Giga-Pixel Whole Slide Image Classificationcited by 35
- 2024DGR-MIL: Exploring Diverse Global Representation in Multiple Instance Learning for Whole Slide Image Classificationcited by 25
- 2020Explanation and Use of Uncertainty Quantified by Bayesian Neural Network Classifiers for Breast Histopathology Imagescited by 13
- 2021Deep Gaussian Processes: A Surveycited by 13
- 2023Probabilistic Attention based on Gaussian Processes for Deep Multiple Instance Learningcited by 8
- 2025How Effective Can Dropout Be in Multiple Instance Learning ?cited by 7
- 2025Self-Supervision Enhances Instance-based Multiple Instance Learning Methods in Digital Pathology: A Benchmark Studycited by 6
- 2023ProMIL: Probabilistic Multiple Instance Learning for Medical Imagingcited by 3
- 2023Mixed Models with Multiple Instance Learningcited by 2
- 2023Introducing instance label correlation in multiple instance learning. Application to cancer detection on histopathological imagescited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.