Classifying and Segmenting Microscopy Images Using Convolutional Multiple Instance Learning
Not on the map. Why?
Abstract (arXiv)
Convolutional neural networks (CNN) have achieved state of the art performance on both classification and segmentation tasks. Applying CNNs to microscopy images is challenging due to the lack of datasets labeled at the single cell level. We extend the application of CNNs to microscopy image classification and segmentation using multiple instance learning (MIL). We present the adaptive Noisy-AND MIL pooling function, a new MIL operator that is robust to outliers. Combining CNNs with MIL enables training CNNs using full resolution microscopy images with global labels. We base our approach on the similarity between the aggregation function used in MIL and pooling layers used in CNNs. We show that training MIL CNNs end-to-end outperforms several previous methods on both mammalian and yeast microscopy images without requiring any segmentation steps.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 9; 2023: 9; 2024: 3; 2025: 2; 2026: 5.
38 papers.
Sort:
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
- 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methodscited by 46
- 2022Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysiscited by 29
- 2022Inference of captions from histopathological patchescited by 26
- 2023Rethinking Multiple Instance Learning for Whole Slide Image Classification: A Good Instance Classifier is All You Needcited by 22
- 2022An Aggregation of Aggregation Methods in Computational Pathologycited by 20
- 2022Hierarchical classification at multiple operating pointscited by 14
- 2021Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentationcited by 12
- 2021Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classificationcited by 12
- 2022Learning image representations for anomaly detection: application to discovery of histological alterations in drug developmentcited by 11
- 2023Masked Autoencoders are Scalable Learners of Cellular Morphologycited by 9
- 2022Using Multiple Instance Learning to Build Multimodal Representationscited by 7
26 more
- 2021Multi-Attention Multiple Instance Learningcited by 6
- 2023Data efficient deep learning for medical image analysis: A surveycited by 6
- 2026ASMIL: Attention-Stabilized Multiple Instance Learning for Whole Slide Imagingcited by 6
- 2025Fast and Accurate Gigapixel Pathological Image Classification with Hierarchical Distillation Multi-Instance Learningcited by 5
- 2021DEEMD: Drug Efficacy Estimation against SARS-CoV-2 based on cell Morphology with Deep multiple instance learningcited by 4
- 2021HAMIL: Hierarchical Aggregation-Based Multi-Instance Learning for Microscopy Image Classificationcited by 3
- 2023Provable Multi-instance Deep AUC Maximization with Stochastic Poolingcited by 3
- 2023ProMIL: Probabilistic Multiple Instance Learning for Medical Imagingcited by 3
- 2023Morphological Profiling for Drug Discovery in the Era of Deep Learningcited by 3
- 2021COVID-view: Diagnosis of COVID-19 using Chest CTcited by 2
- 2025Integrating chemical structures as treatments improves representations of microscopy images for morphological profilingcited by 2
- 2021mil-benchmarks: Standardized Evaluation of Deep Multiple-Instance Learning Techniquescited by 1
- 2022Deep Learning-Based Sparse Whole-Slide Image Analysis for the Diagnosis of Gastric Intestinal Metaplasiacited by 1
- 2022Automated Detection of Acute Promyelocytic Leukemia in Blood Films and Bone Marrow Aspirates with Annotation-free Deep Learningcited by 1
- 2022Go Beyond Multiple Instance Neural Networks: Deep-learning Models based on Local Pattern Aggregationcited by 1
- 2024mTREE: Multi-Level Text-Guided Representation End-to-End Learning for Whole Slide Image Analysiscited by 1
- 2021Malignancy Prediction and Lesion Identification from Clinical Dermatological Imagescited by 0
- 2021A deep learning model for gastric diffuse-type adenocarcinoma classification in whole slide imagescited by 0
- 2021Interpretable and Interactive Deep Multiple Instance Learning for Dental Caries Classification in Bitewing X-rayscited by 0
- 2023From slides (through tiles) to pixels: an explainability framework for weakly supervised models in pre-clinical pathologycited by 0
- 2023Multiple Instance Learning with Trainable Decision Tree Ensemblescited by 0
- 2024Bi-capacity Choquet Integral for Sensor Fusion with Label Uncertaintycited by 0
- 2026Spatial Blindness in Whole-Slide Multiple Instance Learningcited by 0
- 2026GCE-MIL: Faithful and Recoverable Evidence for Multiple Instance Learning in Whole-Slide Imagingcited by 0
- 2026Rethinking Global Average Pooling: Your Classifier Is Secretly a Multi-Instance Learnercited by 0
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathologycited by 0
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathology21 Sep 2026
- 2026Rethinking Global Average Pooling: Your Classifier Is Secretly a Multi-Instance Learner12 Jun 2026
- 2026GCE-MIL: Faithful and Recoverable Evidence for Multiple Instance Learning in Whole-Slide Imaging17 May 2026
- 2026Spatial Blindness in Whole-Slide Multiple Instance Learning17 May 2026
- 2026ASMIL: Attention-Stabilized Multiple Instance Learning for Whole Slide Imaging1 Mar 2026
- 2025Integrating chemical structures as treatments improves representations of microscopy images for morphological profiling13 Apr 2025
- 2025Fast and Accurate Gigapixel Pathological Image Classification with Hierarchical Distillation Multi-Instance Learning28 Feb 2025
- 2024Bi-capacity Choquet Integral for Sensor Fusion with Label Uncertainty5 Sep 2024
- 2024mTREE: Multi-Level Text-Guided Representation End-to-End Learning for Whole Slide Image Analysis28 May 2024
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology16 Apr 2024
- 2023Morphological Profiling for Drug Discovery in the Era of Deep Learning13 Dec 2023
- 2023Data efficient deep learning for medical image analysis: A survey10 Oct 2023
26 more
- 2023Masked Autoencoders are Scalable Learners of Cellular Morphology27 Sep 2023
- 2023Rethinking Multiple Instance Learning for Whole Slide Image Classification: A Good Instance Classifier is All You Need5 Jul 2023
- 2023ProMIL: Probabilistic Multiple Instance Learning for Medical Imaging18 Jun 2023
- 2023Provable Multi-instance Deep AUC Maximization with Stochastic Pooling14 May 2023
- 2023Multiple Instance Learning with Trainable Decision Tree Ensembles13 Feb 2023
- 2023From slides (through tiles) to pixels: an explainability framework for weakly supervised models in pre-clinical pathology3 Feb 2023
- 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methods13 Jan 2023
- 2022Using Multiple Instance Learning to Build Multimodal Representations11 Dec 2022
- 2022An Aggregation of Aggregation Methods in Computational Pathology2 Nov 2022
- 2022Hierarchical classification at multiple operating points19 Oct 2022
- 2022Learning image representations for anomaly detection: application to discovery of histological alterations in drug development14 Oct 2022
- 2022Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis18 Aug 2022
- 2022Go Beyond Multiple Instance Neural Networks: Deep-learning Models based on Local Pattern Aggregation28 May 2022
- 2022Automated Detection of Acute Promyelocytic Leukemia in Blood Films and Bone Marrow Aspirates with Annotation-free Deep Learning20 Mar 2022
- 2022Inference of captions from histopathological patches7 Feb 2022
- 2022Deep Learning-Based Sparse Whole-Slide Image Analysis for the Diagnosis of Gastric Intestinal Metaplasia5 Jan 2022
- 2021Interpretable and Interactive Deep Multiple Instance Learning for Dental Caries Classification in Bitewing X-rays17 Dec 2021
- 2021Multi-Attention Multiple Instance Learning11 Dec 2021
- 2021COVID-view: Diagnosis of COVID-19 using Chest CT9 Aug 2021
- 2021DEEMD: Drug Efficacy Estimation against SARS-CoV-2 based on cell Morphology with Deep multiple instance learning10 May 2021
- 2021mil-benchmarks: Standardized Evaluation of Deep Multiple-Instance Learning Techniques4 May 2021
- 2021A deep learning model for gastric diffuse-type adenocarcinoma classification in whole slide images26 Apr 2021
- 2021Malignancy Prediction and Lesion Identification from Clinical Dermatological Images2 Apr 2021
- 2021Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classification30 Mar 2021
- 2021HAMIL: Hierarchical Aggregation-Based Multi-Instance Learning for Microscopy Image Classification17 Mar 2021
- 2021Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentation22 Jan 2021
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
- 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methodscited by 46
- 2022Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysiscited by 29
- 2022Inference of captions from histopathological patchescited by 26
- 2023Rethinking Multiple Instance Learning for Whole Slide Image Classification: A Good Instance Classifier is All You Needcited by 22
- 2022An Aggregation of Aggregation Methods in Computational Pathologycited by 20
- 2022Hierarchical classification at multiple operating pointscited by 14
- 2021Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentationcited by 12
- 2021Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classificationcited by 12
- 2022Learning image representations for anomaly detection: application to discovery of histological alterations in drug developmentcited by 11
- 2023Masked Autoencoders are Scalable Learners of Cellular Morphologycited by 9
- 2022Using Multiple Instance Learning to Build Multimodal Representationscited by 7
12 most cited of 38 All 38 (JSON)
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathology21 Sep 2026
- 2026Rethinking Global Average Pooling: Your Classifier Is Secretly a Multi-Instance Learner12 Jun 2026
- 2026GCE-MIL: Faithful and Recoverable Evidence for Multiple Instance Learning in Whole-Slide Imaging17 May 2026
- 2026Spatial Blindness in Whole-Slide Multiple Instance Learning17 May 2026
- 2026ASMIL: Attention-Stabilized Multiple Instance Learning for Whole Slide Imaging1 Mar 2026
- 2025Integrating chemical structures as treatments improves representations of microscopy images for morphological profiling13 Apr 2025
- 2025Fast and Accurate Gigapixel Pathological Image Classification with Hierarchical Distillation Multi-Instance Learning28 Feb 2025
- 2024Bi-capacity Choquet Integral for Sensor Fusion with Label Uncertainty5 Sep 2024
- 2024mTREE: Multi-Level Text-Guided Representation End-to-End Learning for Whole Slide Image Analysis28 May 2024
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology16 Apr 2024
- 2023Morphological Profiling for Drug Discovery in the Era of Deep Learning13 Dec 2023
- 2023Data efficient deep learning for medical image analysis: A survey10 Oct 2023
12 newest of 38 All 38 (JSON)