A Petri Dish for Histopathology Image Analysis
Not on the map. Why?
Abstract (arXiv)
With the rise of deep learning, there has been increased interest in using neural networks for histopathology image analysis, a field that investigates the properties of biopsy or resected specimens traditionally manually examined under a microscope by pathologists. However, challenges such as limited data, costly annotation, and processing high-resolution and variable-size images make it difficult to quickly iterate over model designs. Throughout scientific history, many significant research directions have leveraged small-scale experimental setups as petri dishes to efficiently evaluate exploratory ideas. In this paper, we introduce a minimalist histopathology image analysis dataset (MHIST), an analogous petri dish for histopathology image analysis. MHIST is a binary classification dataset of 3,152 fixed-size images of colorectal polyps, each with a gold-standard label determined by the majority vote of seven board-certified gastrointestinal pathologists and annotator agreement level. MHIST occupies less than 400 MB of disk space, and a ResNet-18 baseline can be trained to convergence on MHIST in just 6 minutes using 3.5 GB of memory on a NVIDIA RTX 3090. As example use cases, we use MHIST to study natural questions such as how dataset size, network depth, transfer learning, and high-disagreement examples affect model performance. By introducing MHIST, we hope to not only help facilitate the work of current histopathology imaging researchers, but also make the field more-accessible to the general community. Our dataset is available at https://bmirds.github.io/MHIST.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). Builds on 20 of its 54 references that are in the map. First posted on arXiv 29 Jan 2021.
Builds on
20 of 54 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2018Do Better ImageNet Models Transfer Better?cited by 560
- 2018Rotation Equivariant CNNs for Digital Pathologycited by 420
- 2019Deep neural network models for computational histopathology: A surveycited by 165
- 2018BACH: Grand Challenge on Breast Cancer Histology Imagescited by 131
- 2019Automated Gleason Grading of Prostate Biopsies using Deep Learningcited by 69
- 2018Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challengecited by 61
- 2019Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networkscited by 43
8 more
- 2019DermGAN: Synthetic Generation of Clinical Skin Images with Pathologycited by 33
- 2020Learn like a Pathologist: Curriculum Learning by Annotator Agreement for Histopathology Image Classificationcited by 29
- 2017Deep-Learning for Classification of Colorectal Polyps on Whole-Slide Imagescited by 26
- 2019Automated detection of celiac disease on duodenal biopsy slides: a deep learning approachcited by 6
- 2019Pathologist-Level Grading of Prostate Biopsies with Artificial Intelligencecited by 4
- 2020Synthetic Petri Dish: A Novel Surrogate Model for Rapid Architecture Searchcited by 3
- 2016Deep Learning Assessment of Tumor Proliferation in Breast Cancer Histological Imagescited by 2
- 2020Difficulty Translation in Histopathology Imagescited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 9; 2023: 6; 2024: 22; 2025: 11; 2026: 14.
63 papers.
Sort:
By area:
- 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
- 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 148
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 144
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
- 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 86
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathologycited by 43
- 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 40
- 2024In-context learning enables multimodal large language models to classify cancer pathology imagescited by 38
- 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2023Estimating Conditional Mutual Information for Dynamic Feature Selectioncited by 20
- 2024Towards Large-Scale Training of Pathology Foundation Modelscited by 19
38 more
- 2025Training state-of-the-art pathology foundation models with orders of magnitude less datacited by 19
- 2023Adapter Learning in Pretrained Feature Extractor for Continual Learning of Diseasescited by 18
- 2024A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyondcited by 16
- 2024FineBio: A Fine-Grained Video Dataset of Biological Experiments with Hierarchical Annotationcited by 11
- 2025PixCell: A generative foundation model for digital histopathology imagescited by 11
- 2025Atlas: A Novel Pathology Foundation Model by Mayo Clinic, Charit'e, and Aignosticscited by 10
- 2022From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathologycited by 9
- 2022Recent Progress in Transformer-based Medical Image Analysiscited by 9
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Modelscited by 9
- 2022Evaluating histopathology transfer learning with ChampKitcited by 7
- 2024EXAONEPath 1.0 Patch-level Foundation Model for Pathologycited by 7
- 2025How Good is my Histopathology Vision-Language Foundation Model? A Holistic Benchmarkcited by 7
- 2024DynaMMo: Dynamic Model Merging for Efficient Class Incremental Learning for Medical Imagescited by 6
- 2025Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representationcited by 6
- 2026Atlas 2 -- Foundation models for clinical deploymentcited by 6
- 2021On the Efficiency of Subclass Knowledge Distillation in Classification Taskscited by 4
- 2023Dynamically Scaled Temperature in Self-Supervised Contrastive Learningcited by 4
- 2023Attention De-sparsification Matters: Inducing Diversity in Digital Pathology Representation Learningcited by 4
- 2025Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddingscited by 4
- 2026Histopath-C: Towards Realistic Domain Shifts for Histopathology Vision-Language Adaptationcited by 4
- 2022Calibrating Histopathology Image Classifiers using Label Smoothingcited by 3
- 2022Subclass Knowledge Distillation with Known Subclass Labelscited by 3
- 2024BioFusionNet: Deep Learning-Based Survival Risk Stratification in ER+ Breast Cancer Through Multifeature and Multimodal Data Fusioncited by 3
- 2024Cardinality Estimation on Hyper-relational Knowledge Graphscited by 3
- 2022HistoKT: Cross Knowledge Transfer in Computational Pathologycited by 2
- 2022Exploiting Explainable Metrics for Augmented SGDcited by 2
- 2024MambaMIC: An Efficient Baseline for Microscopic Image Classification with State Space Modelscited by 2
- 2024Class Incremental Learning with Task-Specific Batch Normalization and Out-of-Distribution Detectioncited by 2
- 2024L-WISE: Boosting Human Visual Category Learning Through Model-Based Image Selection and Enhancementcited by 2
- 2025MedicalNarratives: Connecting Medical Vision and Language with Localized Narrativescited by 2
- 2024Contrastive-Based Deep Embeddings for Label Noise-Resilient Histopathology Image Classificationcited by 1
- 2024Adapting Self-Supervised Learning for Computational Pathologycited by 1
- 2024Pre-training Everywhere: Parameter-Efficient Fine-Tuning for Medical Image Analysis via Target Parameter Pre-trainingcited by 1
- 2024Unlocking adaptive digital pathology through dynamic feature learningcited by 1
- 2025In-Context Learning for Label-Efficient Cancer Image Classification in Oncologycited by 1
- 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Modelscited by 1
- 2024Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Pathology Analysiscited by 0
- 2025Beyond H&E: Unlocking Pathological Insights with Polarization Imagingcited by 0
50 most cited of 63 All 63 (JSON)
- 2026SCALE: Synthetic Calibration via Agreement Labeling in Embedding Space30 Sep 2026
- 2026HERO: Histology Encoder for Robust Representation in Oncology28 Sep 2026
- 2026DistillPath: An Efficient 22M Distilled Pathology Encoder Approaching Large Foundation Model Performance18 Aug 2026
- 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology4 Aug 2026
- 2026STREAM: Stochastic Riemannian Flow Matching with Anisotropic Decoder for Digital Histopathology Image Generation5 Jun 2026
- 2026Geometry-Aware Uncertainty Coresets for Robust Visual In-Context Learning in Histopathology18 May 2026
- 2026Knowledge Poisoning Attacks on Medical Multi-Modal Retrieval-Augmented Generation11 May 2026
- 2026SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification17 Apr 2026
- 2026M-IDoL: Information Decomposition for Modality-Specific and Diverse Representation Learning in Medical Foundation Model10 Apr 2026
- 2026ACE-LoRA: Graph-Attentive Context Enhancement for Parameter-Efficient Adaptation of Medical Vision-Language Models17 Mar 2026
- 2026A Contrastive Pre-trained Foundation Model for Deciphering Imaging Noisomics across Modalities21 Jan 2026
- 2026Histopath-C: Towards Realistic Domain Shifts for Histopathology Vision-Language Adaptation18 Jan 2026
38 more
- 2026An Example for Domain Adaptation Using CycleGAN13 Jan 2026
- 2026Atlas 2 -- Foundation models for clinical deployment8 Jan 2026
- 2025Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddings28 Nov 2025
- 2025Effortless Vision-Language Model Specialization in Histopathology without Annotation11 Aug 2025
- 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Models1 Aug 2025
- 2025PixCell: A generative foundation model for digital histopathology images5 Jun 2025
- 2025In-Context Learning for Label-Efficient Cancer Image Classification in Oncology8 May 2025
- 2025Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representation26 Apr 2025
- 2025Training state-of-the-art pathology foundation models with orders of magnitude less data7 Apr 2025
- 2025How Good is my Histopathology Vision-Language Foundation Model? A Holistic Benchmark17 Mar 2025
- 2025Beyond H&E: Unlocking Pathological Insights with Polarization Imaging5 Mar 2025
- 2025Atlas: A Novel Pathology Foundation Model by Mayo Clinic, Charit'e, and Aignostics9 Jan 2025
- 2025MedicalNarratives: Connecting Medical Vision and Language with Localized Narratives7 Jan 2025
- 2024Unlocking adaptive digital pathology through dynamic feature learning29 Dec 2024
- 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathology16 Dec 2024
- 2024L-WISE: Boosting Human Visual Category Learning Through Model-Based Image Selection and Enhancement12 Dec 2024
- 2024Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Pathology Analysis12 Dec 2024
- 2024Class Incremental Learning with Task-Specific Batch Normalization and Out-of-Distribution Detection1 Nov 2024
- 2024A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyond3 Oct 2024
- 2024MambaMIC: An Efficient Baseline for Microscopic Image Classification with State Space Models12 Sep 2024
- 2024Pre-training Everywhere: Parameter-Efficient Fine-Tuning for Medical Image Analysis via Target Parameter Pre-training27 Aug 2024
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Models23 Aug 2024
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathology1 Aug 2024
- 2024EXAONEPath 1.0 Patch-level Foundation Model for Pathology1 Aug 2024
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysis23 Jun 2024
- 2024Cardinality Estimation on Hyper-relational Knowledge Graphs24 May 2024
- 2024Adapting Self-Supervised Learning for Computational Pathology2 May 2024
- 2024DynaMMo: Dynamic Model Merging for Efficient Class Incremental Learning for Medical Images22 Apr 2024
- 2024Contrastive-Based Deep Embeddings for Label Noise-Resilient Histopathology Image Classification11 Apr 2024
- 2024Towards Large-Scale Training of Pathology Foundation Models24 Mar 2024
- 2024In-context learning enables multimodal large language models to classify cancer pathology images12 Mar 2024
- 2024BioFusionNet: Deep Learning-Based Survival Risk Stratification in ER+ Breast Cancer Through Multifeature and Multimodal Data Fusion16 Feb 2024
- 2024FineBio: A Fine-Grained Video Dataset of Biological Experiments with Hierarchical Annotation1 Feb 2024
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathology29 Jan 2024
- 2024RudolfV: A Foundation Model by Pathologists for Pathologists8 Jan 2024
- 2023Virchow: A Million-Slide Digital Pathology Foundation Model14 Sep 2023
- 2023Attention De-sparsification Matters: Inducing Diversity in Digital Pathology Representation Learning12 Sep 2023
- 2023Dynamically Scaled Temperature in Self-Supervised Contrastive Learning2 Aug 2023
50 newest of 63 All 63 (JSON)
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathologycited by 43
- 2024In-context learning enables multimodal large language models to classify cancer pathology imagescited by 38
- 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Modelscited by 9
- 2025How Good is my Histopathology Vision-Language Foundation Model? A Holistic Benchmarkcited by 7
- 2025Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representationcited by 6
- 2026Histopath-C: Towards Realistic Domain Shifts for Histopathology Vision-Language Adaptationcited by 4
- 2024Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Pathology Analysiscited by 0
- 2025Effortless Vision-Language Model Specialization in Histopathology without Annotationcited by 0
- 2026ACE-LoRA: Graph-Attentive Context Enhancement for Parameter-Efficient Adaptation of Medical Vision-Language Modelscited by 0
- 2026Geometry-Aware Uncertainty Coresets for Robust Visual In-Context Learning in Histopathologycited by 0
- 2026Geometry-Aware Uncertainty Coresets for Robust Visual In-Context Learning in Histopathology18 May 2026
- 2026ACE-LoRA: Graph-Attentive Context Enhancement for Parameter-Efficient Adaptation of Medical Vision-Language Models17 Mar 2026
- 2026Histopath-C: Towards Realistic Domain Shifts for Histopathology Vision-Language Adaptation18 Jan 2026
- 2025Effortless Vision-Language Model Specialization in Histopathology without Annotation11 Aug 2025
- 2025Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representation26 Apr 2025
- 2025How Good is my Histopathology Vision-Language Foundation Model? A Holistic Benchmark17 Mar 2025
- 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathology16 Dec 2024
- 2024Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Pathology Analysis12 Dec 2024
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Models23 Aug 2024
- 2024In-context learning enables multimodal large language models to classify cancer pathology images12 Mar 2024
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathology29 Jan 2024
- 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
- 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 148
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 144
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
- 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 86
- 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 40
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2023Estimating Conditional Mutual Information for Dynamic Feature Selectioncited by 20
- 2024Towards Large-Scale Training of Pathology Foundation Modelscited by 19
- 2025Training state-of-the-art pathology foundation models with orders of magnitude less datacited by 19
- 2023Adapter Learning in Pretrained Feature Extractor for Continual Learning of Diseasescited by 18
- 2024FineBio: A Fine-Grained Video Dataset of Biological Experiments with Hierarchical Annotationcited by 11
12 most cited of 48 All 48 (JSON)
- 2026SCALE: Synthetic Calibration via Agreement Labeling in Embedding Space30 Sep 2026
- 2026HERO: Histology Encoder for Robust Representation in Oncology28 Sep 2026
- 2026DistillPath: An Efficient 22M Distilled Pathology Encoder Approaching Large Foundation Model Performance18 Aug 2026
- 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology4 Aug 2026
- 2026SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification17 Apr 2026
- 2026A Contrastive Pre-trained Foundation Model for Deciphering Imaging Noisomics across Modalities21 Jan 2026
- 2026An Example for Domain Adaptation Using CycleGAN13 Jan 2026
- 2026Atlas 2 -- Foundation models for clinical deployment8 Jan 2026
- 2025Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddings28 Nov 2025
- 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Models1 Aug 2025
- 2025PixCell: A generative foundation model for digital histopathology images5 Jun 2025
- 2025In-Context Learning for Label-Efficient Cancer Image Classification in Oncology8 May 2025
12 newest of 48 All 48 (JSON)