Prototype-Guided Diffusion for Digital Pathology: Achieving Foundation Model Performance with Minimal Clinical Data
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Foundation models in digital pathology use massive datasets to learn useful compact feature representations of complex histology images. However, there is limited transparency into what drives the correlation between dataset size and performance, raising the question of whether simply adding more data to increase performance is always necessary. In this study, we propose a prototype-guided diffusion model to generate high-fidelity synthetic pathology data at scale, enabling large-scale self-supervised learning and reducing reliance on real patient samples while preserving downstream performance. Using guidance from histological prototypes during sampling, our approach ensures biologically and diagnostically meaningful variations in the generated data. We demonstrate that self-supervised features trained on our synthetic dataset achieve competitive performance despite using ~60x-760x less data than models trained on large real-world datasets. Notably, models trained using our synthetic data showed statistically comparable or better performance across multiple evaluation metrics and tasks, even when compared to models trained on orders of magnitude larger datasets. Our hybrid approach, combining synthetic and real data, further enhanced performance, achieving top results in several evaluations. These findings underscore the potential of generative AI to create compelling training data for digital pathology, significantly reducing the reliance on extensive clinical datasets and highlighting the efficiency of our approach.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 18 of its 40 references that are in the map. First posted on arXiv 15 Apr 2025.
Builds on
18 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 17
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2020Whole Slide Images based Cancer Survival Prediction using Attention Guided Deep Multiple Instance Learning Networkscited by 178
- 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 72
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 50
- 2020A Multi-resolution Model for Histopathology Image Classification and Localization with Multiple Instance Learningcited by 35
- 2021Selective Synthetic Augmentation with HistoGAN for Improved Histopathology Image Classificationcited by 35
- 2024Conditional Image Synthesis with Diffusion Models: A Surveycited by 29
- 2025Foundation Models in Computational Pathology: A Review of Challenges, Opportunities, and Impactcited by 22
5 more
- 2023Synthetic Augmentation with Large-scale Unconditional Pre-trainingcited by 18
- 2019Synthetic Augmentation and Feature-based Filtering for Improved Cervical Histopathology Image Classificationcited by 17
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Datacited by 15
- 2020Synthetic Sample Selection via Reinforcement Learningcited by 13
- 2023CPIA Dataset: A Comprehensive Pathological Image Analysis Dataset for Self-supervised Learning Pre-trainingcited by 2
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathology
- 2026Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation
- 2024Unleashing the Potential of Synthetic Images: A Study on Histopathology Image Classification
- 2024Comparative Analysis of Diffusion Generative Models in Computational Pathology
- 2025PixCell: A generative foundation model for digital histopathology images
- 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Images
- 2026A Generative Foundation Model for Multimodal Histopathology
- 2026Controllable Diffusion-Based Lesion Inpainting for Scalable Histopathology Data Augmentation