mlsanityData to 7 Oct 2026

PathLDM: Text conditioned Latent Diffusion Model for Histopathology

arXiv 2309.00748 ↗First posted 1 Sep 2023cs.CV cs.LGcited by 51

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

To achieve high-quality results, diffusion models must be trained on large datasets. This can be notably prohibitive for models in specialized domains, such as computational pathology. Conditioning on labeled data is known to help in data-efficient model training. Therefore, histopathology reports, which are rich in valuable clinical information, are an ideal choice as guidance for a histopathology generative model. In this paper, we introduce PathLDM, the first text-conditioned Latent Diffusion Model tailored for generating high-quality histopathology images. Leveraging the rich contextual information provided by pathology text reports, our approach fuses image and textual data to enhance the generation process. By utilizing GPT's capabilities to distill and summarize complex text reports, we establish an effective conditioning mechanism. Through strategic conditioning and necessary architectural enhancements, we achieved a SoTA FID score of 7.64 for text-to-image generation on the TCGA-BRCA dataset, significantly outperforming the closest text-conditioned competitor with FID 30.1.

Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 32 of its 51 references that are in the map. First posted on arXiv 1 Sep 2023.

Builds on

32 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022Diffusion Probabilistic Models beat GANs on Medical Images14 Dec
  2. 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Images27 Sep

Other references · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  8. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  9. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  10. 2020Denoising Diffusion Implicit Modelscited by 9,655
  11. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  12. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
18 more
  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  8. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  9. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
  10. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
  11. 2018Rotation Equivariant CNNs for Digital Pathologycited by 420
  12. 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
  13. 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 276
  14. 2019Classification Accuracy Score for Conditional Generative Modelscited by 134
  15. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 132
  16. 2023ViT-DAE: Transformer-driven Diffusion Autoencoder for Histopathology Image Analysiscited by 15
  17. 2019Utilizing Automated Breast Cancer Detection to Identify Spatial Distributions of Tumor Infiltrating Lymphocytes in Invasive Breast Cancercited by 12
  18. 2023Conditional Generation from Unconditional Diffusion Models using Denoiser Representationscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 20; 2025: 18; 2026: 11.

51 papers.

Sort:

By area:

  1. 2023Learned representation-guided diffusion models for large-image generationcited by 39
  2. 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transformscited by 25
  3. 2024Adding Conditional Control to Diffusion Models with Reinforcement Learningcited by 16
  4. 2024TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Modelcited by 16
  5. 2024ZoomLDM: Latent Diffusion Model for multi-scale image generationcited by 15
  6. 2025UniMedVL: Unifying Medical Multimodal Understanding and Generation through Observation-Knowledge-Analysiscited by 12
  7. 2025PixCell: A generative foundation model for digital histopathology imagescited by 11
  8. 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Modelscited by 9
  9. 2024A Systematic Review of Generalization Research in Medical Image Classificationcited by 8
  10. 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Modelscited by 8
  11. 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Modelcited by 8
  12. 2024Pixel super-resolved virtual staining of label-free tissue using diffusion modelscited by 8
38 more
  1. 2025GECKO: Gigapixel Vision-Concept Contrastive Pretraining in Histopathologycited by 8
  2. 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditionscited by 8
  3. 2024StainFuser: Controlling Diffusion for Faster Neural Style Transfer in Multi-Gigapixel Histology Imagescited by 6
  4. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicinecited by 5
  5. 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challengescited by 5
  6. 2025Multimodal LLM-Guided Semantic Correction in Text-to-Image Diffusioncited by 5
  7. 2024Histo-Diffusion: A Diffusion Super-Resolution Method for Digital Pathology with Comprehensive Quality Assessmentcited by 4
  8. 2024Gen-SIS: Generative Self-augmentation Improves Self-supervised Learningcited by 4
  9. 2025LesionGen: A Concept-Guided Diffusion Model for Dermatology Image Synthesiscited by 4
  10. 2023Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathologycited by 3
  11. 2025PathSegDiff: Pathology Segmentation using Diffusion model representationscited by 3
  12. 2025Semantic and Visual Crop-Guided Diffusion Models for Heterogeneous Tissue Synthesis in Histopathologycited by 3
  13. 2025Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Controlcited by 3
  14. 2024Boosting Medical Image-based Cancer Detection via Text-guided Supervision from Reportscited by 2
  15. 2024Mask-guided cross-image attention for zero-shot in-silico histopathologic image generation with a diffusion modelcited by 2
  16. 2024Artificial Intelligence for Biomedical Video Generationcited by 2
  17. 2025Prototype-Guided Diffusion for Digital Pathology: Achieving Foundation Model Performance with Minimal Clinical Datacited by 2
  18. 2026SCE-LITE-HQ: Smooth visual counterfactual explanations with generative foundation modelscited by 2
  19. 2024Advancing Histopathology with Deep Learning Under Data Scarcity: A Decade in Reviewcited by 1
  20. 2024Comparative Analysis of Diffusion Generative Models in Computational Pathologycited by 1
  21. 2025Pathology-Aware Adaptive Watermarking for Text-Driven Medical Image Synthesiscited by 1
  22. 2025Computationally Efficient Diffusion Models in Medical Imaging: A Comprehensive Reviewcited by 1
  23. 2025Leveraging Clinical Text and Class Conditioning for 3D Prostate MRI Generationcited by 1
  24. 2025Is Exchangeability better than I.I.D to handle Data Distribution Shifts while Pooling Data for Data-scarce Medical image segmentation?cited by 1
  25. 2026Self-learned representation-guided latent diffusion model for breast cancer classification in deep ultraviolet whole surface imagescited by 1
  26. 2026Tokenizer-Generator Coupling in Medical Image Generationcited by 1
  27. 2024Advancing Histopathology-Based Breast Cancer Diagnosis: Insights into Multi-Modality and Explainabilitycited by 0
  28. 2024Mitigating Downstream Model Risks via Model Provenancecited by 0
  29. 2024Evaluation Metric for Quality Control and Generative Models in Histopathology Imagescited by 0
  30. 2025Prompt Mechanisms in Medical Imaging: A Comprehensive Surveycited by 0
  31. 2025MSDM: Generating Task-Specific Pathology Images with a Multimodal Conditioned Diffusion Model for Cell and Nuclei Segmentationcited by 0
  32. 2026Semi-Supervised Domain Adaptation with Latent Diffusion for Pathology Image Classificationcited by 0
  33. 2026The Latent Color Subspace: Emergent Order in High-Dimensional Chaoscited by 0
  34. 2026Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformerscited by 0
  35. 2026Central-to-Local Adaptive Generative Diffusion Framework for Improving Gene Expression Prediction in Data-Limited Spatial Transcriptomicscited by 0
  36. 2026A Generative Foundation Model for Multimodal Histopathologycited by 0
  37. 2026STREAM: Stochastic Riemannian Flow Matching with Anisotropic Decoder for Digital Histopathology Image Generationcited by 0
  38. 2026What Makes a Good Medical Image Tokenizer? Rethinking Reconstruction and Generation in Medical Image Tokenizationcited by 0

50 most cited of 51 All 51 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Graph Conditioned Diffusion for Controllable Histopathology Image Generation
  2. 2026CytoSyn: a Foundation Diffusion Model for Histopathology -- Tech Report
  3. 2024Style-Extracting Diffusion Models for Semi-Supervised Histopathology Segmentation
  4. 2026Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation
  5. 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology
  6. 2026DiffusionQC: Artifact Detection in Histopathology via Diffusion Model
  7. 2024Dynamic Entity-Masked Graph Diffusion Model for histopathological image Representation Learning
  8. 2026Mitigating Batch Effects in Histopathology via Language-Mediated Robust Embedding Generation