PhenDiff: Revealing Subtle Phenotypes with Diffusion Models in Real Images
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
For the past few years, deep generative models have increasingly been used in biological research for a variety of tasks. Recently, they have proven to be valuable for uncovering subtle cell phenotypic differences that are not directly discernible to the human eye. However, current methods employed to achieve this goal mainly rely on Generative Adversarial Networks (GANs). While effective, GANs encompass issues such as training instability and mode collapse, and they do not accurately map images back to the model's latent space, which is necessary to synthesize, manipulate, and thus interpret outputs based on real images. In this work, we introduce PhenDiff: a multi-class conditional method leveraging Diffusion Models (DMs) designed to identify shifts in cellular phenotypes by translating a real image from one condition to another. We qualitatively and quantitatively validate this method on cases where the phenotypic changes are visible or invisible, such as in low concentrations of drug treatments. Overall, PhenDiff represents a valuable tool for identifying cellular variations in real microscopy images. We anticipate that it could facilitate the understanding of diseases and advance drug discovery through the identification of novel biomarkers.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 10 of its 20 references that are in the map. First posted on arXiv 13 Dec 2023.
Builds on
10 of 20 references.
References · 10
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 212
- 2022Predicting Cellular Responses to Novel Drug Perturbations at a Single-Cell Resolutioncited by 42
- 2020Improving Inversion and Generation Diversity in StyleGAN using a Gaussianized Latent Spacecited by 34
- 2023Unpaired Image-to-Image Translation with Limited Data to Reveal Subtle Phenotypescited by 7
Built on by
Citing papers per year: 2025: 5; 2026: 5.
10 papers.
- 2025CellFlux: Simulating Cellular Morphology Changes via Flow Matchingcited by 19
- 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discoverycited by 1
- 2026CellFluxRL: Biologically-Constrained Virtual Cell Modeling via Reinforcement Learningcited by 1
- 2026Elucidating the Design Space of Flow Matching for Cellular Microscopycited by 1
- 2025DiffEx: Explaining a Classifier with Diffusion Models to Identify Microscopic Cellular Variationscited by 0
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Modelscited by 0
- 2025Morphologically Intelligent Perturbation Prediction with FORMcited by 0
- 2026FreeBridge: Variational Schr"odinger Bridges for Cellular Transition Dynamicscited by 0
- 2026Conditional Neural Optimal Transport for Predicting Cellular Phenotypes from Molecular Structurecited by 0
- 2026Joint Flow Matching Enables Continuous Dose-Conditioned Cell Morphingcited by 0
- 2026Joint Flow Matching Enables Continuous Dose-Conditioned Cell Morphing17 Aug 2026
- 2026Conditional Neural Optimal Transport for Predicting Cellular Phenotypes from Molecular Structure14 Aug 2026
- 2026FreeBridge: Variational Schr"odinger Bridges for Cellular Transition Dynamics9 Jun 2026
- 2026Elucidating the Design Space of Flow Matching for Cellular Microscopy25 Mar 2026
- 2026CellFluxRL: Biologically-Constrained Virtual Cell Modeling via Reinforcement Learning23 Mar 2026
- 2025Morphologically Intelligent Perturbation Prediction with FORM24 Oct 2025
- 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discovery22 Oct 2025
- 2025CellFlux: Simulating Cellular Morphology Changes via Flow Matching13 Feb 2025
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models12 Feb 2025
- 2025DiffEx: Explaining a Classifier with Diffusion Models to Identify Microscopic Cellular Variations12 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2025Diffusion-Based Synthetic Brightfield Microscopy Images for Enhanced Single Cell Detection
- 2023Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
- 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Models
- 2024Comparative Analysis of Diffusion Generative Models in Computational Pathology
- 2024Spatial Diffusion for Cell Layout Generation
- 2023Conditional Image Generation with Pretrained Generative Model
- 2025GANs vs. Diffusion Models for virtual staining with the HER2match dataset
- 2024Can Generative AI Replace Immunofluorescent Staining Processes? A Comparison Study of Synthetically Generated CellPainting Images from Brightfield