mlsanityData to 7 Oct 2026

Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models

arXiv 2502.09665 ↗First posted 12 Feb 2025cs.CVcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Identifying subtle phenotypic variations in cellular images is critical for advancing biological research and accelerating drug discovery. These variations are often masked by the inherent cellular heterogeneity, making it challenging to distinguish differences between experimental conditions. Recent advancements in deep generative models have demonstrated significant potential for revealing these nuanced phenotypes through image translation, opening new frontiers in cellular and molecular biology as well as the identification of novel biomarkers. Among these generative models, diffusion models stand out for their ability to produce high-quality, realistic images. However, training diffusion models typically requires large datasets and substantial computational resources, both of which can be limited in biological research. In this work, we propose a novel approach that leverages pre-trained latent diffusion models to uncover subtle phenotypic changes. We validate our approach qualitatively and quantitatively on several small datasets of microscopy images. Our findings reveal that our approach enables effective detection of phenotypic variations, capturing both visually apparent and imperceptible differences. Ultimately, our results highlight the promising potential of this approach for phenotype detection, especially in contexts constrained by limited data and computational capacity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 21 of its 37 references that are in the map. First posted on arXiv 12 Feb 2025.

Builds on

21 of 37 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023PhenDiff: Revealing Subtle Phenotypes with Diffusion Models in Real Images13 Dec

Other references · 20

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  8. 2015Variational Inference with Normalizing Flowscited by 2,161
  9. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  10. 2023Extracting Training Data from Diffusion Modelscited by 723
  11. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  12. 2018A Survey on Deep Transfer Learningcited by 417
8 more
  1. 2018MolGAN: An implicit generative model for small molecular graphscited by 392
  2. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  3. 2023Generalization in diffusion models arises from geometry-adaptive harmonic representationscited by 179
  4. 2017Deep Reinforcement Learning for De-Novo Drug Designcited by 161
  5. 2020Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNscited by 103
  6. 2023Strong Baselines for Parameter Efficient Few-Shot Fine-tuningcited by 36
  7. 2021Deep Generative Modeling for Protein Designcited by 17
  8. 2023Unpaired Image-to-Image Translation with Limited Data to Reveal Subtle Phenotypescited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discovery
  2. 2025Adapting Video Diffusion Models for Time-Lapse Microscopy
  3. 2023Denoising Diffusion Probabilistic Models for Generation of Realistic Fully-Annotated Microscopy Image Data Sets
  4. 2025Diffusion-Based Synthetic Brightfield Microscopy Images for Enhanced Single Cell Detection
  5. 2023Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
  6. 2023Diffusion Models in Bioinformatics: A New Wave of Deep Learning Revolution in Action
  7. 2025DiffEx: Explaining a Classifier with Diffusion Models to Identify Microscopic Cellular Variations
  8. 2025Learning Diffusion Models with Flexible Representation Guidance