mlsanityData to 14 Oct 2026

Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels

arXiv 2303.08863 ↗First posted 15 Mar 2023cs.CV cs.LG q-bio.QMcited by 6

Not on the map. Why?

Abstract (arXiv)

Image-to-image reconstruction problems with free or inexpensive metadata in the form of class labels appear often in biological and medical image domains. Existing text-guided or style-transfer image-to-image approaches do not translate to datasets where additional information is provided as discrete classes. We introduce and implement a model which combines image-to-image and class-guided denoising diffusion probabilistic models. We train our model on a real-world dataset of microscopy images used for drug discovery, with and without incorporating metadata labels. By exploring the properties of image-to-image diffusion with relevant labels, we show that class-guided image-to-image diffusion can improve the meaningful content of the reconstructed images and outperform the unguided model in useful downstream tasks.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 55 references that are in the map. First posted on arXiv 15 Mar 2023.

Builds on

30 of 55 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  12. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
18 more
  1. 2018Group Normalizationcited by 1,524
  2. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  3. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  4. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  5. 2017Generative Adversarial Networks: An Overviewcited by 590
  6. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  7. 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
  8. 2022Diffusion Models for Medical Anomaly Detectioncited by 232
  9. 2018Multimodal Generative Models for Scalable Weakly-Supervised Learningcited by 200
  10. 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 178
  11. 2018MedGAN: Medical Image Translation using GANscited by 152
  12. 2018Distribution Matching Losses Can Hallucinate Features in Medical Image Translationcited by 99
  13. 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
  14. 2022What is Healthy? Generative Counterfactual Diffusion for Lesion Localizationcited by 52
  15. 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methodscited by 46
  16. 2019DUAL-GLOW: Conditional Flow-Based Generative Model for Modality Transfercited by 19
  17. 2022Self-Supervised Learning of Phenotypic Representations from Cell Images with Weak Labelscited by 9
  18. 2021Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddingscited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2; 2025: 3.

6 papers.

  1. 2024Can virtual staining for high-throughput screening generalize?cited by 2
  2. 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discoverycited by 1
  3. 2023Multiple Noises in Diffusion Model for Semi-Supervised Multi-Domain Translationcited by 0
  4. 2024Diffusion Models to Enhance the Resolution of Microscopy Images: A Tutorialcited by 0
  5. 2025Diffusion-Based Synthetic Brightfield Microscopy Images for Enhanced Single Cell Detectioncited by 0
  6. 2025MONET -- Virtual Cell Painting of Brightfield Images and Time Lapses Using Reference Consistent Diffusioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2022On Distillation of Guided Diffusion Models
  2. 2025Learning Diffusion Models with Flexible Representation Guidance
  3. 2024Diffusion Models Need Visual Priors for Image Generation
  4. 2023Discriminative Class Tokens for Text-to-Image Diffusion Models
  5. 2024Plug-and-Play Diffusion Distillation
  6. 2023Elucidating The Design Space of Classifier-Guided Diffusion Generation
  7. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidance
  8. 2023Denoising Diffusion Probabilistic Models for Generation of Realistic Fully-Annotated Microscopy Image Data Sets