mlsanityData to 14 Oct 2026

Artificial Immunofluorescence in a Flash: Rapid Synthetic Imaging from Brightfield Through Residual Diffusion

arXiv 2407.17882 ↗First posted 25 Jul 2024eess.IVcited by 1

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Immunofluorescent (IF) imaging is crucial for visualizing biomarker expressions, cell morphology and assessing the effects of drug treatments on sub-cellular components. IF imaging needs extra staining process and often requiring cell fixation, therefore it may also introduce artefects and alter endogenouous cell morphology. Some IF stains are expensive or not readily available hence hindering experiments. Recent diffusion models, which synthesise high-fidelity IF images from easy-to-acquire brightfield (BF) images, offer a promising solution but are hindered by training instability and slow inference times due to the noise diffusion process. This paper presents a novel method for the conditional synthesis of IF images directly from BF images along with cell segmentation masks. Our approach employs a Residual Diffusion process that enhances stability and significantly reduces inference time. We performed a critical evaluation against other image-to-image synthesis models, including UNets, GANs, and advanced diffusion models. Our model demonstrates significant improvements in image quality (p<0.05 in MSE, PSNR, and SSIM), inference speed (26 times faster than competing diffusion models), and accurate segmentation results for both nuclei and cell bodies (0.77 and 0.63 mean IOU for nuclei and cell true positives, respectively). This paper is a substantial advancement in the field, providing robust and efficient tools for cell image analysis.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 16 of its 30 references that are in the map. First posted on arXiv 25 Jul 2024.

Builds on

16 of 30 references.

References · 16

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  4. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  5. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  6. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  7. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  8. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
  9. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
  10. 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
  11. 2018Cell Detection with Star-convex Polygonscited by 183
  12. 2022Semantic Image Synthesis via Diffusion Modelscited by 132
4 more
  1. 2024Enhancing Semantic Fidelity in Text-to-Image Synthesis: Attention Regulation in Diffusion Modelscited by 27
  2. 2023On Inference Stability for Diffusion Modelscited by 4
  3. 2020Extracting quantitative biological information from brightfield cell images using deep learningcited by 3
  4. 2023SegmentAnything helps microscopy images based automatic and quantitative organoid detection and analysiscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Can Generative AI Replace Immunofluorescent Staining Processes? A Comparison Study of Synthetically Generated CellPainting Images from Brightfield
  2. 2025Diffusion-Based Synthetic Brightfield Microscopy Images for Enhanced Single Cell Detection
  3. 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology
  4. 2024Cascaded Diffusion Models for 2D and 3D Microscopy Image Synthesis to Enhance Cell Segmentation
  5. 2025Adapting Video Diffusion Models for Time-Lapse Microscopy
  6. 2023Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
  7. 2024Denoising diffusion models for high-resolution microscopy image restoration
  8. 2026Three-Step Conditional Diffusion 3D Reconstruction for Light-Field Microscopy