Segmentation-before-Staining Improves Structural Fidelity in Virtual IHC-to-Multiplex IF Translation
Not on the map. Why?
Abstract (arXiv)
Multiplex immunofluorescence (mIF) enables simultaneous single-cell quantification of multiple biomarkers within intact tissue architecture, yet its high reagent cost, multi-round staining protocols, and need for specialized imaging platforms limit routine clinical adoption. Virtual staining can synthesize mIF channels from widely available brightfield immunohistochemistry (IHC), but current translators optimize pixel-level fidelity without explicitly constraining nuclear morphology. In pathology, this gap is clinically consequential: subtle distortions in nuclei count, shape, or spatial arrangement propagate directly to quantification endpoints such as the Ki67 proliferation index, where errors of a few percent can shift treatment-relevant risk categories. This work introduces a supervision-free, architecture-agnostic conditioning strategy that injects a continuous cell probability map from a pretrained nuclei segmentation foundation model as an explicit input prior, together with a variance-preserving regularization term that matches local intensity statistics to maintain cell-level heterogeneity in synthesized fluorescence channels. The soft prior retains gradient-level boundary information lost by binary thresholding, providing a richer conditioning signal without task-specific tuning. Controlled experiments across Pix2Pix with U-Net and ResNet generators, deterministic regression U-Net, and conditional diffusion on two independent datasets demonstrate consistent improvements in nuclei count fidelity and perceptual quality, as the sole modifications. Code will be made publicly available upon acceptance.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 11 of its 28 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
11 of 28 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,687
- 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
- 2022BCI: Breast Cancer Immunohistochemical Image Generation through Pyramid Pix2pixcited by 61
- 2022Deep Learning-enabled Virtual Histological Staining of Biological Samplescited by 42
- 2022DeepLIIF: An Online Platform for Quantification of Clinical Pathology Slidescited by 9
- 2023An AI-Ready Multiplex Staining Dataset for Reproducible and Accurate Characterization of Tumor Immune Microenvironmentcited by 2
Built on by
Not cited yet.