Generative AI for Misalignment-Resistant Virtual Staining to Accelerate Histopathology Workflows
Not on the map. Why?
Abstract (arXiv)
Accurate histopathological diagnosis often requires multiple differently stained tissue sections, a process that is time-consuming, labor-intensive, and environmentally taxing due to the use of multiple chemical stains. Recently, virtual staining has emerged as a promising alternative that is faster, tissue-conserving, and environmentally friendly. However, existing virtual staining methods face significant challenges in clinical applications, primarily due to their reliance on well-aligned paired data. Obtaining such data is inherently difficult because chemical staining processes can distort tissue structures, and a single tissue section cannot undergo multiple staining procedures without damage or loss of information. As a result, most available virtual staining datasets are either unpaired or roughly paired, making it difficult for existing methods to achieve accurate pixel-level supervision. To address this challenge, we propose a robust virtual staining framework featuring cascaded registration mechanisms to resolve spatial mismatches between generated outputs and their corresponding ground truth. Experimental results demonstrate that our method significantly outperforms state-of-the-art models across five datasets, achieving an average improvement of 3.2% on internal datasets and 10.1% on external datasets. Moreover, in datasets with substantial misalignment, our approach achieves a remarkable 23.8% improvement in peak signal-to-noise ratio compared to baseline models. The exceptional robustness of the proposed method across diverse datasets simplifies the data acquisition process for virtual staining and offers new insights for advancing its development.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 59 references that are in the map. First posted on arXiv 17 Sep 2025.
Builds on
28 of 59 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2017Unsupervised Image-to-Image Translation Networkscited by 603
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
16 more
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
- 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
- 2022BCI: Breast Cancer Immunohistochemical Image Generation through Pyramid Pix2pixcited by 61
- 2020Deep learning-based transformation of the H&E stain into special stainscited by 55
- 2019Networks for Joint Affine and Non-parametric Image Registrationcited by 44
- 2022Deep Learning-enabled Virtual Histological Staining of Biological Samplescited by 42
- 2023Adaptive Supervised PatchNCE Loss for Learning H&E-to-IHC Stain Translation with Inconsistent Groundtruth Image Pairscited by 38
- 2020Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissuecited by 29
- 2020StainNet: a fast and robust stain normalization networkcited by 28
- 2019Unsupervised Deformable Image Registration Using Cycle-Consistent CNNcited by 22
- 2021Label-free virtual HER2 immunohistochemical staining of breast tissue using deep learningcited by 22
- 2024StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image Translationcited by 18
- 2023Virtual histological staining of unlabeled autopsy tissuecited by 11
- 2023Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Coloncited by 10
- 2024HEMIT: H&E to Multiplex-immunohistochemistry Image Translation with Dual-Branch Pix2pix Generatorcited by 7
- 2025Digital Staining with Knowledge Distillation: A Unified Framework for Unpaired and Paired-But-Misaligned Datacited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.