IMPLICITSTAINER: Resolution Agnostic Data-Efficient Virtual Staining Using Neural Implicit Functions
Not on the map. Why?
Abstract (arXiv)
Hematoxylin and eosin (H&E)-stained slides are central to cancer diagnosis and monitoring, visualizing tissue architecture and cellular morphology. However, H&E lacks the molecular specificity needed to distinguish cell states and functional activation. Antibody-based stains, such as immunohistochemistry (IHC), are therefore required to identify specific phenotypes (e.g., CD3^+ T cells or HER2-positive tumor cells) but are costly, time-consuming, and not universally available. Deep learning-based image translation methods, often termed virtual staining, offer a complementary alternative by generating virtual immunostains directly from H&E images. Most existing virtual staining methods are patch-based and operate at fixed resolutions, often requiring large datasets and additional post-hoc super-resolution models to generate high-resolution images. Furthermore, GAN- and diffusion-based approaches introduce stochasticity into generated stains which, although beneficial for visual realism in natural images, can lead to hallucinations and structural distortions that affect the accuracy and reliability required for clinical use. We propose IMPLICITSTAINER, a deterministic framework that reformulates virtual staining as a continuous pixel-level translation problem. In contrast to existing patch-based approaches, IMPLICITSTAINER formulates image translation as a continuous spatial mapping using neural implicit deep learning models. Each target-domain (IHC) pixel is predicted from a high-dimensional embedding of the corresponding source-domain H&E pixel, its local spatial neighborhood, and explicit coordinate information. IMPLICITSTAINER enables resolution-agnostic inference, improves robustness in low-data regimes, and yields deterministic, reproducible outputs. Across more than twenty baselines, IMPLICITSTAINER achieves SOTA performance on virtual staining tasks, including IHC and mIF.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 55 of its 104 references that are in the map. First posted on arXiv 14 May 2025.
Builds on
55 of 104 references.
References · 55
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
38 more
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2017Unsupervised Image-to-Image Translation Networkscited by 603
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
- 2019Axial Attention in Multidimensional Transformerscited by 358
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2021UniT: Multimodal Multitask Learning with a Unified Transformercited by 195
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2019Seeing What a GAN Cannot Generatecited by 148
- 2020Image Generators with Conditionally-Independent Pixel Synthesiscited by 106
- 2022Global Context Vision Transformerscited by 98
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
- 2018Bias and Generalization in Deep Generative Models: An Empirical Studycited by 83
- 2019Diversity-Sensitive Conditional Generative Adversarial Networkscited by 77
- 2019AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networkscited by 77
- 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
- 2017CycleGAN, a Master of Steganographycited by 65
- 2022BCI: Breast Cancer Immunohistochemical Image Generation through Pyramid Pix2pixcited by 61
- 2020Spatially-Adaptive Pixelwise Networks for Fast Image Translationcited by 45
- 2020Unpaired Image-to-Image Translation using Adversarial Consistency Losscited by 43
- 2022UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translationcited by 42
- 2022Surface Reconstruction from Point Clouds: A Survey and a Benchmarkcited by 41
- 2022QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translationcited by 39
- 2023Adaptive Supervised PatchNCE Loss for Learning H&E-to-IHC Stain Translation with Inconsistent Groundtruth Image Pairscited by 38
- 2020Combating Mode Collapse in GAN training: An Empirical Analysis using Hessian Eigenvaluescited by 27
- 2024Tackling Structural Hallucination in Image Translation with Local Diffusioncited by 21
- 2024Pathological Semantics-Preserving Learning for H&E-to-IHC Virtual Stainingcited by 21
- 2024StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image Translationcited by 18
- 2022Vector Quantized Image-to-Image Translationcited by 16
- 2022Virtual stain transfer in histology via cascaded deep neural networkscited by 13
- 2024StainDiffuser: MultiTask Dual Diffusion Model for Virtual Stainingcited by 11
- 2024Vision transformers in domain adaptation and domain generalization: a study of robustnesscited by 11
- 2025Mitigating Hallucinations in Diffusion Models through Adaptive Attention Modulationcited by 11
- 2023Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Coloncited by 10
- 2024VIMs: Virtual Immunohistochemistry Multiplex staining via Text-to-Stain Diffusion Trained on Uniplex Stainscited by 10
- 2024Virtual birefringence imaging and histological staining of amyloid deposits in label-free tissue using autofluorescence microscopy and deep learningcited by 8
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.