mlsanityData to 14 Oct 2026

PAINT: Pathology-Aware Integrated Next-Scale Transformation for Virtual Immunohistochemistry

arXiv 2601.16024 ↗First posted 22 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Virtual immunohistochemistry (IHC) aims to computationally synthesize molecular staining patterns from routine Hematoxylin and Eosin (H&E) images, offering a cost-effective and tissue-efficient alternative to traditional physical staining. However, this task is particularly challenging: H&E morphology provides ambiguous cues about protein expression, and similar tissue structures may correspond to distinct molecular states. Most existing methods focus on direct appearance synthesis to implicitly achieve cross-modal generation, often resulting in semantic inconsistencies due to insufficient structural priors. In this paper, we propose Pathology-Aware Integrated Next-Scale Transformation (PAINT), a visual autoregressive framework that reformulates the synthesis process as a structure-first conditional generation task. Unlike direct image translation, PAINT enforces a causal order by resolving molecular details conditioned on a global structural layout. Central to this approach is the introduction of a Spatial Structural Start Map (3S-Map), which grounds the autoregressive initialization in observed morphology, ensuring deterministic, spatially aligned synthesis. Experiments on the IHC4BC and MIST datasets demonstrate that PAINT outperforms state-of-the-art methods in structural fidelity and clinical downstream tasks, validating the potential of structure-guided autoregressive modeling.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

28 of 43 references.

References · 28

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  7. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  8. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  9. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  10. 2016Pixel Recurrent Neural Networkscited by 816
  11. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
  12. 2018Image Transformercited by 772
16 more
  1. 2021Vector-quantized Image Modeling with Improved VQGANcited by 658
  2. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
  3. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
  4. 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 192
  5. 2019Deep neural network models for computational histopathology: A surveycited by 165
  6. 2018Distribution Matching Losses Can Hallucinate Features in Medical Image Translationcited by 99
  7. 2020On hallucinations in tomographic image reconstructioncited by 68
  8. 2023Adaptive Supervised PatchNCE Loss for Learning H&E-to-IHC Stain Translation with Inconsistent Groundtruth Image Pairscited by 38
  9. 2024Hallucination Index: An Image Quality Metric for Generative Reconstruction Modelscited by 26
  10. 2024Pathological Semantics-Preserving Learning for H&E-to-IHC Virtual Stainingcited by 21
  11. 2022Vector Quantized Image-to-Image Translationcited by 16
  12. 2023Predicting Ki67, ER, PR, and HER2 Statuses from H&E-stained Breast Cancer Imagescited by 14
  13. 2022DeepLIIF: An Online Platform for Quantification of Clinical Pathology Slidescited by 9
  14. 2024DeeperHistReg: Robust Whole Slide Images Registration Frameworkcited by 6
  15. 2025HistDiST: Histopathological Diffusion-based Stain Transfercited by 5
  16. 2025Virtual Full-stack Scanning of Brain MRI via Imputing Any Quantised Codecited by 4

Built on by

Not cited yet.