Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment
Not on the map. Why?
Abstract (arXiv)
Histopathological examination primarily relies on hematoxylin and eosin (H&E) and immunohistochemistry (IHC) staining. Although IHC provides critical molecular information, it is costly and requires specialized expertise. Stain transfer provides an efficient alternative by computationally generating IHC from H&E images, but remains challenged by unified and interpretable modeling for heterogeneous biomarkers under pixel-unaligned supervision. We propose DMCoStain, a novel Data-Model Co-optimization framework for Stain transfer. It iteratively co-refines training data and model capability, improving staining accuracy and interpretability in both pathological and structural consistency. To refine training data in a clinically meaningful manner, it incorporates the Multimodal Expert-Guided Finer Selection (MEGFS) strategy, built upon a pioneering IHC-positive-expression (IPE) vision-language model (VLM) that emulates pathologist reasoning. To support MEGFS, we construct ImmunoInstruction, the first large-scale IPE instruction-following dataset with 150K VQA samples. Extensive experiments on multiple tissues and biomarkers demonstrate that DMCoStain achieves state-of-the-art (SOTA) accuracy. This paradigm offers strong practical value, and MEGFS also functions as a specialized evaluation tool for future model development. Dataset, code, and more details are in https://github.com/SikangSHU/DMCoStain.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 40 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
9 of 40 references.
References · 9
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathologycited by 57
- 2024SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understandingcited by 57
- 2024WSI-LLaVA: A Multimodal Large Language Model for Whole Slide Imagecited by 40
- 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasonercited by 40
- 2024Pathological Semantics-Preserving Learning for H&E-to-IHC Virtual Stainingcited by 21
- 2025MiCo: Multiple Instance Learning with Context-Aware Clustering for Whole Slide Image Analysiscited by 7
- 2025USIGAN: Unbalanced Self-Information Feature Transport for Weakly Paired Image IHC Virtual Stainingcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PGVMS: A Prompt-Guided Unified Framework for Virtual Multiplex IHC Staining with Pathological Semantic Learning
- 2025StainNet: Scaling Self-Supervised Foundation Models on Immunohistochemistry and Special Stains for Computational Pathology
- 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology
- 2025Score-based Diffusion Model for Unpaired Virtual Histology Staining
- 2025HistDiST: Histopathological Diffusion-based Stain Transfer
- 2025From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC
- 2026A Generative Foundation Model for Multimodal Histopathology
- 2025Multi-Modal Foundation Models for Computational Pathology: A Survey