Digital Staining with Knowledge Distillation: A Unified Framework for Unpaired and Paired-But-Misaligned Data
On the map: Knowledge distillation → Distillation for medical imaging
Abstract (arXiv)
Staining is essential in cell imaging and medical diagnostics but poses significant challenges, including high cost, time consumption, labor intensity, and irreversible tissue alterations. Recent advances in deep learning have enabled digital staining through supervised model training. However, collecting large-scale, perfectly aligned pairs of stained and unstained images remains difficult. In this work, we propose a novel unsupervised deep learning framework for digital cell staining that reduces the need for extensive paired data using knowledge distillation. We explore two training schemes: (1) unpaired and (2) paired-but-misaligned settings. For the unpaired case, we introduce a two-stage pipeline, comprising light enhancement followed by colorization, as a teacher model. Subsequently, we obtain a student staining generator through knowledge distillation with hybrid non-reference losses. To leverage the pixel-wise information between adjacent sections, we further extend to the paired-but-misaligned setting, adding the Learning to Align module to utilize pixel-level information. Experiment results on our dataset demonstrate that our proposed unsupervised deep staining method can generate stained images with more accurate positions and shapes of the cell targets in both settings. Compared with competing methods, our method achieves improved results both qualitatively and quantitatively (e.g., NIQE and PSNR).We applied our digital staining method to the White Blood Cell (WBC) dataset, investigating its potential for medical applications.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 40 of its 85 references that are in the map. First posted on arXiv 14 Apr 2025.
Builds on
40 of 85 references.
Closest ancestors · 2
Same direction, newest first
- 2023Unsupervised Deep Digital Staining For Microscopic Cell Images Via Knowledge Distillation3 Mar
- 2021Efficient Medical Image Segmentation Based on Knowledge Distillation23 Aug
Other references · 38
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2016Colorful Image Colorizationcited by 1,114
- 2016Least Squares Generative Adversarial Networkscited by 1,001
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
- 2017Real-Time User-Guided Image Colorization with Learned Deep Priorscited by 123
- 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 103
- 2018Distribution Matching Losses Can Hallucinate Features in Medical Image Translationcited by 99
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
26 more
- 2020Unpaired Multi-modal Segmentation via Knowledge Distillationcited by 81
- 2020Instance-aware Image Colorizationcited by 76
- 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
- 2019ChromaGAN: Adversarial Picture Colorization with Semantic Class Distributioncited by 61
- 2020Deep learning-based transformation of the H&E stain into special stainscited by 55
- 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
- 2022Deep Learning-enabled Virtual Histological Staining of Biological Samplescited by 42
- 2022Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translationcited by 39
- 2022QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translationcited by 39
- 2020Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesiscited by 38
- 2021Teachers Do More Than Teach: Compressing Image-to-Image Modelscited by 37
- 2017Unsupervised Diverse Colorization via Generative Adversarial Networkscited by 30
- 2020Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissuecited by 29
- 2022Modulated Contrast for Versatile Image Synthesiscited by 23
- 2021Label-free virtual HER2 immunohistochemical staining of breast tissue using deep learningcited by 22
- 2023WBCAtt: A White Blood Cell Dataset Annotated with Detailed Morphological Attributescited by 22
- 2020Virtual staining for mitosis detection in Breast Histopathologycited by 13
- 2021Semantic Relation Preserving Knowledge Distillation for Image-to-Image Translationcited by 13
- 2024Progressive Divide-and-Conquer via Subsampling Decomposition for Accelerated MRIcited by 13
- 2021Disentangled Feature Representation for Few-shot Image Classificationcited by 12
- 2017VIDOSAT: High-dimensional Sparsifying Transform Learning for Online Video Denoisingcited by 10
- 2022Deep Learning Methods for Calibrated Photometric Stereo and Beyondcited by 10
- 2023Digital staining in optical microscopy using deep learning -- a reviewcited by 7
- 2018Virtualization of tissue staining in digital pathology using an unsupervised deep learning approachcited by 6
- 2022Ultra-high-resolution unpaired stain transformation via Kernelized Instance Normalizationcited by 5
- 2021DINO: A Conditional Energy-Based GAN for Domain Translationcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024StainFuser: Controlling Diffusion for Faster Neural Style Transfer in Multi-Gigapixel Histology Images
- 2021Resolution-Based Distillation for Efficient Histology Image Classification
- 2025VLM-based Prompts as the Optimal Assistant for Unpaired Histopathology Virtual Staining
- 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology
- 2025CellGenNet: A Knowledge-Distilled Framework for Robust Cell Segmentation in Cancer Tissues
- 2025GANs vs. Diffusion Models for virtual staining with the HER2match dataset
- 2026Computationally Efficient Pathology Segmentation using Knowledge Distillation from Foundation Models
- 2022H&E Stain Normalization using U-Net