mlsanityData to 14 Oct 2026

Digital Staining with Knowledge Distillation: A Unified Framework for Unpaired and Paired-But-Misaligned Data

arXiv 2504.09899 ↗First posted 14 Apr 2025cs.CV eess.IVcited by 2

On the map: Knowledge distillation → Distillation for medical imaging

Abstract (arXiv)

Staining is essential in cell imaging and medical diagnostics but poses significant challenges, including high cost, time consumption, labor intensity, and irreversible tissue alterations. Recent advances in deep learning have enabled digital staining through supervised model training. However, collecting large-scale, perfectly aligned pairs of stained and unstained images remains difficult. In this work, we propose a novel unsupervised deep learning framework for digital cell staining that reduces the need for extensive paired data using knowledge distillation. We explore two training schemes: (1) unpaired and (2) paired-but-misaligned settings. For the unpaired case, we introduce a two-stage pipeline, comprising light enhancement followed by colorization, as a teacher model. Subsequently, we obtain a student staining generator through knowledge distillation with hybrid non-reference losses. To leverage the pixel-wise information between adjacent sections, we further extend to the paired-but-misaligned setting, adding the Learning to Align module to utilize pixel-level information. Experiment results on our dataset demonstrate that our proposed unsupervised deep staining method can generate stained images with more accurate positions and shapes of the cell targets in both settings. Compared with competing methods, our method achieves improved results both qualitatively and quantitatively (e.g., NIQE and PSNR).We applied our digital staining method to the White Blood Cell (WBC) dataset, investigating its potential for medical applications.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 40 of its 85 references that are in the map. First posted on arXiv 14 Apr 2025.

Builds on

40 of 85 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Unsupervised Deep Digital Staining For Microscopic Cell Images Via Knowledge Distillation3 Mar
  2. 2021Efficient Medical Image Segmentation Based on Knowledge Distillation23 Aug

Other references · 38

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  4. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  5. 2016Colorful Image Colorizationcited by 1,114
  6. 2016Least Squares Generative Adversarial Networkscited by 1,001
  7. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
  8. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  9. 2017Real-Time User-Guided Image Colorization with Learned Deep Priorscited by 123
  10. 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 103
  11. 2018Distribution Matching Losses Can Hallucinate Features in Medical Image Translationcited by 99
  12. 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
26 more
  1. 2020Unpaired Multi-modal Segmentation via Knowledge Distillationcited by 81
  2. 2020Instance-aware Image Colorizationcited by 76
  3. 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
  4. 2019ChromaGAN: Adversarial Picture Colorization with Semantic Class Distributioncited by 61
  5. 2020Deep learning-based transformation of the H&E stain into special stainscited by 55
  6. 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
  7. 2022Deep Learning-enabled Virtual Histological Staining of Biological Samplescited by 42
  8. 2022Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translationcited by 39
  9. 2022QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translationcited by 39
  10. 2020Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesiscited by 38
  11. 2021Teachers Do More Than Teach: Compressing Image-to-Image Modelscited by 37
  12. 2017Unsupervised Diverse Colorization via Generative Adversarial Networkscited by 30
  13. 2020Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissuecited by 29
  14. 2022Modulated Contrast for Versatile Image Synthesiscited by 23
  15. 2021Label-free virtual HER2 immunohistochemical staining of breast tissue using deep learningcited by 22
  16. 2023WBCAtt: A White Blood Cell Dataset Annotated with Detailed Morphological Attributescited by 22
  17. 2020Virtual staining for mitosis detection in Breast Histopathologycited by 13
  18. 2021Semantic Relation Preserving Knowledge Distillation for Image-to-Image Translationcited by 13
  19. 2024Progressive Divide-and-Conquer via Subsampling Decomposition for Accelerated MRIcited by 13
  20. 2021Disentangled Feature Representation for Few-shot Image Classificationcited by 12
  21. 2017VIDOSAT: High-dimensional Sparsifying Transform Learning for Online Video Denoisingcited by 10
  22. 2022Deep Learning Methods for Calibrated Photometric Stereo and Beyondcited by 10
  23. 2023Digital staining in optical microscopy using deep learning -- a reviewcited by 7
  24. 2018Virtualization of tissue staining in digital pathology using an unsupervised deep learning approachcited by 6
  25. 2022Ultra-high-resolution unpaired stain transformation via Kernelized Instance Normalizationcited by 5
  26. 2021DINO: A Conditional Energy-Based GAN for Domain Translationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024StainFuser: Controlling Diffusion for Faster Neural Style Transfer in Multi-Gigapixel Histology Images
  2. 2021Resolution-Based Distillation for Efficient Histology Image Classification
  3. 2025VLM-based Prompts as the Optimal Assistant for Unpaired Histopathology Virtual Staining
  4. 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology
  5. 2025CellGenNet: A Knowledge-Distilled Framework for Robust Cell Segmentation in Cancer Tissues
  6. 2025GANs vs. Diffusion Models for virtual staining with the HER2match dataset
  7. 2026Computationally Efficient Pathology Segmentation using Knowledge Distillation from Foundation Models
  8. 2022H&E Stain Normalization using U-Net