mlsanityData to 14 Oct 2026

MUSE: Multi-Scale Dense Self-Distillation for Nucleus Detection and Classification

arXiv 2511.05170 ↗First posted 7 Nov 2025cs.CVcited by 2

On the map: Knowledge distillation → Distillation for medical imaging

Abstract (arXiv)

Nucleus detection and classification (NDC) in histopathology analysis is a fundamental task that underpins a wide range of high-level pathology applications. However, existing methods heavily rely on labor-intensive nucleus-level annotations and struggle to fully exploit large-scale unlabeled data for learning discriminative nucleus representations. In this work, we propose MUSE (MUlti-scale denSE self-distillation), a novel self-supervised learning method tailored for NDC. At its core is NuLo (Nucleus-based Local self-distillation), a coordinate-guided mechanism that enables flexible local self-distillation based on predicted nucleus positions. By removing the need for strict spatial alignment between augmented views, NuLo allows critical cross-scale alignment, thus unlocking the capacity of models for fine-grained nucleus-level representation. To support MUSE, we design a simple yet effective encoder-decoder architecture and a large field-of-view semi-supervised fine-tuning strategy that together maximize the value of unlabeled pathology images. Extensive experiments on three widely used benchmarks demonstrate that MUSE effectively addresses the core challenges of histopathological NDC. The resulting models not only surpass state-of-the-art supervised baselines but also outperform generic pathology foundation models.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 18 of its 37 references that are in the map. First posted on arXiv 7 Nov 2025.

Builds on

18 of 37 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 2021Vision Transformers for Dense Predictioncited by 1,803
  8. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
  9. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
  10. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
  11. 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 388
  12. 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 150
6 more
  1. 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
  2. 2023OCELOT: Overlapped Cell on Tissue Dataset for Histopathologycited by 29
  3. 2025CellViT++: Energy-Efficient and Adaptive Cell Segmentation and Classification Using Foundation Modelscited by 21
  4. 2023Structure Embedded Nucleus Classification for Histopathology Imagescited by 14
  5. 2024Cell Graph Transformer for Nuclei Classificationcited by 9
  6. 2023DPA-P2PNet: Deformable Proposal-aware P2PNet for Accurate Point-based Cell Detectioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From UNI2-h to ConvNeXt-T: Lightweight Nuclei Instance Segmentation via Knowledge Distillation
  2. 2022Self-distillation Augmented Masked Autoencoders for Histopathological Image Classification
  3. 2021Self-supervised driven consistency training for annotation efficient histopathology image analysis
  4. 2023HoVer-UNet: Accelerating HoVerNet with UNet-based multi-class nuclei segmentation via knowledge distillation
  5. 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Models
  6. 2023TransNuSeg: A Lightweight Multi-Task Transformer for Nuclei Segmentation
  7. 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Model
  8. 2023NASDM: Nuclei-Aware Semantic Histopathology Image Generation Using Diffusion Models