mlsanityData to 7 Oct 2026

Adaptive Multi-Scale Integration Unlocks Robust Cell Annotation in Histopathology Images

arXiv 2511.13586 ↗First posted 17 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Identifying cell types and subtypes in routine histopathology is fundamental for understanding disease. Existing tile-based models capture nuclear detail but miss the broader tissue context that influences cell identity. Current human annotations are coarse-grained and uneven across studies, making fine-grained, subtype-level classification difficult. In this study, we build a marker-guided dataset from Xenium spatial transcriptomics with single-cell resolution labels for more than two million cells across eight organs and 16 classes to address the lack of high-quality annotations. Leveraging this data resource, we introduce NuClass, a pathologist workflow inspired framework for cell-wise multi-scale integration of nuclear morphology and microenvironmental context. It combines Path local, which focuses on nuclear morphology from 224x224 pixel crops, and Path global, which models the surrounding 1024x1024 pixel neighborhood, through a learnable gating module that balances local and global information. An uncertainty-guided objective directs the global path to prioritize regions where the local path is uncertain, and we provide calibrated confidence estimates and Grad-CAM maps for interpretability. Evaluated on three fully held-out cohorts, NuClass achieves up to 96 percent F1 for its best-performing class, outperforming strong baselines. Our results demonstrate that multi-scale, uncertainty-aware fusion can bridge the gap between slide-level pathological foundation models and reliable, cell-level phenotype prediction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

22 of 40 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2016Layer Normalizationcited by 5,579
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  7. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  8. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,479
  9. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
  10. 2019When Does Label Smoothing Help?cited by 985
  11. 2016Deep Networks with Stochastic Depthcited by 973
  12. 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
10 more
  1. 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 387
  2. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
  3. 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
  4. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 132
  5. 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
  6. 2021Lizard: A Large-Scale Dataset for Colonic Nuclear Instance Segmentation and Classificationcited by 89
  7. 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 33
  8. 2022Nuclei instance segmentation and classification in histopathology images with StarDistcited by 31
  9. 2023Structure Embedded Nucleus Classification for Histopathology Imagescited by 14
  10. 2023VOLTA: an Environment-Aware Contrastive Cell Representation Learning for Histopathologycited by 6

Built on by

Not cited yet.