mlsanityData to 7 Oct 2026

Beyond ViT Tokens: Masked-Diffusion Pretrained Convolutional Pathology Foundation Model for Cell-Level Dense Prediction

arXiv 2605.08276 ↗First posted 8 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Cell-level dense prediction is central to computational pathology, but remains challenging due to fine-grained histological structures, strong domain shifts, and costly dense annotations. Existing ViT-based pathology foundation models rely on patch tokenization, which can disrupt spatial continuity and weaken local morphological details needed for cell-level prediction. To address this, we propose Masked-Diffusion Convolutional Foundation Models, termed ConvNeXt Masked-Diffusion (CMD), a self-supervised convolutional generative pretraining framework for dense pathology representation learning. CMD uses a fully convolutional ConvNeXt-UNet backbone, performs masked-diffusion pretraining in pixel space, and incorporates frozen pathology foundation model features through adaptive normalization. Experimental results demonstrate that CMD consistently outperforms existing ViT-based pathology foundation models and even surpasses state-of-the-art end-to-end segmentation methods while fine-tuning only a small number of task-specific parameters across multiple pathology dense prediction tasks. The advantage is particularly pronounced under limited annotation settings, where CMD exhibits stronger robustness and generalization ability. Our findings suggest that purely convolutional architectures can also serve as competitive pathology foundation models for cell-level dense prediction, achieving leading performance within the current ViT-dominated paradigm and providing a scalable, high-performance solution that better preserves histological structural priors for fine-grained pathology understanding.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 41 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

28 of 41 references.

References · 28

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2022A ConvNet for the 2020scited by 3,545
  7. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  8. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  9. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  10. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  11. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
  12. 2022Vision Transformer Adapter for Dense Predictionscited by 564
16 more
  1. 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
  2. 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 144
  3. 2023Open-vocabulary Object Segmentation with Diffusion Modelscited by 82
  4. 2018Methods for Segmentation and Classification of Digital Microscopy Tissue Imagescited by 72
  5. 2024Phikon-v2, A large and public feature extractor for biomarker predictioncited by 67
  6. 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 52
  7. 2020Dense Steerable Filter CNNs for Exploiting Rotational Symmetry in Histology Imagescited by 33
  8. 2024Towards Large-Scale Training of Pathology Foundation Modelscited by 19
  9. 2025Training state-of-the-art pathology foundation models with orders of magnitude less datacited by 19
  10. 2023Masked Diffusion as Self-supervised Representation Learnercited by 11
  11. 2024Agent Aggregator with Mask Denoise Mechanism for Histopathology Whole Slide Image Analysiscited by 11
  12. 2025HISTAI: An Open-Source, Large-Scale Whole Slide Image Dataset for Computational Pathologycited by 9
  13. 2025PathOrchestra: A Comprehensive Foundation Model for Computational Pathology with Over 100 Diverse Clinical-Grade Taskscited by 8
  14. 2025Subspecialty-Specific Foundation Model for Intelligent Gastrointestinal Pathologycited by 2
  15. 2026VISTA-PATH: An interactive foundation model for pathology image segmentation and quantitative analysis in computational pathologycited by 2
  16. 2025nnMIL: A generalizable multiple instance learning framework for computational pathologycited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.