Multimodal Prototype Alignment for Semi-supervised Pathology Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Pathological image segmentation faces numerous challenges, particularly due to ambiguous semantic boundaries and the high cost of pixel-level annotations. Although recent semi-supervised methods based on consistency regularization (e.g., UniMatch) have made notable progress, they mainly rely on perturbation-based consistency within the image modality, making it difficult to capture high-level semantic priors, especially in structurally complex pathology images. To address these limitations, we propose MPAMatch - a novel segmentation framework that performs pixel-level contrastive learning under a multimodal prototype-guided supervision paradigm. The core innovation of MPAMatch lies in the dual contrastive learning scheme between image prototypes and pixel labels, and between text prototypes and pixel labels, providing supervision at both structural and semantic levels. This coarse-to-fine supervisory strategy not only enhances the discriminative capability on unlabeled samples but also introduces the text prototype supervision into segmentation for the first time, significantly improving semantic boundary modeling. In addition, we reconstruct the classic segmentation architecture (TransUNet) by replacing its ViT backbone with a pathology-pretrained foundation model (Uni), enabling more effective extraction of pathology-relevant features. Extensive experiments on GLAS, EBHI-SEG-GLAND, EBHI-SEG-CANCER, and KPI show MPAMatch's superiority over state-of-the-art methods, validating its dual advantages in structural and semantic modeling.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 27 Aug 2025.
Builds on
23 of 40 references.
References · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 332
- 2019Billion-scale semi-supervised learning for image classificationcited by 232
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 178
- 2018Adversarial Learning for Semi-Supervised Semantic Segmentationcited by 173
11 more
- 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
- 2020Multi-scale Domain-adversarial Multiple-instance CNN for Cancer Subtype Classification with Unannotated Histopathological Imagescited by 81
- 2022Cross Language Image Matching for Weakly Supervised Semantic Segmentationcited by 72
- 2021Multi-Layer Pseudo-Supervision for Histopathology Tissue Semantic Segmentation using Patch-level Classification Labelscited by 43
- 2021Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentationcited by 43
- 2021Revisiting Consistency Regularization for Semi-Supervised Learningcited by 34
- 2020A Three-Stage Self-Training Framework for Semi-Supervised Semantic Segmentationcited by 30
- 2024Pathology-knowledge Enhanced Multi-instance Prompt Learning for Few-shot Whole Slide Image Classificationcited by 13
- 2020Semixup: In- and Out-of-Manifold Regularization for Deep Semi-Supervised Knee Osteoarthritis Severity Grading from Plain Radiographscited by 8
- 2024Diagnostic Text-guided Representation Learning in Hierarchical Classification for Pathological Whole Slide Imagecited by 4
- 2024mTREE: Multi-Level Text-Guided Representation End-to-End Learning for Whole Slide Image Analysiscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.