DenseMP: Unsupervised Dense Pre-training for Few-shot Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Few-shot medical image semantic segmentation is of paramount importance in the domain of medical image analysis. However, existing methodologies grapple with the challenge of data scarcity during the training phase, leading to over-fitting. To mitigate this issue, we introduce a novel Unsupervised Dense Few-shot Medical Image Segmentation Model Training Pipeline (DenseMP) that capitalizes on unsupervised dense pre-training. DenseMP is composed of two distinct stages: (1) segmentation-aware dense contrastive pre-training, and (2) few-shot-aware superpixel guided dense pre-training. These stages collaboratively yield a pre-trained initial model specifically designed for few-shot medical image segmentation, which can subsequently be fine-tuned on the target dataset. Our proposed pipeline significantly enhances the performance of the widely recognized few-shot segmentation model, PA-Net, achieving state-of-the-art results on the Abd-CT and Abd-MRI datasets. Code will be released after acceptance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 61 references that are in the map. First posted on arXiv 13 Jul 2023.
Builds on
37 of 61 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
25 more
- 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
- 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2018Rethinking ImageNet Pre-trainingcited by 376
- 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
- 2017One-Shot Learning for Semantic Segmentationcited by 337
- 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
- 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
- 2015Conditional Random Fields as Recurrent Neural Networkscited by 213
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2018An efficient framework for learning sentence representationscited by 197
- 2018SG-One: Similarity Guidance Network for One-Shot Semantic Segmentationcited by 169
- 2020Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentationcited by 134
- 2020Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotationcited by 128
- 2020CRNet: Cross-Reference Networks for Few-Shot Segmentationcited by 101
- 2020TAP: Text-Aware Pre-training for Text-VQA and Text-Captioncited by 95
- 2018Unsupervised domain adaptation for medical imaging segmentation with self-ensemblingcited by 94
- 2019'Squeeze & Excite' Guided Few-Shot Segmentation of Volumetric Imagescited by 69
- 2021Mining Latent Classes for Few-shot Segmentationcited by 69
- 2021Learning Meta-class Memory for Few-Shot Semantic Segmentationcited by 56
- 2021CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understandingcited by 50
- 2015Semantic Image Segmentation via Deep Parsing Networkcited by 44
- 2020Going to Extremes: Weakly Supervised Medical Image Segmentationcited by 38
- 2019A Survey on Deep Learning-based Architectures for Semantic Segmentation on 2D imagescited by 29
Built on by
Citing papers per year: 2025: 1.
1 paper.