mlsanityData to 7 Oct 2026

DenseMP: Unsupervised Dense Pre-training for Few-shot Medical Image Segmentation

arXiv 2307.09604 ↗First posted 13 Jul 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Few-shot medical image semantic segmentation is of paramount importance in the domain of medical image analysis. However, existing methodologies grapple with the challenge of data scarcity during the training phase, leading to over-fitting. To mitigate this issue, we introduce a novel Unsupervised Dense Few-shot Medical Image Segmentation Model Training Pipeline (DenseMP) that capitalizes on unsupervised dense pre-training. DenseMP is composed of two distinct stages: (1) segmentation-aware dense contrastive pre-training, and (2) few-shot-aware superpixel guided dense pre-training. These stages collaboratively yield a pre-trained initial model specifically designed for few-shot medical image segmentation, which can subsequently be fine-tuned on the target dataset. Our proposed pipeline significantly enhances the performance of the widely recognized few-shot segmentation model, PA-Net, achieving state-of-the-art results on the Abd-CT and Abd-MRI datasets. Code will be released after acceptance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 61 references that are in the map. First posted on arXiv 13 Jul 2023.

Builds on

37 of 61 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  8. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  9. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
  10. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  11. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  12. 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
25 more
  1. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  2. 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
  3. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  4. 2018Rethinking ImageNet Pre-trainingcited by 376
  5. 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
  6. 2017One-Shot Learning for Semantic Segmentationcited by 337
  7. 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
  8. 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
  9. 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
  10. 2015Conditional Random Fields as Recurrent Neural Networkscited by 213
  11. 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
  12. 2018An efficient framework for learning sentence representationscited by 197
  13. 2018SG-One: Similarity Guidance Network for One-Shot Semantic Segmentationcited by 169
  14. 2020Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentationcited by 134
  15. 2020Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotationcited by 128
  16. 2020CRNet: Cross-Reference Networks for Few-Shot Segmentationcited by 101
  17. 2020TAP: Text-Aware Pre-training for Text-VQA and Text-Captioncited by 95
  18. 2018Unsupervised domain adaptation for medical imaging segmentation with self-ensemblingcited by 94
  19. 2019'Squeeze & Excite' Guided Few-Shot Segmentation of Volumetric Imagescited by 69
  20. 2021Mining Latent Classes for Few-shot Segmentationcited by 69
  21. 2021Learning Meta-class Memory for Few-Shot Semantic Segmentationcited by 56
  22. 2021CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understandingcited by 50
  23. 2015Semantic Image Segmentation via Deep Parsing Networkcited by 44
  24. 2020Going to Extremes: Weakly Supervised Medical Image Segmentationcited by 38
  25. 2019A Survey on Deep Learning-based Architectures for Semantic Segmentation on 2D imagescited by 29

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.