mlsanityData to 14 Oct 2026

ClamNet: Using contrastive learning with variable depth Unets for medical image segmentation

arXiv 2206.05225 ↗First posted 10 Jun 2022cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Unets have become the standard method for semantic segmentation of medical images, along with fully convolutional networks (FCN). Unet++ was introduced as a variant of Unet, in order to solve some of the problems facing Unet and FCNs. Unet++ provided networks with an ensemble of variable depth Unets, hence eliminating the need for professionals estimating the best suitable depth for a task. While Unet and all its variants, including Unet++ aimed at providing networks that were able to train well without requiring large quantities of annotated data, none of them attempted to eliminate the need for pixel-wise annotated data altogether. Obtaining such data for each disease to be diagnosed comes at a high cost. Hence such data is scarce. In this paper we use contrastive learning to train Unet++ for semantic segmentation of medical images using medical images from various sources including magnetic resonance imaging (MRI) and computed tomography (CT), without the need for pixel-wise annotations. Here we describe the architecture of the proposed model and the training method used. This is still a work in progress and so we abstain from including results in this paper. The results and the trained model would be made available upon publication or in subsequent versions of this paper on arxiv.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 73 references that are in the map. First posted on arXiv 10 Jun 2022.

Builds on

47 of 73 references.

References · 47

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  4. 2017Mask R-CNNcited by 7,277
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  7. 2016Pyramid Scene Parsing Networkcited by 2,479
  8. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  9. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  10. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
  11. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
  12. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
35 more
  1. 2019Contrastive Multiview Codingcited by 1,301
  2. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  3. 2018Dual Attention Network for Scene Segmentationcited by 1,003
  4. 2017A Survey on Multi-Task Learningcited by 840
  5. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 640
  6. 2020Contrastive Learning with Hard Negative Samplescited by 628
  7. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
  8. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 576
  9. 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 554
  10. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  11. 2017Progressive Neural Architecture Searchcited by 487
  12. 2017Deep Layer Aggregationcited by 436
  13. 2020Hard Negative Mixing for Contrastive Learningcited by 402
  14. 2017Deep Learning for Medical Image Analysiscited by 401
  15. 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
  16. 2014Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networkscited by 300
  17. 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
  18. 2017ICNet for Real-Time Semantic Segmentation on High-Resolution Imagescited by 261
  19. 2019Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentationcited by 260
  20. 2019Unsupervised Embedding Learning via Invariant and Spreading Instance Featurecited by 232
  21. 2017LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentationcited by 214
  22. 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
  23. 2016Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learningcited by 209
  24. 2016Grad-CAM: Why did you say that?cited by 161
  25. 2020Unsupervised Learning of Dense Visual Representationscited by 147
  26. 2018OCNet: Object Context Network for Scene Parsingcited by 140
  27. 2017Semantic Instance Segmentation with a Discriminative Loss Functioncited by 118
  28. 2019SegSort: Segmentation by Discriminative Sorting of Segmentscited by 96
  29. 2017Recurrent Pixel Embedding for Instance Groupingcited by 58
  30. 2019Region Mutual Information Loss for Semantic Segmentationcited by 49
  31. 2018Adaptive Affinity Fields for Semantic Segmentationcited by 48
  32. 2017Semantic Instance Segmentation via Deep Metric Learningcited by 37
  33. 2017Deeply-Supervised CNN for Prostate Segmentationcited by 30
  34. 2018MDU-Net: Multi-scale Densely Connected U-Net for biomedical image segmentationcited by 27
  35. 2021Pulmonary Vessel Segmentation based on Orthogonal Fused U-Net++ of Chest CT Imagescited by 11

Built on by

Not cited yet.