mlsanityData to 14 Oct 2026

Weakly-supervised positional contrastive learning: application to cirrhosis classification

arXiv 2307.04617 ↗First posted 10 Jul 2023cs.CV cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Large medical imaging datasets can be cheaply and quickly annotated with low-confidence, weak labels (e.g., radiological scores). Access to high-confidence labels, such as histology-based diagnoses, is rare and costly. Pretraining strategies, like contrastive learning (CL) methods, can leverage unlabeled or weakly-annotated datasets. These methods typically require large batch sizes, which poses a difficulty in the case of large 3D images at full resolution, due to limited GPU memory. Nevertheless, volumetric positional information about the spatial context of each 2D slice can be very important for some medical applications. In this work, we propose an efficient weakly-supervised positional (WSP) contrastive learning strategy where we integrate both the spatial context of each 2D slice and a weak label via a generic kernel-based loss function. We illustrate our method on cirrhosis prediction using a large volume of weakly-labeled images, namely radiological low-confidence annotations, and small strongly-labeled (i.e., high-confidence) datasets. The proposed model improves the classification AUC by 5% with respect to a baseline model on our internal dataset, and by 26% on the public LIHC dataset from the Cancer Genome Atlas. The code is available at: https://github.com/Guerbet-AI/wsp-contrastive.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 10 Jul 2023.

Builds on

23 of 31 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  6. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  7. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  8. 2020Supervised Contrastive Learningcited by 2,829
  9. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  10. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
  11. 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
  12. 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
11 more
  1. 2019Kornia: an Open Source Differentiable Computer Vision Library for PyTorchcited by 232
  2. 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
  3. 2019Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluationcited by 107
  4. 2021Contrastive Learning with Stronger Augmentationscited by 100
  5. 2019Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik's Cubecited by 76
  6. 2021Positional Contrastive Learning for Volumetric Medical Image Segmentationcited by 56
  7. 2021Contrastive Learning with Continuous Proxy Meta-Data for 3D MRI Classificationcited by 49
  8. 2022Unbiased Supervised Contrastive Learningcited by 40
  9. 2021ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Geneticscited by 36
  10. 2022Contrastive learning for regression in multi-site brain age predictioncited by 14
  11. 2023Learning to diagnose cirrhosis from radiological and histological labels with joint self and weakly-supervised pretraining strategiescited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.