Weakly-Supervised 3D Medical Image Segmentation using Geometric Prior and Contrastive Similarity
Not on the map. Why?
Abstract (arXiv)
Medical image segmentation is almost the most important pre-processing procedure in computer-aided diagnosis but is also a very challenging task due to the complex shapes of segments and various artifacts caused by medical imaging, (i.e., low-contrast tissues, and non-homogenous textures). In this paper, we propose a simple yet effective segmentation framework that incorporates the geometric prior and contrastive similarity into the weakly-supervised segmentation framework in a loss-based fashion. The proposed geometric prior built on point cloud provides meticulous geometry to the weakly-supervised segmentation proposal, which serves as better supervision than the inherent property of the bounding-box annotation (i.e., height and width). Furthermore, we propose contrastive similarity to encourage organ pixels to gather around in the contrastive embedding space, which helps better distinguish low-contrast tissues. The proposed contrastive embedding space can make up for the poor representation of the conventionally-used gray space. Extensive experiments are conducted to verify the effectiveness and the robustness of the proposed weakly-supervised segmentation framework. The proposed framework is superior to state-of-the-art weakly-supervised methods on the following publicly accessible datasets: LiTS 2017 Challenge, KiTS 2021 Challenge, and LPBA40. We also dissect our method and evaluate the performance of each component.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 44 of its 65 references that are in the map. First posted on arXiv 4 Feb 2023.
Builds on
44 of 65 references.
References · 44
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2018Open3D: A Modern Library for 3D Data Processingcited by 717
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
- 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 330
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
32 more
- 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
- 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
- 2016ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentationcited by 291
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2015BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentationcited by 238
- 2016Simple Does It: Weakly Supervised Instance and Semantic Segmentationcited by 226
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2015Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentationcited by 189
- 2019The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 Challengecited by 188
- 2020GRNet: Gridding Residual Network for Dense Point Cloud Completioncited by 174
- 2020BoxInst: High-Performance Instance Segmentation with Box Annotationscited by 150
- 2021Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bankcited by 125
- 2017Anatomically Constrained Neural Networks (ACNN): Application to Cardiac Image Enhancement and Segmentationcited by 109
- 2015Constrained Convolutional Neural Networks for Weakly Supervised Segmentationcited by 100
- 2020Contrastive Learning for Label-Efficient Semantic Segmentationcited by 93
- 2019Prior-aware Neural Network for Partially-Supervised Multi-Organ Segmentationcited by 88
- 2021SimCVD: Simple Contrastive Voxel-Wise Representation Distillation for Semi-Supervised Medical Image Segmentationcited by 86
- 2016DeepCut: Object Segmentation from Bounding Box Annotations using Convolutional Neural Networkscited by 79
- 2019CAMEL: A Weakly Supervised Learning Framework for Histopathology Image Segmentationcited by 73
- 2018Constrained-CNN losses for weakly supervised segmentationcited by 62
- 2014Multi-Atlas Segmentation of Biomedical Images: A Surveycited by 56
- 2020Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Imagescited by 55
- 2021Semi-supervised Contrastive Learning for Label-efficient Medical Image Segmentationcited by 52
- 2017Constrained Deep Weak Supervision for Histopathology Image Segmentationcited by 51
- 2021Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentationcited by 43
- 2019Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentationcited by 40
- 2020Bounding boxes for weakly supervised segmentation: Global constraints get close to full supervisioncited by 40
- 2021Inter Extreme Points Geodesics for End-to-End Weakly Supervised Image Segmentationcited by 21
- 2021Weakly supervised segmentation with cross-modality equivariant constraintscited by 18
- 2021Boosting Semi-supervised Image Segmentation with Global and Local Mutual Information Regularizationcited by 14
- 2019Constrained domain adaptation for Image segmentationcited by 10
- 2021Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentationcited by 8
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 2; 2026: 1.
9 papers.
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directionscited by 14
- 2024Ultrasound Nodule Segmentation Using Asymmetric Learning with Simple Clinical Annotationcited by 9
- 2025WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM with Sub-Class Exploration and Prompt Affinity Miningcited by 8
- 2023SimPLe: Similarity-Aware Propagation Learning for Weakly-Supervised Breast Cancer Segmentation in DCE-MRIcited by 6
- 2024Beyond Pixel-Wise Supervision for Medical Image Segmentation: From Traditional Models to Foundation Modelscited by 4
- 20243D Vascular Segmentation Supervised by 2D Annotation of Maximum Intensity Projectioncited by 3
- 2024Enhancing pretraining efficiency for medical image segmentation via transferability metricscited by 0
- 2025Weakly Supervised Segmentation Framework for Thyroid Nodule Based on High-confidence Labels and High-rationality Lossescited by 0
- 2026Example-based Robust Abnormality Detection with Minimal Annotations using Exemplar Med-DETRcited by 0
- 2026Example-based Robust Abnormality Detection with Minimal Annotations using Exemplar Med-DETR25 Aug 2026
- 2025WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM with Sub-Class Exploration and Prompt Affinity Mining6 Mar 2025
- 2025Weakly Supervised Segmentation Framework for Thyroid Nodule Based on High-confidence Labels and High-rationality Losses27 Feb 2025
- 2024Enhancing pretraining efficiency for medical image segmentation via transferability metrics24 Oct 2024
- 2024Ultrasound Nodule Segmentation Using Asymmetric Learning with Simple Clinical Annotation23 Apr 2024
- 2024Beyond Pixel-Wise Supervision for Medical Image Segmentation: From Traditional Models to Foundation Models20 Apr 2024
- 20243D Vascular Segmentation Supervised by 2D Annotation of Maximum Intensity Projection19 Feb 2024
- 2023SimPLe: Similarity-Aware Propagation Learning for Weakly-Supervised Breast Cancer Segmentation in DCE-MRI29 Jun 2023
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directions22 Mar 2023