Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning
Not on the map. Why?
Abstract (arXiv)
3D medical image segmentation is a challenging task with crucial implications for disease diagnosis and treatment planning. Recent advances in deep learning have significantly enhanced fully supervised medical image segmentation. However, this approach heavily relies on labor-intensive and time-consuming fully annotated ground-truth labels, particularly for 3D volumes. To overcome this limitation, we propose a novel probabilistic-aware weakly supervised learning pipeline, specifically designed for 3D medical imaging. Our pipeline integrates three innovative components: a Probability-based Pseudo Label Generation technique for synthesizing dense segmentation masks from sparse annotations, a Probabilistic Multi-head Self-Attention network for robust feature extraction within our Probabilistic Transformer Network, and a Probability-informed Segmentation Loss Function to enhance training with annotation confidence. Demonstrating significant advances, our approach not only rivals the performance of fully supervised methods but also surpasses existing weakly supervised methods in CT and MRI datasets, achieving up to 18.1% improvement in Dice scores for certain organs. The code is available at https://github.com/runminjiang/PW4MedSeg.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 40 of its 56 references that are in the map. First posted on arXiv 5 Mar 2024.
Builds on
40 of 56 references.
References · 40
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
28 more
- 2015Variational Dropout and the Local Reparameterization Trickcited by 489
- 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 330
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
- 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
- 2019Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentationcited by 258
- 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
- 2015BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentationcited by 238
- 2021UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformercited by 197
- 2019MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentationcited by 195
- 2020PseudoSeg: Designing Pseudo Labels for Semantic Segmentationcited by 180
- 2020Single-Stage Semantic Segmentation from Image Labelscited by 167
- 2021Active Learning for Deep Object Detection via Probabilistic Modelingcited by 79
- 2018Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removalcited by 56
- 2022Anomaly Detection-Inspired Few-Shot Medical Image Segmentation Through Self-Supervision With Supervoxelscited by 42
- 2021Optimized U-Net for Brain Tumor Segmentationcited by 40
- 2020Going to Extremes: Weakly Supervised Medical Image Segmentationcited by 38
- 2021ACPL: Anti-curriculum Pseudo-labelling for Semi-supervised Medical Image Classificationcited by 34
- 2021Fully Convolutional Networks for Panoptic Segmentation with Point-based Supervisioncited by 31
- 2017Adversarial Synthesis Learning Enables Segmentation Without Target Modality Ground Truthcited by 30
- 2019Improving Robustness of Deep Learning Based Knee MRI Segmentation: Mixup and Adversarial Domain Adaptationcited by 27
- 2022Transformer based multiple instance learning for weakly supervised histopathology image segmentationcited by 26
- 2021Bayesian Attention Belief Networkscited by 25
- 2018Three Dimensional Fluorescence Microscopy Image Synthesis and Segmentationcited by 19
- 2019Neural Style Transfer Improves 3D Cardiovascular MR Image Segmentation on Inconsistent Datacited by 18
- 2019Unsupervised Multi-modal Style Transfer for Cardiac MR Segmentationcited by 15
- 2023AME-CAM: Attentive Multiple-Exit CAM for Weakly Supervised Segmentation on MRI Brain Tumorcited by 8
- 2018Dynamic Optimization of Neural Network Structures Using Probabilistic Modelingcited by 4
- 2019Transfer Learning with Edge Attention for Prostate MRI Segmentationcited by 4
Built on by
Citing papers per year: 2025: 2.
2 papers.