Primitive Geometry Segment Pre-training for 3D Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
The construction of 3D medical image datasets presents several issues, including requiring significant financial costs in data collection and specialized expertise for annotation, as well as strict privacy concerns for patient confidentiality compared to natural image datasets. Therefore, it has become a pressing issue in 3D medical image segmentation to enable data-efficient learning with limited 3D medical data and supervision. A promising approach is pre-training, but improving its performance in 3D medical image segmentation is difficult due to the small size of existing 3D medical image datasets. We thus present the Primitive Geometry Segment Pre-training (PrimGeoSeg) method to enable the learning of 3D semantic features by pre-training segmentation tasks using only primitive geometric objects for 3D medical image segmentation. PrimGeoSeg performs more accurate and efficient 3D medical image segmentation without manual data collection and annotation. Further, experimental results show that PrimGeoSeg on SwinUNETR improves performance over learning from scratch on BTCV, MSD (Task06), and BraTS datasets by 3.7%, 4.4%, and 0.3%, respectively. Remarkably, the performance was equal to or better than state-of-the-art self-supervised learning despite the equal number of pre-training data. From experimental results, we conclude that effective pre-training can be achieved by looking at primitive geometric objects only. Code and dataset are available at https://github.com/SUPER-TADORY/PrimGeoSeg.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 8 Jan 2024.
Builds on
23 of 32 references.
References · 23
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
- 2021The Medical Segmentation Decathloncited by 620
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
- 2021Self-supervised Pretraining of Visual Features in the Wildcited by 197
- 20203D Self-Supervised Methods for Medical Imagingcited by 134
- 2021Pre-training without Natural Imagescited by 100
- 2018Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapycited by 76
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
11 more
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
- 2021Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse Contextscited by 59
- 2021UniMiSS: Universal Medical Self-Supervised Learning via Breaking Dimensionality Barriercited by 55
- 2021Momentum Contrastive Voxel-wise Representation Learning for Semi-supervised Volumetric Medical Image Segmentationcited by 49
- 2017NiftyNet: a deep-learning platform for medical imagingcited by 45
- 2022Self-supervised 3D anatomy segmentation using self-distilled masked image transformer (SMIT)cited by 35
- 2021Can Vision Transformers Learn without Natural Images?cited by 32
- 2021Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representationscited by 24
- 2022Pre-training Vision Transformers with Formula-driven Supervised Learningcited by 21
- 2022Joint Self-Supervised Image-Volume Representation Learning with Intra-Inter Contrastive Clusteringcited by 16
- 2021Initialization Using Perlin Noise for Training Networks with a Limited Amount of Datacited by 7
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 2.
6 papers.
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
- 2024Scaling Backwards: Minimal Synthetic Pre-training?cited by 14
- 2024Formula-Supervised Visual-Geometric Pre-trainingcited by 3
- 2025MoireDB: Formula-generated Interference-fringe Image Datasetcited by 0
- 2026Learning Generalizable 3D Medical Image Representations from Mask-Guided Self-Supervisioncited by 0
- 2026FDIF: Formula-Driven supervised Learning with Implicit Functions for 3D Medical Image Segmentationcited by 0
- 2026FDIF: Formula-Driven supervised Learning with Implicit Functions for 3D Medical Image Segmentation24 Mar 2026
- 2026Learning Generalizable 3D Medical Image Representations from Mask-Guided Self-Supervision14 Mar 2026
- 2025MoireDB: Formula-generated Interference-fringe Image Dataset3 Feb 2025
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesis4 Nov 2024
- 2024Formula-Supervised Visual-Geometric Pre-training20 Sep 2024
- 2024Scaling Backwards: Minimal Synthetic Pre-training?1 Aug 2024