mlsanityData to 7 Oct 2026

Primitive Geometry Segment Pre-training for 3D Medical Image Segmentation

arXiv 2401.03665 ↗First posted 8 Jan 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

The construction of 3D medical image datasets presents several issues, including requiring significant financial costs in data collection and specialized expertise for annotation, as well as strict privacy concerns for patient confidentiality compared to natural image datasets. Therefore, it has become a pressing issue in 3D medical image segmentation to enable data-efficient learning with limited 3D medical data and supervision. A promising approach is pre-training, but improving its performance in 3D medical image segmentation is difficult due to the small size of existing 3D medical image datasets. We thus present the Primitive Geometry Segment Pre-training (PrimGeoSeg) method to enable the learning of 3D semantic features by pre-training segmentation tasks using only primitive geometric objects for 3D medical image segmentation. PrimGeoSeg performs more accurate and efficient 3D medical image segmentation without manual data collection and annotation. Further, experimental results show that PrimGeoSeg on SwinUNETR improves performance over learning from scratch on BTCV, MSD (Task06), and BraTS datasets by 3.7%, 4.4%, and 0.3%, respectively. Remarkably, the performance was equal to or better than state-of-the-art self-supervised learning despite the equal number of pre-training data. From experimental results, we conclude that effective pre-training can be achieved by looking at primitive geometric objects only. Code and dataset are available at https://github.com/SUPER-TADORY/PrimGeoSeg.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 8 Jan 2024.

Builds on

23 of 32 references.

References · 23

  1. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  2. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
  3. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  4. 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
  5. 2021The Medical Segmentation Decathloncited by 620
  6. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
  7. 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
  8. 2021Self-supervised Pretraining of Visual Features in the Wildcited by 197
  9. 20203D Self-Supervised Methods for Medical Imagingcited by 134
  10. 2021Pre-training without Natural Imagescited by 100
  11. 2018Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapycited by 76
  12. 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
11 more
  1. 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
  2. 2021Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse Contextscited by 59
  3. 2021UniMiSS: Universal Medical Self-Supervised Learning via Breaking Dimensionality Barriercited by 55
  4. 2021Momentum Contrastive Voxel-wise Representation Learning for Semi-supervised Volumetric Medical Image Segmentationcited by 49
  5. 2017NiftyNet: a deep-learning platform for medical imagingcited by 45
  6. 2022Self-supervised 3D anatomy segmentation using self-distilled masked image transformer (SMIT)cited by 35
  7. 2021Can Vision Transformers Learn without Natural Images?cited by 32
  8. 2021Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representationscited by 24
  9. 2022Pre-training Vision Transformers with Formula-driven Supervised Learningcited by 21
  10. 2022Joint Self-Supervised Image-Volume Representation Learning with Intra-Inter Contrastive Clusteringcited by 16
  11. 2021Initialization Using Perlin Noise for Training Networks with a Limited Amount of Datacited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 1; 2026: 2.

6 papers.