SS-3DCapsNet: Self-supervised 3D Capsule Networks for Medical Segmentation on Less Labeled Data
Not on the map. Why?
Abstract (arXiv)
Capsule network is a recent new deep network architecture that has been applied successfully for medical image segmentation tasks. This work extends capsule networks for volumetric medical image segmentation with self-supervised learning. To improve on the problem of weight initialization compared to previous capsule networks, we leverage self-supervised learning for capsule networks pre-training, where our pretext-task is optimized by self-reconstruction. Our capsule network, SS-3DCapsNet, has a UNet-based architecture with a 3D Capsule encoder and 3D CNNs decoder. Our experiments on multiple datasets including iSeg-2017, Hippocampus, and Cardiac demonstrate that our 3D capsule network with self-supervised pre-training considerably outperforms previous capsule networks and 3D-UNets.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 32 of its 50 references that are in the map. First posted on arXiv 15 Jan 2022.
Builds on
32 of 50 references.
References · 32
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2014Conditional Generative Adversarial Netscited by 2,152
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2016Colorful Image Colorizationcited by 1,113
- 2017Dynamic Routing Between Capsulescited by 689
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
20 more
- 2019Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentationcited by 258
- 2018Cooperative Learning of Audio and Video Models from Self-Supervised Synchronizationcited by 246
- 2020U-Net and its variants for medical image segmentation: theory and applicationscited by 169
- 2020Medical Image Segmentation Using Deep Learning: A Surveycited by 163
- 2016Learning Features by Watching Objects Movecited by 138
- 2016The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentationcited by 122
- 2019Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentationcited by 121
- 2017DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentationcited by 110
- 2018Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognitioncited by 40
- 2020Synthetic Learning: Learn From Distributed Asynchronized Discriminator GAN Without Sharing Medical Image Datacited by 38
- 2018Cross and Learn: Cross-Modal Self-Supervisioncited by 34
- 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
- 2018Capsules for Object Segmentationcited by 30
- 2020Capsules for Biomedical Image Segmentationcited by 18
- 2020Offset Curves Loss for Imbalanced Problem in Medical Segmentationcited by 11
- 2020A Multi-task Contextual Atrous Residual Network for Brain Tumor Detection & Segmentationcited by 9
- 2018Dilated Convolutions in Neural Networks for Left Atrial Segmentation in 3D Gadolinium Enhanced-MRIcited by 6
- 2018Deep Recurrent Level Set for Segmenting Brain Tumorscited by 6
- 2021DAM-AL: Dilated Attention Mechanism with Attention Loss for 3D Infant Brain Image Segmentationcited by 6
- 2020Flow-based Deformation Guidance for Unpaired Multi-Contrast MRI Image-to-Image Translationcited by 4
Built on by
Citing papers per year: 2022: 4; 2023: 2; 2024: 3; 2025: 1.
10 papers.
- 2023MEGANet: Multi-Scale Edge-Guided Attention Network for Weak Boundary Polyp Segmentationcited by 28
- 2022EmbryosFormer: Deformable Transformer and Collaborative Encoding-Decoding for Embryos Stage Development Classificationcited by 12
- 2024DynaSeg: A Deep Dynamic Fusion Method for Unsupervised Image Segmentation Incorporating Feature Similarity and Spatial Continuitycited by 4
- 20223DConvCaps: 3DUnet with Convolutional Capsule Encoder for Medical Image Segmentationcited by 3
- 2022Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learningcited by 3
- 2023A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Imagescited by 2
- 2024CarcassFormer: An End-to-end Transformer-based Framework for Simultaneous Localization, Segmentation and Classification of Poultry Carcass Defectcited by 1
- 2022CapsNet for Medical Image Segmentationcited by 0
- 20243D-EffiViTCaps: 3D Efficient Vision Transformer with Capsule for Medical Image Segmentationcited by 0
- 2025The Convergence of Dynamic Routing between Capsulescited by 0
- 2025The Convergence of Dynamic Routing between Capsules8 Jan 2025
- 2024DynaSeg: A Deep Dynamic Fusion Method for Unsupervised Image Segmentation Incorporating Feature Similarity and Spatial Continuity9 May 2024
- 2024CarcassFormer: An End-to-end Transformer-based Framework for Simultaneous Localization, Segmentation and Classification of Poultry Carcass Defect17 Apr 2024
- 20243D-EffiViTCaps: 3D Efficient Vision Transformer with Capsule for Medical Image Segmentation25 Mar 2024
- 2023MEGANet: Multi-Scale Edge-Guided Attention Network for Weak Boundary Polyp Segmentation6 Sep 2023
- 2023A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Images5 Sep 2023
- 2022EmbryosFormer: Deformable Transformer and Collaborative Encoding-Decoding for Embryos Stage Development Classification7 Oct 2022
- 2022Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learning30 Sep 2022
- 20223DConvCaps: 3DUnet with Convolutional Capsule Encoder for Medical Image Segmentation19 May 2022
- 2022CapsNet for Medical Image Segmentation16 Mar 2022