Self-supervised Tumor Segmentation through Layer Decomposition
Not on the map. Why?
Abstract (arXiv)
In this paper, we target self-supervised representation learning for zero-shot tumor segmentation. We make the following contributions: First, we advocate a zero-shot setting, where models from pre-training should be directly applicable for the downstream task, without using any manual annotations. Second, we take inspiration from "layer-decomposition", and innovate on the training regime with simulated tumor data. Third, we conduct extensive ablation studies to analyse the critical components in data simulation, and validate the necessity of different proxy tasks. We demonstrate that, with sufficient texture randomization in simulation, model trained on synthetic data can effortlessly generalise to segment real tumor data. Forth, our approach achieves superior results for zero-shot tumor segmentation on different downstream datasets, BraTS2018 for brain tumor segmentation and LiTS2017 for liver tumor segmentation. While evaluating the model transferability for tumor segmentation under a low-annotation regime, the proposed approach also outperforms all existing self-supervised approaches, opening up the usage of self-supervised learning in practical scenarios.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 52 of its 80 references that are in the map. First posted on arXiv 7 Sep 2021.
Builds on
52 of 80 references.
References · 52
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Neural Discrete Representation Learningcited by 4,650
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
38 more
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
- 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
- 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
- 2018Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysiscited by 178
- 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
- 2015DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentationcited by 158
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2020Autoencoders for Unsupervised Anomaly Segmentation in Brain MR Images: A Comparative Studycited by 146
- 20203D Self-Supervised Methods for Medical Imagingcited by 134
- 2018"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priorscited by 114
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2018Layer-structured 3D Scene Inference via View Synthesiscited by 82
- 2019Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik's Cubecited by 76
- 2019Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Predictioncited by 70
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
- 2019Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentationcited by 55
- 2020Layered Neural Rendering for Retiming People in Videocited by 51
- 2021Omnimatte: Associating Objects and Their Effects in Videocited by 50
- 2021Detecting Outliers with Poisson Image Interpolationcited by 44
- 2020PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentationcited by 36
- 2019Modified U-Net (mU-Net) with Incorporation of Object-Dependent High Level Features for Improved Liver and Liver-Tumor Segmentation in CT Imagescited by 28
- 2018A Two-Stream Mutual Attention Network for Semi-supervised Biomedical Segmentation with Noisy Labelscited by 26
- 2018The Visual Centrifuge: Model-Free Layered Video Representationscited by 23
- 2019Self-Supervised Similarity Learning for Digital Pathologycited by 22
- 2021Implicit field learning for unsupervised anomaly detection in medical imagescited by 17
- 2021ASC-Net : Adversarial-based Selective Network for Unsupervised Anomaly Segmentationcited by 15
- 2021Sli2Vol: Annotate a 3D Volume from a Single Slice with Self-Supervised Learningcited by 15
- 2018Crossbar-Net: A Novel Convolutional Network for Kidney Tumor Segmentation in CT Imagescited by 14
- 2020Self-supervised Depth Estimation to Regularise Semantic Segmentation in Knee Arthroscopycited by 9
- 2020SAR: Scale-Aware Restoration Learning for 3D Tumor Segmentationcited by 8
- 2021A self-supervised learning strategy for postoperative brain cavity segmentation simulating resectionscited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 0; 2025: 1.
4 papers.
- 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 110
- 2025Self-Supervised Learning for Image Segmentation: A Comprehensive Surveycited by 3
- 2021ASC-Net: Unsupervised Medical Anomaly Segmentation Using an Adversarial-based Selective Cutting Networkcited by 1
- 2023Unsupervised Brain Tumor Segmentation with Image-based Promptscited by 1
- 2025Self-Supervised Learning for Image Segmentation: A Comprehensive Survey19 May 2025
- 2023Unsupervised Brain Tumor Segmentation with Image-based Prompts4 Apr 2023
- 2022LViT: Language meets Vision Transformer in Medical Image Segmentation29 Jun 2022
- 2021ASC-Net: Unsupervised Medical Anomaly Segmentation Using an Adversarial-based Selective Cutting Network16 Dec 2021