mlsanityData to 7 Oct 2026

Self-supervised Tumor Segmentation through Layer Decomposition

arXiv 2109.03230 ↗First posted 7 Sep 2021cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

In this paper, we target self-supervised representation learning for zero-shot tumor segmentation. We make the following contributions: First, we advocate a zero-shot setting, where models from pre-training should be directly applicable for the downstream task, without using any manual annotations. Second, we take inspiration from "layer-decomposition", and innovate on the training regime with simulated tumor data. Third, we conduct extensive ablation studies to analyse the critical components in data simulation, and validate the necessity of different proxy tasks. We demonstrate that, with sufficient texture randomization in simulation, model trained on synthetic data can effortlessly generalise to segment real tumor data. Forth, our approach achieves superior results for zero-shot tumor segmentation on different downstream datasets, BraTS2018 for brain tumor segmentation and LiTS2017 for liver tumor segmentation. While evaluating the model transferability for tumor segmentation under a low-annotation regime, the proposed approach also outperforms all existing self-supervised approaches, opening up the usage of self-supervised learning in practical scenarios.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 52 of its 80 references that are in the map. First posted on arXiv 7 Sep 2021.

Builds on

52 of 80 references.

References · 52

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2017Neural Discrete Representation Learningcited by 4,650
  6. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  7. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  8. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  9. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  10. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  11. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  12. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
38 more
  1. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  2. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  3. 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
  4. 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
  5. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  6. 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
  7. 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
  8. 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
  9. 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
  10. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  11. 2018Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysiscited by 178
  12. 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
  13. 2015DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentationcited by 158
  14. 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
  15. 2020Autoencoders for Unsupervised Anomaly Segmentation in Brain MR Images: A Comparative Studycited by 146
  16. 20203D Self-Supervised Methods for Medical Imagingcited by 134
  17. 2018"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priorscited by 114
  18. 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
  19. 2018Layer-structured 3D Scene Inference via View Synthesiscited by 82
  20. 2019Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik's Cubecited by 76
  21. 2019Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Predictioncited by 70
  22. 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
  23. 2019Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentationcited by 55
  24. 2020Layered Neural Rendering for Retiming People in Videocited by 51
  25. 2021Omnimatte: Associating Objects and Their Effects in Videocited by 50
  26. 2021Detecting Outliers with Poisson Image Interpolationcited by 44
  27. 2020PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentationcited by 36
  28. 2019Modified U-Net (mU-Net) with Incorporation of Object-Dependent High Level Features for Improved Liver and Liver-Tumor Segmentation in CT Imagescited by 28
  29. 2018A Two-Stream Mutual Attention Network for Semi-supervised Biomedical Segmentation with Noisy Labelscited by 26
  30. 2018The Visual Centrifuge: Model-Free Layered Video Representationscited by 23
  31. 2019Self-Supervised Similarity Learning for Digital Pathologycited by 22
  32. 2021Implicit field learning for unsupervised anomaly detection in medical imagescited by 17
  33. 2021ASC-Net : Adversarial-based Selective Network for Unsupervised Anomaly Segmentationcited by 15
  34. 2021Sli2Vol: Annotate a 3D Volume from a Single Slice with Self-Supervised Learningcited by 15
  35. 2018Crossbar-Net: A Novel Convolutional Network for Kidney Tumor Segmentation in CT Imagescited by 14
  36. 2020Self-supervised Depth Estimation to Regularise Semantic Segmentation in Knee Arthroscopycited by 9
  37. 2020SAR: Scale-Aware Restoration Learning for 3D Tumor Segmentationcited by 8
  38. 2021A self-supervised learning strategy for postoperative brain cavity segmentation simulating resectionscited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 0; 2025: 1.

4 papers.