BT-Unet: A self-supervised learning framework for biomedical image segmentation using Barlow Twins with U-Net models
Not on the map. Why?
Abstract (arXiv)
Deep learning has brought the most profound contribution towards biomedical image segmentation to automate the process of delineation in medical imaging. To accomplish such task, the models are required to be trained using huge amount of annotated or labelled data that highlights the region of interest with a binary mask. However, efficient generation of the annotations for such huge data requires expert biomedical analysts and extensive manual effort. It is a tedious and expensive task, while also being vulnerable to human error. To address this problem, a self-supervised learning framework, BT-Unet is proposed that uses the Barlow Twins approach to pre-train the encoder of a U-Net model via redundancy reduction in an unsupervised manner to learn data representation. Later, complete network is fine-tuned to perform actual segmentation. The BT-Unet framework can be trained with a limited number of annotated samples while having high number of unannotated samples, which is mostly the case in real-world problems. This framework is validated over multiple U-Net models over diverse datasets by generating scenarios of a limited number of labelled samples using standard evaluation metrics. With exhaustive experiment trials, it is observed that the BT-Unet framework enhances the performance of the U-Net models with significant margin under such circumstances.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 27 of its 37 references that are in the map. First posted on arXiv 7 Dec 2021.
Builds on
27 of 37 references.
References · 27
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
15 more
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
- 2019Self-labelling via simultaneous clustering and representation learningcited by 528
- 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 368
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2020Medical Image Segmentation Using Deep Learning: A Surveycited by 164
- 2021Positional Contrastive Learning for Volumetric Medical Image Segmentationcited by 56
- 2017ISIC 2017 - Skin Lesion Analysis Towards Melanoma Detectioncited by 34
- 2021Modality specific U-Net variants for biomedical image segmentation: A surveycited by 20
- 2021Hierarchical Self-Supervised Learning for Medical Image Segmentation Based on Multi-Domain Data Aggregationcited by 18
- 2021RCA-IUnet: A residual cross-spatial attention guided inception U-Net model for tumor segmentation in breast ultrasound imagingcited by 13
- 2021Imbalance-Aware Self-Supervised Learning for 3D Radiomic Representationscited by 12
- 2021Self-Supervised Learning for Segmentationcited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 2; 2026: 2.
12 papers.
- 2024Multi-modal Vision Pre-training for Medical Image Analysiscited by 23
- 2023A Review of Predictive and Contrastive Self-supervised Learning for Medical Imagescited by 10
- 2024Dense Self-Supervised Learning for Medical Image Segmentationcited by 3
- 2024Devil is in Details: Locality-Aware 3D Abdominal CT Volume Generation for Self-Supervised Organ Segmentationcited by 3
- 2024Thyroid ultrasound diagnosis improvement via multi-view self-supervised learning and two-stage pre-trainingcited by 2
- 2024Resource Efficient Multi-stain Kidney Glomeruli Segmentation via Self-supervisioncited by 2
- 2023MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillationcited by 1
- 2023BTSeg: Barlow Twins Regularization for Domain Adaptation in Semantic Segmentationcited by 0
- 2025Deep Learning-Assisted Detection of Sarcopenia in Cross-Sectional Computed Tomography Imagingcited by 0
- 2025Barlow-Swin: Toward a novel siamese-based segmentation architecture using Swin-Transformerscited by 0
- 2026The ecosystem of machine learning competitions: Platforms, participants, and their impact on AI developmentcited by 0
- 2026Pix2Rep-v2: Data-Efficient Representation Learning for Dense Medical Imaging Applicationscited by 0
- 2026Pix2Rep-v2: Data-Efficient Representation Learning for Dense Medical Imaging Applications1 Sep 2026
- 2026The ecosystem of machine learning competitions: Platforms, participants, and their impact on AI development9 Apr 2026
- 2025Barlow-Swin: Toward a novel siamese-based segmentation architecture using Swin-Transformers8 Sep 2025
- 2025Deep Learning-Assisted Detection of Sarcopenia in Cross-Sectional Computed Tomography Imaging24 Aug 2025
- 2024Resource Efficient Multi-stain Kidney Glomeruli Segmentation via Self-supervision19 Dec 2024
- 2024Multi-modal Vision Pre-training for Medical Image Analysis14 Oct 2024
- 2024Devil is in Details: Locality-Aware 3D Abdominal CT Volume Generation for Self-Supervised Organ Segmentation30 Sep 2024
- 2024Dense Self-Supervised Learning for Medical Image Segmentation29 Jul 2024
- 2024Thyroid ultrasound diagnosis improvement via multi-view self-supervised learning and two-stage pre-training18 Feb 2024
- 2023BTSeg: Barlow Twins Regularization for Domain Adaptation in Semantic Segmentation31 Aug 2023
- 2023MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation21 Mar 2023
- 2023A Review of Predictive and Contrastive Self-supervised Learning for Medical Images10 Feb 2023