Self-mentoring: a new deep learning pipeline to train a self-supervised U-net for few-shot learning of bio-artificial capsule segmentation
Not on the map. Why?
Abstract (arXiv)
Background: Accurate segmentation of microscopic structures such as bio-artificial capsules in microscopy imaging is a prerequisite to the computer-aided understanding of important biomechanical phenomenons. State-of-the-art segmentation performances are achieved by deep neural networks and related data-driven approaches. Training these networks from only a few annotated examples is challenging while producing manually annotated images that provide supervision is tedious. Method: Recently, self-supervision, i.e. designing a neural pipeline providing synthetic or indirect supervision, has proved to significantly increase generalization performances of models trained on few shots. The objective of this paper is to introduce one such neural pipeline in the context of micro-capsule image segmentation. Our method leverages the rather simple content of these images so that a trainee network can be mentored by a referee network which has been previously trained on synthetically generated pairs of corrupted/correct region masks. Results: Challenging experimental setups are investigated. They involve from only 3 to 10 annotated images along with moderately large amounts of unannotated images. In a bio-artificial capsule dataset, our approach consistently and drastically improves accuracy. We also show that the learnt referee network is transferable to another Glioblastoma cell dataset and that it can be efficiently coupled with data augmentation strategies. Conclusions: Experimental results show that very significant accuracy increments are obtained by the proposed pipeline, leading to the conclusion that the self-supervision mechanism introduced in this paper has the potential to replace human annotations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 52 references that are in the map. First posted on arXiv 22 May 2022.
Builds on
18 of 52 references.
References · 18
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Mask R-CNNcited by 7,277
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 437
6 more
- 2020Meta Pseudo Labelscited by 374
- 2016One-Shot Video Object Segmentationcited by 235
- 2020BoxInst: High-Performance Instance Segmentation with Box Annotationscited by 151
- 2017Meta-Learning and Universality: Deep Representations and Gradient Descent can Approximate any Learning Algorithmcited by 65
- 2020Few-Shot Microscopy Image Cell Segmentationcited by 11
- 2022Fully Self-Supervised Learning for Semantic Segmentationcited by 11
Built on by
Not cited yet.