Biologically-inspired Semi-supervised Semantic Segmentation for Biomedical Imaging
Not on the map. Why?
Abstract (arXiv)
We propose a novel bio-inspired semi-supervised learning approach for training downsampling-upsampling semantic segmentation architectures. The first stage does not use backpropagation. Rather, it exploits the Hebbian principle ``fire together, wire together'' as a local learning rule for updating the weights of both convolutional and transpose-convolutional layers, allowing unsupervised discovery of data features. In the second stage, the model is fine-tuned with standard backpropagation on a small subset of labeled data. We evaluate our methodology through experiments conducted on several widely used biomedical datasets, deeming that this domain is paramount in computer vision and is notably impacted by data scarcity. Results show that our proposed method outperforms SOTA approaches across different levels of label availability. Furthermore, we show that using our unsupervised stage to initialize the SOTA approaches leads to performance improvements. The code to replicate our experiments can be found at https://github.com/ciampluca/hebbian-bootstraping-semi-supervised-medical-imaging
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 46 of its 84 references that are in the map. First posted on arXiv 4 Dec 2024.
Builds on
46 of 84 references.
References · 46
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
34 more
- 2018ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentationcited by 623
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 462
- 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 454
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 378
- 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 375
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
- 2021CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentationcited by 227
- 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 222
- 2020Semi-supervised Medical Image Segmentation through Dual-task Consistencycited by 215
- 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2016A guide to convolution arithmetic for deep learningcited by 182
- 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
- 2020Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotationcited by 128
- 2019Enabling Spike-based Backpropagation for Training Deep Neural Network Architecturescited by 119
- 2018A Survey on Data Collection for Machine Learning: a Big Data -- AI Integration Perspectivecited by 111
- 2022Hebbian Deep Learning Without Feedbackcited by 61
- 2021Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentationcited by 54
- 2019Fast and energy-efficient neuromorphic deep learning with first-spike timescited by 52
- 2019Temporal-Coded Deep Spiking Neural Network with Easy Training and Robust Performancecited by 45
- 2018Unsupervised Learning by Competing Hidden Unitscited by 44
- 2020KiU-Net: Overcomplete Convolutional Architectures for Biomedical Image and Volumetric Segmentationcited by 32
- 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 29
- 2020COVID-19 Infection Map Generation and Detection from Chest X-Ray Imagescited by 28
- 2015A Hebbian/Anti-Hebbian Neural Network for Linear Subspace Learning: A Derivation from Multidimensional Scaling of Streaming Datacited by 26
- 2019People infer recursive visual concepts from just a few examplescited by 23
- 2021Hebbian Semi-Supervised Learning in a Sample Efficiency Settingcited by 19
- 2016Augmenting Supervised Neural Networks with Unsupervised Objectives for Large-scale Image Classificationcited by 18
- 2022FastHebb: Scaling Hebbian Training of Deep Neural Networks to ImageNet Levelcited by 11
- 2022MFSNet: A Multi Focus Segmentation Network for Skin Lesion Segmentationcited by 10
- 2021Highlighting the Importance of Reducing Research Bias and Carbon Emissions in CNNscited by 9
- 2022Is Bio-Inspired Learning Better than Backprop? Benchmarking Bio Learning vs. Backpropcited by 9
- 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Surveycited by 7
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025From Neurons to Computation: Biological Reservoir Computing for Pattern Recognitioncited by 2
- 2025From Neural Activity to Computation: Biological Reservoirs for Pattern Recognition in Digit Classificationcited by 1
- 2026Neuro-Inspired Visual Pattern Recognition via Biological Reservoir Computingcited by 1
- 2025Semi-Supervised Biomedical Image Segmentation via Diffusion Models and Teacher-Student Co-Trainingcited by 0
- 2026Neuro-Inspired Visual Pattern Recognition via Biological Reservoir Computing5 Feb 2026
- 2025From Neural Activity to Computation: Biological Reservoirs for Pattern Recognition in Digit Classification7 Oct 2025
- 2025From Neurons to Computation: Biological Reservoir Computing for Pattern Recognition6 May 2025
- 2025Semi-Supervised Biomedical Image Segmentation via Diffusion Models and Teacher-Student Co-Training2 Apr 2025