mlsanityData to 7 Oct 2026

Biologically-inspired Semi-supervised Semantic Segmentation for Biomedical Imaging

arXiv 2412.03192 ↗First posted 4 Dec 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

We propose a novel bio-inspired semi-supervised learning approach for training downsampling-upsampling semantic segmentation architectures. The first stage does not use backpropagation. Rather, it exploits the Hebbian principle ``fire together, wire together'' as a local learning rule for updating the weights of both convolutional and transpose-convolutional layers, allowing unsupervised discovery of data features. In the second stage, the model is fine-tuned with standard backpropagation on a small subset of labeled data. We evaluate our methodology through experiments conducted on several widely used biomedical datasets, deeming that this domain is paramount in computer vision and is notably impacted by data scarcity. Results show that our proposed method outperforms SOTA approaches across different levels of label availability. Furthermore, we show that using our unsupervised stage to initialize the SOTA approaches leads to performance improvements. The code to replicate our experiments can be found at https://github.com/ciampluca/hebbian-bootstraping-semi-supervised-medical-imaging

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 46 of its 84 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

46 of 84 references.

References · 46

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  7. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  8. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  9. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  10. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  11. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
  12. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
34 more
  1. 2018ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentationcited by 623
  2. 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
  3. 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 462
  4. 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 454
  5. 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 378
  6. 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 375
  7. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
  8. 2021CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentationcited by 227
  9. 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 222
  10. 2020Semi-supervised Medical Image Segmentation through Dual-task Consistencycited by 215
  11. 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
  12. 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
  13. 2016A guide to convolution arithmetic for deep learningcited by 182
  14. 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
  15. 2020Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotationcited by 128
  16. 2019Enabling Spike-based Backpropagation for Training Deep Neural Network Architecturescited by 119
  17. 2018A Survey on Data Collection for Machine Learning: a Big Data -- AI Integration Perspectivecited by 111
  18. 2022Hebbian Deep Learning Without Feedbackcited by 61
  19. 2021Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentationcited by 54
  20. 2019Fast and energy-efficient neuromorphic deep learning with first-spike timescited by 52
  21. 2019Temporal-Coded Deep Spiking Neural Network with Easy Training and Robust Performancecited by 45
  22. 2018Unsupervised Learning by Competing Hidden Unitscited by 44
  23. 2020KiU-Net: Overcomplete Convolutional Architectures for Biomedical Image and Volumetric Segmentationcited by 32
  24. 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 29
  25. 2020COVID-19 Infection Map Generation and Detection from Chest X-Ray Imagescited by 28
  26. 2015A Hebbian/Anti-Hebbian Neural Network for Linear Subspace Learning: A Derivation from Multidimensional Scaling of Streaming Datacited by 26
  27. 2019People infer recursive visual concepts from just a few examplescited by 23
  28. 2021Hebbian Semi-Supervised Learning in a Sample Efficiency Settingcited by 19
  29. 2016Augmenting Supervised Neural Networks with Unsupervised Objectives for Large-scale Image Classificationcited by 18
  30. 2022FastHebb: Scaling Hebbian Training of Deep Neural Networks to ImageNet Levelcited by 11
  31. 2022MFSNet: A Multi Focus Segmentation Network for Skin Lesion Segmentationcited by 10
  32. 2021Highlighting the Importance of Reducing Research Bias and Carbon Emissions in CNNscited by 9
  33. 2022Is Bio-Inspired Learning Better than Backprop? Benchmarking Bio Learning vs. Backpropcited by 9
  34. 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Surveycited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.