mlsanityData to 14 Oct 2026

SpikeCLR: Contrastive Self-Supervised Learning for Few-Shot Event-Based Vision using Spiking Neural Networks

arXiv 2603.16338 ↗First posted 17 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Event-based vision sensors provide significant advantages for high-speed perception, including microsecond temporal resolution, high dynamic range, and low power consumption. When combined with Spiking Neural Networks (SNNs), they can be deployed on neuromorphic hardware, enabling energy-efficient applications on embedded systems. However, this potential is severely limited by the scarcity of large-scale labeled datasets required to effectively train such models. In this work, we introduce SpikeCLR, a contrastive self-supervised learning framework that enables SNNs to learn robust visual representations from unlabeled event data. We adapt prior frame-based methods to the spiking domain using surrogate gradient training and introduce a suite of event-specific augmentations that leverage spatial, temporal, and polarity transformations. Through extensive experiments on CIFAR10-DVS, N-Caltech101, N-MNIST, and DVS-Gesture benchmarks, we demonstrate that self-supervised pretraining with subsequent fine-tuning outperforms supervised learning in low-data regimes, achieving consistent gains in few-shot and semi-supervised settings. Our ablation studies reveal that combining spatial and temporal augmentations is critical for learning effective spatio-temporal invariances in event data. We further show that learned representations transfer across datasets, contributing to efforts for powerful event-based models in label-scarce settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

27 of 43 references.

References · 27

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  3. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  4. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  5. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  6. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  7. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
  8. 2019Event-based Vision: A Surveycited by 1,016
  9. 2020What Makes for Good Views for Contrastive Learning?cited by 846
  10. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  11. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
  12. 2021Deep Residual Learning in Spiking Neural Networkscited by 331
15 more
  1. 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
  2. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
  3. 2018Deep Learning in Spiking Neural Networkscited by 263
  4. 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 218
  5. 2016Training Deep Spiking Neural Networks using Backpropagationcited by 205
  6. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
  7. 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 198
  8. 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
  9. 2022VICRegL: Self-Supervised Learning of Local Visual Featurescited by 118
  10. 2020Contrastive Learning with Adversarial Examplescited by 91
  11. 2022Neuromorphic Data Augmentation for Training Spiking Neural Networkscited by 52
  12. 2023Event Camera Data Pre-trainingcited by 50
  13. 2022Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded Viewscited by 37
  14. 2021EventDrop: data augmentation for event-based learningcited by 28
  15. 2024Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methodscited by 25

Built on by

Not cited yet.