mlsanityData to 14 Oct 2026

Unsupervised spiking feature learning for event-based pedestrian crossing detection: approaching supervised accuracy without labelled training data

arXiv 2609.31671 ↗First posted 15 Sep 2026cs.CV cs.AI cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

Event cameras are well suited to pedestrian crossing detection, and spiking neural networks (SNNs) can process their output natively, but current SNN detectors are trained with supervised backpropagation and therefore require costly frame-level crossing labels. We investigate crossing detection with no labels in feature learning and report the first unsupervised results on the recent DVS-PedX pedestrian-crossing benchmark. A single spiking layer trained with winner-take-all spike-timing-dependent plasticity learns a dictionary from unlabelled event-frame patches; frames are encoded by cosine similarity to the learned filters with spatial pooling and read out by a linear classifier, the only supervised component. On the 24,454-frame test split the method attains 90.3% accuracy and an area under the receiver operating characteristic curve (AUROC) of 0.936, compared with 92.0% and 0.943 for a supervised spiking network trained end-to-end on the same frames; under adverse weather the AUROC is 0.913. The result is insensitive to the choice of plasticity rule but depends strongly on the readout protocol: with the classical neuron-assignment readout the same network attains only 0.70 AUROC. On the benchmark's real converted portion, a readout refit lifts performance from chance (0.53) to 0.67 AUROC, within the published supervised range. These findings indicate that the accuracy cost of removing labels from feature learning is small on this benchmark, and that reported weaknesses of unsupervised spiking networks may be attributable to the readout protocol rather than to the learning rule.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 53 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

18 of 53 references.

References · 18

  1. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  2. 2019Event-based Vision: A Surveycited by 1,016
  3. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  4. 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 406
  5. 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
  6. 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 218
  7. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
  8. 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
  9. 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
  10. 2020A Large Scale Event-based Detection Dataset for Automotivecited by 109
  11. 2018Autonomous Vehicles that Interact with Pedestrians: A Survey of Theory and Practicecited by 76
  12. 2018BindsNET: A machine learning-oriented spiking neural networks library in Pythoncited by 43
6 more
  1. 2017DART: Distribution Aware Retinal Transform for Event-based Camerascited by 40
  2. 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
  3. 2018Bio-inspired digit recognition using reward-modulated spike-timing-dependent plasticity in deep convolutional networkscited by 27
  4. 2025DVS-PedX: Synthetic-and-Real Event-Based Pedestrian Datasetcited by 4
  5. 2020Unsupervised Feature Learning for Event Data: Direct vs Inverse Problem Formulationcited by 3
  6. 2026Pedestrian Crossing Intent Classification From Event-Based Vision Using Convolutional Spiking Neural Networks With Temporal Augmentationcited by 1

Built on by

Not cited yet.