mlsanityData to 14 Oct 2026

Automotive Object Detection via Learning Sparse Events by Spiking Neurons

arXiv 2307.12900 ↗First posted 24 Jul 2023cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Event-based sensors, distinguished by their high temporal resolution of 1 μs and a dynamic range of 120 dB, stand out as ideal tools for deployment in fast-paced settings like vehicles and drones. Traditional object detection techniques that utilize Artificial Neural Networks (ANNs) face challenges due to the sparse and asynchronous nature of the events these sensors capture. In contrast, Spiking Neural Networks (SNNs) offer a promising alternative, providing a temporal representation that is inherently aligned with event-based data. This paper explores the unique membrane potential dynamics of SNNs and their ability to modulate sparse events. We introduce an innovative spike-triggered adaptive threshold mechanism designed for stable training. Building on these insights, we present a specialized spiking feature pyramid network (SpikeFPN) optimized for automotive event-based object detection. Comprehensive evaluations demonstrate that SpikeFPN surpasses both traditional SNNs and advanced ANNs enhanced with attention mechanisms. Evidently, SpikeFPN achieves a mean Average Precision (mAP) of 0.477 on the GEN1 Automotive Detection (GAD) benchmark dataset, marking significant increases over the selected SNN baselines. Moreover, the efficient design of SpikeFPN ensures robust performance while optimizing computational resources, attributed to its innate sparse computation capabilities. Source codes are publicly accessible at https://github.com/EMI-Group/spikefpn.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 62 of its 102 references that are in the map. First posted on arXiv 24 Jul 2023.

Builds on

62 of 102 references.

References · 62

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2017Mask R-CNNcited by 7,277
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  7. 2015SSD: Single Shot MultiBox Detectorcited by 3,130
  8. 2018YOLOv3: An Incremental Improvementcited by 2,659
  9. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
  10. 2016YOLO9000: Better, Faster, Strongercited by 1,431
  11. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
  12. 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
38 more
  1. 2018Path Aggregation Network for Instance Segmentationcited by 798
  2. 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 720
  3. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  4. 2019Object Detection in 20 Years: A Surveycited by 531
  5. 2018Object Detection with Deep Learning: A Reviewcited by 528
  6. 2018Deep Learning for Generic Object Detection: A Surveycited by 392
  7. 2021Deep Residual Learning in Spiking Neural Networkscited by 331
  8. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
  9. 2019NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detectioncited by 291
  10. 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 278
  11. 2018SLAYER: Spike Layer Error Reassignment in Timecited by 266
  12. 2019M3D-RPN: Monocular 3D Region Proposal Network for Object Detectioncited by 252
  13. 2018Going Deeper in Spiking Neural Networks: VGG and Residual Architecturescited by 245
  14. 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 233
  15. 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
  16. 2020DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolutioncited by 222
  17. 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 218
  18. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
  19. 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 198
  20. 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
  21. 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 182
  22. 2018Long short-term memory and learning-to-learn in networks of spiking neuronscited by 181
  23. 2019Spiking-YOLO: Spiking Neural Network for Energy-Efficient Object Detectioncited by 177
  24. 2023Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networkscited by 122
  25. 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 117
  26. 2020A Large Scale Event-based Detection Dataset for Automotivecited by 109
  27. 2020Event-based Asynchronous Sparse Convolutional Networkscited by 104
  28. 2020Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networkscited by 100
  29. 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
  30. 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
  31. 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
  32. 2022Object Detection with Spiking Neural Networks on Automotive Event Datacited by 80
  33. 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 78
  34. 2019Learning Spatial Fusion for Single-Shot Object Detectioncited by 59
  35. 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 59
  36. 2021Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentationcited by 55
  37. 2015HFirst: A Temporal Approach to Object Recognitioncited by 50
  38. 2020Effective Fusion Factor in FPN for Tiny Object Detectioncited by 44

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 2.

5 papers.