Automotive Object Detection via Learning Sparse Events by Spiking Neurons
Not on the map. Why?
Abstract (arXiv)
Event-based sensors, distinguished by their high temporal resolution of 1 μs and a dynamic range of 120 dB, stand out as ideal tools for deployment in fast-paced settings like vehicles and drones. Traditional object detection techniques that utilize Artificial Neural Networks (ANNs) face challenges due to the sparse and asynchronous nature of the events these sensors capture. In contrast, Spiking Neural Networks (SNNs) offer a promising alternative, providing a temporal representation that is inherently aligned with event-based data. This paper explores the unique membrane potential dynamics of SNNs and their ability to modulate sparse events. We introduce an innovative spike-triggered adaptive threshold mechanism designed for stable training. Building on these insights, we present a specialized spiking feature pyramid network (SpikeFPN) optimized for automotive event-based object detection. Comprehensive evaluations demonstrate that SpikeFPN surpasses both traditional SNNs and advanced ANNs enhanced with attention mechanisms. Evidently, SpikeFPN achieves a mean Average Precision (mAP) of 0.477 on the GEN1 Automotive Detection (GAD) benchmark dataset, marking significant increases over the selected SNN baselines. Moreover, the efficient design of SpikeFPN ensures robust performance while optimizing computational resources, attributed to its innate sparse computation capabilities. Source codes are publicly accessible at https://github.com/EMI-Group/spikefpn.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 62 of its 102 references that are in the map. First posted on arXiv 24 Jul 2023.
Builds on
62 of 102 references.
References · 62
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2022Generative Adversarial Networkscited by 5,627
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2016YOLO9000: Better, Faster, Strongercited by 1,431
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
38 more
- 2018Path Aggregation Network for Instance Segmentationcited by 798
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 720
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
- 2019Object Detection in 20 Years: A Surveycited by 531
- 2018Object Detection with Deep Learning: A Reviewcited by 528
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2021Deep Residual Learning in Spiking Neural Networkscited by 331
- 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
- 2019NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detectioncited by 291
- 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 278
- 2018SLAYER: Spike Layer Error Reassignment in Timecited by 266
- 2019M3D-RPN: Monocular 3D Region Proposal Network for Object Detectioncited by 252
- 2018Going Deeper in Spiking Neural Networks: VGG and Residual Architecturescited by 245
- 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 233
- 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
- 2020DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolutioncited by 222
- 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 218
- 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 198
- 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
- 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 182
- 2018Long short-term memory and learning-to-learn in networks of spiking neuronscited by 181
- 2019Spiking-YOLO: Spiking Neural Network for Energy-Efficient Object Detectioncited by 177
- 2023Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networkscited by 122
- 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 117
- 2020A Large Scale Event-based Detection Dataset for Automotivecited by 109
- 2020Event-based Asynchronous Sparse Convolutional Networkscited by 104
- 2020Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networkscited by 100
- 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
- 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
- 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
- 2022Object Detection with Spiking Neural Networks on Automotive Event Datacited by 80
- 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 78
- 2019Learning Spatial Fusion for Single-Shot Object Detectioncited by 59
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 59
- 2021Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentationcited by 55
- 2015HFirst: A Temporal Approach to Object Recognitioncited by 50
- 2020Effective Fusion Factor in FPN for Tiny Object Detectioncited by 44
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 2.
5 papers.
- 2025Hybrid Spiking Vision Transformer for Object Detection with Event Camerascited by 7
- 2024Efficient Event-Based Object Detection: A Hybrid Neural Network with Spatial and Temporal Attentioncited by 6
- 2024PowerYOLO: Mixed Precision Model for Hardware Efficient Object Detection with Event Datacited by 2
- 2026Neuromorphic Object Detection: An In-Depth Study and Future Directionscited by 0
- 2026Sequence-SOD: Bio-inspired Sequence-aware Spiking ObjectDetection for Event Camerascited by 0
- 2026Sequence-SOD: Bio-inspired Sequence-aware Spiking ObjectDetection for Event Cameras29 Jul 2026
- 2026Neuromorphic Object Detection: An In-Depth Study and Future Directions26 Jul 2026
- 2025Hybrid Spiking Vision Transformer for Object Detection with Event Cameras12 May 2025
- 2024PowerYOLO: Mixed Precision Model for Hardware Efficient Object Detection with Event Data11 Jul 2024
- 2024Efficient Event-Based Object Detection: A Hybrid Neural Network with Spatial and Temporal Attention15 Mar 2024