Object Detection with Spiking Neural Networks on Automotive Event Data
Not on the map. Why?
Abstract (arXiv)
Automotive embedded algorithms have very high constraints in terms of latency, accuracy and power consumption. In this work, we propose to train spiking neural networks (SNNs) directly on data coming from event cameras to design fast and efficient automotive embedded applications. Indeed, SNNs are more biologically realistic neural networks where neurons communicate using discrete and asynchronous spikes, a naturally energy-efficient and hardware friendly operating mode. Event data, which are binary and sparse in space and time, are therefore the ideal input for spiking neural networks. But to date, their performance was insufficient for automotive real-world problems, such as detecting complex objects in an uncontrolled environment. To address this issue, we took advantage of the latest advancements in matter of spike backpropagation - surrogate gradient learning, parametric LIF, SpikingJelly framework - and of our new textitvoxel cube event encoding to train 4 different SNNs based on popular deep learning networks: SqueezeNet, VGG, MobileNet, and DenseNet. As a result, we managed to increase the size and the complexity of SNNs usually considered in the literature. In this paper, we conducted experiments on two automotive event datasets, establishing new state-of-the-art classification results for spiking neural networks. Based on these results, we combined our SNNs with SSD to propose the first spiking neural networks capable of performing object detection on the complex GEN1 Automotive Detection event dataset.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 9 May 2022.
Builds on
22 of 35 references.
References · 22
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
- 2021Deep Residual Learning in Spiking Neural Networkscited by 326
- 2018SLAYER: Spike Layer Error Reassignment in Timecited by 257
- 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 215
- 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 197
10 more
- 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 184
- 2019Spiking-YOLO: Spiking Neural Network for Energy-Efficient Object Detectioncited by 174
- 2020A Large Scale Event-based Detection Dataset for Automotivecited by 108
- 2020Event-based Asynchronous Sparse Convolutional Networkscited by 103
- 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 90
- 2018Asynchronous Convolutional Networks for Object Detection in Neuromorphic Camerascited by 57
- 2021Learning from Event Cameras with Sparse Spiking Convolutional Neural Networkscited by 25
- 2021Hybrid SNN-ANN: Energy-Efficient Classification and Object Detection for Event-Based Visioncited by 22
- 2020Low-activity supervised convolutional spiking neural networks applied to speech commands recognitioncited by 19
- 2019Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligencecited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 17; 2024: 27; 2025: 18; 2026: 15.
79 papers.
Sort:
By area:
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 163
- 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 158
- 2023SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networkscited by 82
- 2023Deep Directly-Trained Spiking Neural Networks for Object Detectioncited by 76
- 2024State Space Models for Event Camerascited by 75
- 2023GET: Group Event Transformer for Event-Based Visioncited by 73
- 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
- 2024Scene Adaptive Sparse Transformer for Event-based Object Detectioncited by 39
- 2023Optical flow estimation from event-based cameras and spiking neural networkscited by 33
- 2022Pushing the Limits of Asynchronous Graph-based Object Detection with Event Camerascited by 32
- 2023Direct Learning-Based Deep Spiking Neural Networks: A Reviewcited by 31
- 2023LEOD: Label-Efficient Object Detection for Event Camerascited by 24
38 more
- 2024SFOD: Spiking Fusion Object Detectorcited by 19
- 2024EAS-SNN: End-to-End Adaptive Sampling and Representation for Event-based Detection with Recurrent Spiking Neural Networkscited by 16
- 2024Neuromorphic Drone Detection: an Event-RGB Multimodal Approachcited by 14
- 2025Event-based Tiny Object Detection: A Benchmark Dataset and Baselinecited by 14
- 2024SpikeNAS: A Fast Memory-Aware Neural Architecture Search Framework for Spiking Neural Network-based Embedded AI Systemscited by 12
- 2023Spiking-Fer: Spiking Neural Network for Facial Expression Recognition With Event Camerascited by 10
- 2023To Spike or Not To Spike: A Digital Hardware Perspective on Deep Learning Accelerationcited by 10
- 2024FlexEvent: Towards Flexible Event-Frame Object Detection at Varying Operational Frequenciescited by 10
- 2024A Recurrent YOLOv8-based framework for Event-Based Object Detectioncited by 9
- 2024EvRT-DETR: Latent Space Adaptation of Image Detectors for Event-based Visioncited by 9
- 2025Differential Coding for Training-Free ANN-to-SNN Conversioncited by 9
- 2024Spiking CenterNet: A Distillation-boosted Spiking Neural Network for Object Detectioncited by 8
- 2025Adaptive Event Stream Slicing for Open-Vocabulary Event-Based Object Detection via Vision-Language Knowledge Distillationcited by 8
- 2024EvSegSNN: Neuromorphic Semantic Segmentation for Event Datacited by 7
- 2024Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applicationscited by 7
- 2025Hybrid Spiking Vision Transformer for Object Detection with Event Camerascited by 7
- 2023SparseProp: Efficient Event-Based Simulation and Training of Sparse Recurrent Spiking Neural Networkscited by 6
- 2024ShapeAug: Occlusion Augmentation for Event Camera Datacited by 6
- 2023Automotive Object Detection via Learning Sparse Events by Spiking Neuronscited by 5
- 2024Optimising Graph Representation for Hardware Implementation of Graph Convolutional Networks for Event-based Visioncited by 5
- 2024Efficient Event-Based Object Detection: A Hybrid Neural Network with Spatial and Temporal Attentioncited by 5
- 2024MK-SGN: A Spiking Graph Convolutional Network with Multimodal Fusion and Knowledge Distillation for Skeleton-based Action Recognitioncited by 5
- 2025Event-Priori-Based Vision-Language Model for Efficient Visual Understandingcited by 5
- 2023NeuroCLIP: Neuromorphic Data Understanding by CLIP and SNNcited by 4
- 2024A Methodology to Study the Impact of Spiking Neural Network Parameters considering Event-Based Automotive Datacited by 4
- 2024SNN4Agents: A Framework for Developing Energy-Efficient Embodied Spiking Neural Networks for Autonomous Agentscited by 4
- 2024Deep Event-based Object Detection in Autonomous Driving: A Surveycited by 4
- 2024SpikeBottleNet: Spike-Driven Feature Compression Architecture for Edge-Cloud Co-Inferencecited by 3
- 2025Spiking monocular event based 6D pose estimation for space applicationcited by 3
- 2025Event2Vec: Processing Neuromorphic Events Directly by Representations in Vector Spacecited by 3
- 2025Sparse Convolutional Recurrent Learning for Efficient Event-based Neuromorphic Object Detectioncited by 3
- 2023NU-AIR -- A Neuromorphic Urban Aerial Dataset for Detection and Localization of Pedestrians and Vehiclescited by 2
- 2024SpiKernel: A Kernel Size Exploration Methodology for Improving Accuracy of the Embedded Spiking Neural Network Systemscited by 2
- 2024Pedestrian intention prediction in Adverse Weather Conditions with Spiking Neural Networks and Dynamic Vision Sensorscited by 2
- 2024Embedded event based object detection with spiking neural networkcited by 2
- 2024Towards Efficient Deployment of Hybrid SNNs on Neuromorphic and Edge AI Hardwarecited by 2
- 2024Enabling Energy-Efficient Simultaneous Multi-Task Reinforcement Learning through Spiking Neural Networks with Active Dendrites for Bio-inspired Generalist Agentscited by 2
- 2025EvDetMAV: Generalized MAV Detection from Moving Event Camerascited by 2
50 most cited of 79 All 79 (JSON)
- 2026PointEvent: Rethinking Event-based Tiny Object Detection via Serialized Motion Evidence Accumulation17 Sep 2026
- 2026Real-time Unsupervised Object Discovery from Asynchronous Event Streams27 Aug 2026
- 2026Sequence-SOD: Bio-inspired Sequence-aware Spiking ObjectDetection for Event Cameras29 Jul 2026
- 2026Neuromorphic Object Detection: An In-Depth Study and Future Directions26 Jul 2026
- 2026Robust PnP on a Neuromorphic Processor for Object Pose Estimation18 Jul 2026
- 2026ASUMOT: Motion-Consistency-Based Asynchronous UAV Detection and Tracking with Event Cameras13 Jul 2026
- 2026Following the Flow: Advection-Consistent Modeling for Event-based Small Object Detection21 Jun 2026
- 2026Neural Events: Discrete Asynchronous Autoencoders for Event-Based Vision18 Jun 2026
- 2026EventDrive: Event Cameras for Vision-Language Driving Intelligence16 Jun 2026
- 2026Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks24 May 2026
- 2026Frequency-domain Event-based Imaging for Selective Surveillance14 May 2026
- 2026AceleradorSNN: A Neuromorphic Cognitive System Integrating Spiking Neural Networks and DynamicImage Signal Processing on FPGA30 Mar 2026
38 more
- 2026SparseVoxelDet: Fully Sparse Voxel Networks for Efficient Event-Based Drone Detection23 Mar 2026
- 2026Sensor Generalization for Adaptive Sensing in Event-based Object Detection via Joint Distribution Training26 Feb 2026
- 2026SynSacc: A Blender-to-V2E Pipeline for Synthetic Neuromorphic Eye-Movement Data and Sim-to-Real Spiking Model Training9 Feb 2026
- 2025Adaptive Event Stream Slicing for Open-Vocabulary Event-Based Object Detection via Vision-Language Knowledge Distillation1 Oct 2025
- 2025Context-aware Sparse Spatiotemporal Learning for Event-based Vision27 Aug 2025
- 2025Event-based Graph Representation with Spatial and Motion Vectors for Asynchronous Object Detection20 Jul 2025
- 2025Edge Intelligence with Spiking Neural Networks18 Jul 2025
- 2025Event-based Tiny Object Detection: A Benchmark Dataset and Baseline30 Jun 2025
- 2025EvDetMAV: Generalized MAV Detection from Moving Event Cameras24 Jun 2025
- 2025Sparse Convolutional Recurrent Learning for Efficient Event-based Neuromorphic Object Detection16 Jun 2025
- 2025Event-Priori-Based Vision-Language Model for Efficient Visual Understanding9 Jun 2025
- 2025Hybrid Spiking Vision Transformer for Object Detection with Event Cameras12 May 2025
- 2025Self-Supervised Event Representations: Towards Accurate, Real-Time Perception on SoC FPGAs12 May 2025
- 2025Threshold Modulation for Online Test-Time Adaptation of Spiking Neural Networks8 May 2025
- 2025EHGCN: Hierarchical Euclidean-Hyperbolic Fusion via Motion-Aware GCN for Hybrid Event Stream Perception23 Apr 2025
- 2025Event2Vec: Processing Neuromorphic Events Directly by Representations in Vector Space21 Apr 2025
- 2025Scalable Multi-Task Learning through Spiking Neural Networks with Adaptive Task-Switching Policy for Intelligent Autonomous Agents18 Apr 2025
- 2025Event-based Civil Infrastructure Visual Defect Detection: ev-CIVIL Dataset and Benchmark8 Apr 2025
- 2025Differential Coding for Training-Free ANN-to-SNN Conversion1 Mar 2025
- 2025Do Spikes Protect Privacy? Investigating Black-Box Model Inversion Attacks in Spiking Neural Networks8 Feb 2025
- 2025Spiking monocular event based 6D pose estimation for space application6 Jan 2025
- 2024Low-Latency Scalable Streaming for Event-Based Vision10 Dec 2024
- 2024FlexEvent: Towards Flexible Event-Frame Object Detection at Varying Operational Frequencies9 Dec 2024
- 2024Enabling Energy-Efficient Simultaneous Multi-Task Reinforcement Learning through Spiking Neural Networks with Active Dendrites for Bio-inspired Generalist Agents6 Dec 2024
- 2024EvRT-DETR: Latent Space Adaptation of Image Detectors for Event-based Vision3 Dec 2024
- 2024Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applications11 Oct 2024
- 2024SpikeBottleNet: Spike-Driven Feature Compression Architecture for Edge-Cloud Co-Inference11 Oct 2024
- 2024Neuromorphic Drone Detection: an Event-RGB Multimodal Approach24 Sep 2024
- 2024A Recurrent YOLOv8-based framework for Event-Based Object Detection9 Aug 2024
- 2024Towards Efficient Deployment of Hybrid SNNs on Neuromorphic and Edge AI Hardware11 Jul 2024
- 2024Embedded event based object detection with spiking neural network25 Jun 2024
- 2024EvSegSNN: Neuromorphic Semantic Segmentation for Event Data20 Jun 2024
- 2024Pedestrian intention prediction in Adverse Weather Conditions with Spiking Neural Networks and Dynamic Vision Sensors1 Jun 2024
- 2024Deep Event-based Object Detection in Autonomous Driving: A Survey7 May 2024
- 2024MK-SGN: A Spiking Graph Convolutional Network with Multimodal Fusion and Knowledge Distillation for Skeleton-based Action Recognition16 Apr 2024
- 2024SNN4Agents: A Framework for Developing Energy-Efficient Embodied Spiking Neural Networks for Autonomous Agents14 Apr 2024
- 2024A Methodology to Study the Impact of Spiking Neural Network Parameters considering Event-Based Automotive Data4 Apr 2024
- 2024Scene Adaptive Sparse Transformer for Event-based Object Detection2 Apr 2024
50 newest of 79 All 79 (JSON)
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 163
- 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 158
- 2023SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networkscited by 82
- 2023Deep Directly-Trained Spiking Neural Networks for Object Detectioncited by 76
- 2024State Space Models for Event Camerascited by 75
- 2023GET: Group Event Transformer for Event-Based Visioncited by 73
- 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
- 2024Scene Adaptive Sparse Transformer for Event-based Object Detectioncited by 39
- 2023Optical flow estimation from event-based cameras and spiking neural networkscited by 33
- 2022Pushing the Limits of Asynchronous Graph-based Object Detection with Event Camerascited by 32
- 2023Direct Learning-Based Deep Spiking Neural Networks: A Reviewcited by 31
- 2023LEOD: Label-Efficient Object Detection for Event Camerascited by 24
12 most cited of 77 All 77 (JSON)
- 2026PointEvent: Rethinking Event-based Tiny Object Detection via Serialized Motion Evidence Accumulation17 Sep 2026
- 2026Real-time Unsupervised Object Discovery from Asynchronous Event Streams27 Aug 2026
- 2026Sequence-SOD: Bio-inspired Sequence-aware Spiking ObjectDetection for Event Cameras29 Jul 2026
- 2026Neuromorphic Object Detection: An In-Depth Study and Future Directions26 Jul 2026
- 2026Robust PnP on a Neuromorphic Processor for Object Pose Estimation18 Jul 2026
- 2026ASUMOT: Motion-Consistency-Based Asynchronous UAV Detection and Tracking with Event Cameras13 Jul 2026
- 2026Following the Flow: Advection-Consistent Modeling for Event-based Small Object Detection21 Jun 2026
- 2026Neural Events: Discrete Asynchronous Autoencoders for Event-Based Vision18 Jun 2026
- 2026Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks24 May 2026
- 2026Frequency-domain Event-based Imaging for Selective Surveillance14 May 2026
- 2026AceleradorSNN: A Neuromorphic Cognitive System Integrating Spiking Neural Networks and DynamicImage Signal Processing on FPGA30 Mar 2026
- 2026SparseVoxelDet: Fully Sparse Voxel Networks for Efficient Event-Based Drone Detection23 Mar 2026
12 newest of 77 All 77 (JSON)