SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Spiking Neural Networks are a recent and new neural network design approach that promises tremendous improvements in power efficiency, computation efficiency, and processing latency. They do so by using asynchronous spike-based data flow, event-based signal generation, processing, and modifying the neuron model to resemble biological neurons closely. While some initial works have shown significant initial evidence of applicability to common deep learning tasks, their applications in complex real-world tasks has been relatively low. In this work, we first illustrate the applicability of spiking neural networks to a complex deep learning task namely Lidar based 3D object detection for automated driving. Secondly, we make a step-by-step demonstration of simulating spiking behavior using a pre-trained convolutional neural network. We closely model essential aspects of spiking neural networks in simulation and achieve equivalent run-time and accuracy on a GPU. When the model is realized on a neuromorphic hardware, we expect to have significantly improved power efficiency.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 64 references that are in the map. First posted on arXiv 6 Jun 2022.
Builds on
36 of 64 references.
References · 36
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2018SLAYER: Spike Layer Error Reassignment in Timecited by 266
- 2018Going Deeper in Spiking Neural Networks: VGG and Residual Architecturescited by 245
- 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 233
- 2016Training Deep Spiking Neural Networks using Backpropagationcited by 205
- 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 182
- 2019Spiking-YOLO: Spiking Neural Network for Energy-Efficient Object Detectioncited by 177
- 2020Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagationcited by 144
- 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
- 2016Supervised learning based on temporal coding in spiking neural networkscited by 76
- 2015Spiking Deep Networks with LIF Neuronscited by 63
24 more
- 2018Asynchronous Convolutional Networks for Object Detection in Neuromorphic Camerascited by 57
- 2021OmniDet: Surround View Cameras based Multi-task Visual Perception Network for Autonomous Drivingcited by 57
- 2021Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentationcited by 55
- 2018Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perceptioncited by 48
- 2020SynDistNet: Self-Supervised Monocular Fisheye Camera Distance Estimation Synergized with Semantic Segmentation for Autonomous Drivingcited by 48
- 2020Generalized Object Detection on Fisheye Cameras for Autonomous Driving: Dataset, Representations and Baselinecited by 42
- 2020Event-Based Angular Velocity Regression with Spiking Networkscited by 41
- 2019FisheyeDistanceNet: Self-Supervised Scale-Aware Distance Estimation using Monocular Fisheye Camera for Autonomous Drivingcited by 36
- 2018Fast and Efficient Information Transmission with Burst Spikes in Deep Spiking Neural Networkscited by 35
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2022SynWoodScape: Synthetic Surround-view Fisheye Camera Dataset for Autonomous Drivingcited by 32
- 2021SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround View Fisheye Camerascited by 25
- 2021Weather and Light Level Classification for Autonomous Driving: Dataset, Baseline and Active Learningcited by 20
- 2018Monocular Fisheye Camera Depth Estimation Using Sparse LiDAR Supervisioncited by 19
- 2019AuxNet: Auxiliary tasks enhanced Semantic Segmentation for Automated Drivingcited by 19
- 2019FisheyeMODNet: Moving Object detection on Surround-view Cameras for Autonomous Drivingcited by 18
- 2020TiledSoilingNet: Tile-level Soiling Detection on Automotive Surround-view Cameras Using Coverage Metriccited by 17
- 2021BEVDetNet: Bird's Eye View LiDAR Point Cloud based Real-time 3D Object Detection for Autonomous Drivingcited by 17
- 2022Detecting Adversarial Perturbations in Multi-Task Perceptioncited by 15
- 2021Adversarial Attacks on Multi-task Visual Perception for Autonomous Drivingcited by 14
- 2019Real-time Joint Object Detection and Semantic Segmentation Network for Automated Drivingcited by 12
- 2021An Online Learning System for Wireless Charging Alignment using Surround-view Fisheye Camerascited by 9
- 2021A Hybrid Sparse-Dense Monocular SLAM System for Autonomous Drivingcited by 8
- 2018Object Detection based on LIDAR Temporal Pulses using Spiking Neural Networkscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.