Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks
Not on the map. Why?
Abstract (arXiv)
Autonomous driving perception demands accurate and efficient processing of three-dimensional sensor data under strict power constraints. Traditional convolutional neural networks achieve strong detection accuracy but are computationally intensive, limiting their suitability for deployment on resource-constrained neuromorphic platforms. Spiking neural networks offer a compelling alternative through event-driven sparse computation, yet their application to complex real-world perception tasks such as three-dimensional object detection remains limited. In this work, we propose an end-to-end spiking encoder-decoder network for object detection in bird's eye view representations of LiDAR point clouds, trained using surrogate gradient backpropagation. We train two variants: a membrane potential variant that reads continuous neuron state at the output stage for maximum accuracy, achieving 92.05/87.04/86.51 AP at IoU!=!0.5 (Easy/Moderate/Hard), and, a fully binary spiking variant that operates exclusively on spike trains at every layer for direct neuromorphic deployment. We evaluate four input spike encoding strategies and demonstrate that allowing the network to learn spike representations directly from data outperforms hand-crafted Poisson, latency, and z-axis encoding schemes on the KITTI benchmark, where sequential frames are unavailable and the BEV input is presented repeatedly across timesteps as a proxy for temporal streaming. A block-wise energy analysis demonstrates a 3.33× reduction in synaptic operation energy over an equivalent CNN under conservative loop-based operation. Together, these results demonstrate the viability of spiking neural networks for accurate and energy-efficient neuromorphic perception in autonomous driving.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 67 references that are in the map. First posted on arXiv 24 May 2026.
Builds on
38 of 67 references.
References · 38
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2019Event-based Vision: A Surveycited by 1,010
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
26 more
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
- 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 399
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
- 2016Training Deep Spiking Neural Networks using Backpropagationcited by 203
- 2019Spiking-YOLO: Spiking Neural Network for Energy-Efficient Object Detectioncited by 174
- 2020Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systemscited by 100
- 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 90
- 2022Object Detection with Spiking Neural Networks on Automotive Event Datacited by 79
- 2023Deep Directly-Trained Spiking Neural Networks for Object Detectioncited by 76
- 2016Vote3Deep: Fast Object Detection in 3D Point Clouds Using Efficient Convolutional Neural Networkscited by 72
- 2023Spiking PointNet: Spiking Neural Networks for Point Cloudscited by 34
- 2024BEVCar: Camera-Radar Fusion for BEV Map and Object Segmentationcited by 27
- 2019Challenges in Designing Datasets and Validation for Autonomous Drivingcited by 23
- 2020BirdNet+: End-to-End 3D Object Detection in LiDAR Bird's Eye Viewcited by 19
- 2021LiMoSeg: Real-time Bird's Eye View based LiDAR Motion Segmentationcited by 15
- 2023Spiking Neural Network for Ultra-low-latency and High-accurate Object Detectioncited by 14
- 2024Autonomous Driving with Spiking Neural Networkscited by 12
- 2019Deep SCNN-based Real-time Object Detection for Self-driving Vehicles Using LiDAR Temporal Datacited by 8
- 2023LiDAR-BEVMTN: Real-Time LiDAR Bird's-Eye View Multi-Task Perception Network for Autonomous Drivingcited by 2
- 2025LiFT: Lightweight, FPGA-tailored 3D object detection based on LiDAR datacited by 2
- 2022SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Drivingcited by 1
Built on by
Not cited yet.