mlsanityData to 7 Oct 2026

Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks

arXiv 2605.25293 ↗First posted 24 May 2026cs.CV cs.AI cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Autonomous driving perception demands accurate and efficient processing of three-dimensional sensor data under strict power constraints. Traditional convolutional neural networks achieve strong detection accuracy but are computationally intensive, limiting their suitability for deployment on resource-constrained neuromorphic platforms. Spiking neural networks offer a compelling alternative through event-driven sparse computation, yet their application to complex real-world perception tasks such as three-dimensional object detection remains limited. In this work, we propose an end-to-end spiking encoder-decoder network for object detection in bird's eye view representations of LiDAR point clouds, trained using surrogate gradient backpropagation. We train two variants: a membrane potential variant that reads continuous neuron state at the output stage for maximum accuracy, achieving 92.05/87.04/86.51 AP at IoU!=!0.5 (Easy/Moderate/Hard), and, a fully binary spiking variant that operates exclusively on spike trains at every layer for direct neuromorphic deployment. We evaluate four input spike encoding strategies and demonstrate that allowing the network to learn spike representations directly from data outperforms hand-crafted Poisson, latency, and z-axis encoding schemes on the KITTI benchmark, where sequential frames are unavailable and the BEV input is presented repeatedly across timesteps as a proxy for temporal streaming. A block-wise energy analysis demonstrates a 3.33× reduction in synaptic operation energy over an equivalent CNN under conservative loop-based operation. Together, these results demonstrate the viability of spiking neural networks for accurate and energy-efficient neuromorphic perception in autonomous driving.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 67 references that are in the map. First posted on arXiv 24 May 2026.

Builds on

38 of 67 references.

References · 38

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  7. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  8. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  9. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  10. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  11. 2019Event-based Vision: A Surveycited by 1,010
  12. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
26 more
  1. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
  2. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
  3. 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
  4. 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
  5. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
  6. 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 399
  7. 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
  8. 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
  9. 2016Training Deep Spiking Neural Networks using Backpropagationcited by 203
  10. 2019Spiking-YOLO: Spiking Neural Network for Energy-Efficient Object Detectioncited by 174
  11. 2020Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systemscited by 100
  12. 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 90
  13. 2022Object Detection with Spiking Neural Networks on Automotive Event Datacited by 79
  14. 2023Deep Directly-Trained Spiking Neural Networks for Object Detectioncited by 76
  15. 2016Vote3Deep: Fast Object Detection in 3D Point Clouds Using Efficient Convolutional Neural Networkscited by 72
  16. 2023Spiking PointNet: Spiking Neural Networks for Point Cloudscited by 34
  17. 2024BEVCar: Camera-Radar Fusion for BEV Map and Object Segmentationcited by 27
  18. 2019Challenges in Designing Datasets and Validation for Autonomous Drivingcited by 23
  19. 2020BirdNet+: End-to-End 3D Object Detection in LiDAR Bird's Eye Viewcited by 19
  20. 2021LiMoSeg: Real-time Bird's Eye View based LiDAR Motion Segmentationcited by 15
  21. 2023Spiking Neural Network for Ultra-low-latency and High-accurate Object Detectioncited by 14
  22. 2024Autonomous Driving with Spiking Neural Networkscited by 12
  23. 2019Deep SCNN-based Real-time Object Detection for Self-driving Vehicles Using LiDAR Temporal Datacited by 8
  24. 2023LiDAR-BEVMTN: Real-Time LiDAR Bird's-Eye View Multi-Task Perception Network for Autonomous Drivingcited by 2
  25. 2025LiFT: Lightweight, FPGA-tailored 3D object detection based on LiDAR datacited by 2
  26. 2022SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Drivingcited by 1

Built on by

Not cited yet.