Real-Time And Robust 3D Object Detection with Roadside LiDARs
Not on the map. Why?
Abstract (arXiv)
This work aims to address the challenges in autonomous driving by focusing on the 3D perception of the environment using roadside LiDARs. We design a 3D object detection model that can detect traffic participants in roadside LiDARs in real-time. Our model uses an existing 3D detector as a baseline and improves its accuracy. To prove the effectiveness of our proposed modules, we train and evaluate the model on three different vehicle and infrastructure datasets. To show the domain adaptation ability of our detector, we train it on an infrastructure dataset from China and perform transfer learning on a different dataset recorded in Germany. We do several sets of experiments and ablation studies for each module in the detector that show that our model outperforms the baseline by a significant margin, while the inference speed is at 45 Hz (22 ms). We make a significant contribution with our LiDAR-based 3D detector that can be used for smart city applications to provide connected and automated vehicles with a far-reaching view. Vehicles that are connected to the roadside sensors can get information about other vehicles around the corner to improve their path and maneuver planning and to increase road traffic safety.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 11 Jul 2022.
Builds on
28 of 40 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
16 more
- 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
- 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
- 2016UnitBox: An Advanced Object Detection Networkcited by 205
- 2021RangeDet:In Defense of Range View for LiDAR-based 3D Object Detectioncited by 140
- 2021SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloudcited by 119
- 2019TANet: Robust 3D Object Detection from Point Clouds with Triple Attentioncited by 108
- 2020CIA-SSD: Confident IoU-Aware Single-Stage Object Detector From Point Cloudcited by 107
- 2021HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detectioncited by 47
- 2021A Survey on Deep Domain Adaptation for LiDAR Perceptioncited by 46
- 2022A9-Dataset: Multi-Sensor Infrastructure-Based Dataset for Mobility Researchcited by 40
- 2020RangeRCNN: Towards Fast and Accurate 3D Object Detection with Range Image Representationcited by 37
- 20193D BAT: A Semi-Automatic, Web-based 3D Annotation Toolbox for Full-Surround, Multi-Modal Data Streamscited by 35
- 2021IPS300+: a Challenging Multimodal Dataset for Intersection Perception Systemcited by 26
- 2021From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detectioncited by 24
- 2019Providentia -- A Large-Scale Sensor System for the Assistance of Autonomous Vehicles and Its Evaluationcited by 17
- 2020Real-Time Point Cloud Fusion of Multi-LiDAR Infrastructure Sensor Setups with Unknown Spatial Location and Orientationcited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 4.
9 papers.
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 124
- 2023InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensorscited by 25
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2025MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detectioncited by 3
- 2024PointCompress3D: A Point Cloud Compression Framework for Roadside LiDARs in Intelligent Transportation Systemscited by 2
- 2024Transfer Learning from Simulated to Real Scenes for Monocular 3D Object Detectioncited by 2
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Datasetcited by 2
- 2025Enhancing Highway Safety: Accident Detection on the A9 Test Stretch Using Roadside Sensorscited by 1
- 2025Safety-Critical Learning for Long-Tail Events: The TUM Traffic Accident Datasetcited by 1
- 2025MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detection28 Oct 2025
- 2025Safety-Critical Learning for Long-Tail Events: The TUM Traffic Accident Dataset20 Aug 2025
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Dataset15 Mar 2025
- 2025Enhancing Highway Safety: Accident Detection on the A9 Test Stretch Using Roadside Sensors1 Feb 2025
- 2024Transfer Learning from Simulated to Real Scenes for Monocular 3D Object Detection28 Aug 2024
- 2024PointCompress3D: A Point Cloud Compression Framework for Roadside LiDARs in Intelligent Transportation Systems2 May 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlook22 Oct 2023
- 2023InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensors29 Apr 2023