Improved Multi-Scale Grid Rendering of Point Clouds for Radar Object Detection Networks
Not on the map. Why?
Abstract (arXiv)
Architectures that first convert point clouds to a grid representation and then apply convolutional neural networks achieve good performance for radar-based object detection. However, the transfer from irregular point cloud data to a dense grid structure is often associated with a loss of information, due to the discretization and aggregation of points. In this paper, we propose a novel architecture, multi-scale KPPillarsBEV, that aims to mitigate the negative effects of grid rendering. Specifically, we propose a novel grid rendering method, KPBEV, which leverages the descriptive power of kernel point convolutions to improve the encoding of local point cloud contexts during grid rendering. In addition, we propose a general multi-scale grid rendering formulation to incorporate multi-scale feature maps into convolutional backbones of detection networks with arbitrary grid rendering methods. We perform extensive experiments on the nuScenes dataset and evaluate the methods in terms of detection performance and computational complexity. The proposed multi-scale KPPillarsBEV architecture outperforms the baseline by 5.37% and the previous state of the art by 2.88% in Car AP4.0 (average precision for a matching threshold of 4 meters) on the nuScenes validation set. Moreover, the proposed single-scale KPBEV grid rendering improves the Car AP4.0 by 2.90% over the baseline while maintaining the same inference speed.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 25 May 2023.
Builds on
23 of 42 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
11 more
- 2019End-to-End Multi-View Fusion for 3D Object Detection in LiDAR Point Cloudscited by 171
- 2022PillarNet: Real-Time and High-Performance Pillar-based 3D Object Detectioncited by 99
- 2020HVNet: Hybrid Voxel Network for LiDAR Based 3D Object Detectioncited by 82
- 2021Raw High-Definition Radar for Multi-Task Learningcited by 69
- 2021RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localizationcited by 49
- 20192D Car Detection in Radar Data with PointNetscited by 38
- 2022Improved Orientation Estimation and Detection with Hybrid Object Detection Networks for Automotive Radarcited by 33
- 2019Deep Radar Detectorcited by 22
- 2022Pointillism: Accurate 3D bounding box estimation with multi-radarscited by 22
- 2022Gaussian Radar Transformer for Semantic Segmentation in Noisy Radar Datacited by 15
- 2020DeepReflecs: Deep Learning for Automotive Object Classification with Radar Reflectionscited by 9
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 2.
6 papers.
- 2024DPFT: Dual Perspective Fusion Transformer for Camera-Radar-based Object Detectioncited by 19
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
- 2023ClusterFusion: Leveraging Radar Spatial Features for Radar-Camera 3D Object Detection in Autonomous Vehiclescited by 5
- 2025AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detectioncited by 3
- 2023Exploiting Sparsity in Automotive Radar Object Detection Networkscited by 2
- 2025Graph Query Networks for Object Detection with Automotive Radarcited by 0
- 2025Graph Query Networks for Object Detection with Automotive Radar19 Nov 2025
- 2025AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detection1 Apr 2025
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey24 Oct 2024
- 2024DPFT: Dual Perspective Fusion Transformer for Camera-Radar-based Object Detection3 Apr 2024
- 2023ClusterFusion: Leveraging Radar Spatial Features for Radar-Camera 3D Object Detection in Autonomous Vehicles7 Sep 2023
- 2023Exploiting Sparsity in Automotive Radar Object Detection Networks15 Aug 2023