Improved Orientation Estimation and Detection with Hybrid Object Detection Networks for Automotive Radar
Not on the map. Why?
Abstract (arXiv)
This paper presents novel hybrid architectures that combine grid- and point-based processing to improve the detection performance and orientation estimation of radar-based object detection networks. Purely grid-based detection models operate on a bird's-eye-view (BEV) projection of the input point cloud. These approaches suffer from a loss of detailed information through the discrete grid resolution. This applies in particular to radar object detection, where relatively coarse grid resolutions are commonly used to account for the sparsity of radar point clouds. In contrast, point-based models are not affected by this problem as they process point clouds without discretization. However, they generally exhibit worse detection performances than grid-based methods. We show that a point-based model can extract neighborhood features, leveraging the exact relative positions of points, before grid rendering. This has significant benefits for a subsequent grid-based convolutional detection backbone. In experiments on the public nuScenes dataset our hybrid architecture achieves improvements in terms of detection performance (19.7% higher mAP for car class than next-best radar-only submission) and orientation estimates (11.5% relative orientation improvement) over networks from previous literature.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 18 of its 34 references that are in the map. First posted on arXiv 3 May 2022.
Builds on
18 of 34 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Mask R-CNNcited by 7,259
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
- 2020CNN based Road User Detection using the 3D Radar Cubecited by 47
- 20192D Car Detection in Radar Data with PointNetscited by 38
6 more
- 2019Deep Radar Detectorcited by 22
- 2022Pointillism: Accurate 3D bounding box estimation with multi-radarscited by 22
- 2021Radar Voxel Fusion for 3D Object Detectioncited by 13
- 2020Off-the-shelf sensor vs. experimental radar -- How much resolution is necessary in automotive radar classification?cited by 10
- 2020DeepReflecs: Deep Learning for Automotive Object Classification with Radar Reflectionscited by 9
- 2020Deep Learning on Radar Centric 3D Object Detectioncited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 9; 2024: 15; 2025: 6; 2026: 1.
33 papers.
Sort:
- 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
- 2023SMURF: Spatial Multi-Representation Fusion for 3D Object Detection with 4D Imaging Radarcited by 48
- 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perceptioncited by 35
- 2024RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Featurescited by 27
- 2024DPFT: Dual Perspective Fusion Transformer for Camera-Radar-based Object Detectioncited by 19
- 2024CRT-Fusion: Camera, Radar, Temporal Fusion Using Motion Information for 3D Object Detectioncited by 18
- 2022DeepFusion: A Robust and Modular 3D Object Detector for Lidars, Cameras and Radarscited by 16
- 2024RCBEVDet++: Toward High-accuracy Radar-Camera Fusion 3D Perception Networkcited by 11
- 2024LiRaFusion: Deep Adaptive LiDAR-Radar Fusion for 3D Object Detectioncited by 10
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
21 more
- 2024SpaRC: Sparse Radar-Camera Fusion for 3D Object Detectioncited by 8
- 2024Bosch Street Dataset: A Multi-Modal Dataset with Imaging Radar for Automated Drivingcited by 7
- 2024RCTrans: Radar-Camera Transformer via Radar Densifier and Sequential Decoder for 3D Object Detectioncited by 7
- 2023Improved Multi-Scale Grid Rendering of Point Clouds for Radar Object Detection Networkscited by 6
- 2024Radar Spectra-Language Model for Automotive Scene Parsingcited by 6
- 2025DoppDrive: Doppler-Driven Temporal Aggregation for Improved Radar Object Detectioncited by 6
- 2023Automotive Object Detection via Learning Sparse Events by Spiking Neuronscited by 5
- 2023ClusterFusion: Leveraging Radar Spatial Features for Radar-Camera 3D Object Detection in Autonomous Vehiclescited by 5
- 2024SparseRadNet: Sparse Perception Neural Network on Subsampled Radar Datacited by 5
- 2025CORENet: Cross-Modal 4D Radar Denoising Network with LiDAR Supervision for Autonomous Drivingcited by 4
- 2023Robust Human Detection under Visual Degradation via Thermal and mmWave Radar Fusioncited by 3
- 2025AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detectioncited by 3
- 2023RC-BEVFusion: A Plug-In Module for Radar-Camera Bird's Eye View Feature Fusioncited by 2
- 2023Exploiting Sparsity in Automotive Radar Object Detection Networkscited by 2
- 2024Reinforcement Learning for SAR View Angle Inversion with Differentiable SAR Renderercited by 1
- 2024Leveraging Self-Supervised Instance Contrastive Learning for Radar Object Detectioncited by 1
- 2025PAN: Pillars-Attention-Based Network for 3D Object Detectioncited by 1
- 2023Histogram-based Deep Learning for Automotive Radarcited by 0
- 2025Class-Aware PillarMix: Can Mixed Sample Data Augmentation Enhance 3D Object Detection with Radar Point Clouds?cited by 0
- 2025Graph Query Networks for Object Detection with Automotive Radarcited by 0
- 2026If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detectioncited by 0
- 2026If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detection2 Sep 2026
- 2025Graph Query Networks for Object Detection with Automotive Radar19 Nov 2025
- 2025PAN: Pillars-Attention-Based Network for 3D Object Detection19 Sep 2025
- 2025CORENet: Cross-Modal 4D Radar Denoising Network with LiDAR Supervision for Autonomous Driving19 Aug 2025
- 2025DoppDrive: Doppler-Driven Temporal Aggregation for Improved Radar Object Detection17 Aug 2025
- 2025AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detection1 Apr 2025
- 2025Class-Aware PillarMix: Can Mixed Sample Data Augmentation Enhance 3D Object Detection with Radar Point Clouds?4 Mar 2025
- 2024RCTrans: Radar-Camera Transformer via Radar Densifier and Sequential Decoder for 3D Object Detection17 Dec 2024
- 2024SpaRC: Sparse Radar-Camera Fusion for 3D Object Detection29 Nov 2024
- 2024CRT-Fusion: Camera, Radar, Temporal Fusion Using Motion Information for 3D Object Detection5 Nov 2024
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey24 Oct 2024
- 2024RCBEVDet++: Toward High-accuracy Radar-Camera Fusion 3D Perception Network8 Sep 2024
21 more
- 2024Bosch Street Dataset: A Multi-Modal Dataset with Imaging Radar for Automated Driving24 Jun 2024
- 2024SparseRadNet: Sparse Perception Neural Network on Subsampled Radar Data15 Jun 2024
- 2024Radar Spectra-Language Model for Automotive Scene Parsing4 Jun 2024
- 2024DPFT: Dual Perspective Fusion Transformer for Camera-Radar-based Object Detection3 Apr 2024
- 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detection25 Mar 2024
- 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perception12 Mar 2024
- 2024RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features8 Mar 2024
- 2024LiRaFusion: Deep Adaptive LiDAR-Radar Fusion for 3D Object Detection18 Feb 2024
- 2024Leveraging Self-Supervised Instance Contrastive Learning for Radar Object Detection13 Feb 2024
- 2024Reinforcement Learning for SAR View Angle Inversion with Differentiable SAR Renderer2 Jan 2024
- 2023ClusterFusion: Leveraging Radar Spatial Features for Radar-Camera 3D Object Detection in Autonomous Vehicles7 Sep 2023
- 2023Exploiting Sparsity in Automotive Radar Object Detection Networks15 Aug 2023
- 2023Automotive Object Detection via Learning Sparse Events by Spiking Neurons24 Jul 2023
- 2023SMURF: Spatial Multi-Representation Fusion for 3D Object Detection with 4D Imaging Radar20 Jul 2023
- 2023Robust Human Detection under Visual Degradation via Thermal and mmWave Radar Fusion7 Jul 2023
- 2023RC-BEVFusion: A Plug-In Module for Radar-Camera Bird's Eye View Feature Fusion25 May 2023
- 2023Improved Multi-Scale Grid Rendering of Point Clouds for Radar Object Detection Networks25 May 2023
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perception3 Apr 2023
- 2023Histogram-based Deep Learning for Automotive Radar6 Mar 2023
- 2022DeepFusion: A Robust and Modular 3D Object Detector for Lidars, Cameras and Radars26 Sep 2022
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformer14 Sep 2022
- 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
- 2023SMURF: Spatial Multi-Representation Fusion for 3D Object Detection with 4D Imaging Radarcited by 48
- 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perceptioncited by 35
- 2024RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Featurescited by 27
- 2024DPFT: Dual Perspective Fusion Transformer for Camera-Radar-based Object Detectioncited by 19
- 2024CRT-Fusion: Camera, Radar, Temporal Fusion Using Motion Information for 3D Object Detectioncited by 18
- 2022DeepFusion: A Robust and Modular 3D Object Detector for Lidars, Cameras and Radarscited by 16
- 2024RCBEVDet++: Toward High-accuracy Radar-Camera Fusion 3D Perception Networkcited by 11
- 2024LiRaFusion: Deep Adaptive LiDAR-Radar Fusion for 3D Object Detectioncited by 10
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
12 most cited of 33 All 33 (JSON)
- 2026If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detection2 Sep 2026
- 2025Graph Query Networks for Object Detection with Automotive Radar19 Nov 2025
- 2025PAN: Pillars-Attention-Based Network for 3D Object Detection19 Sep 2025
- 2025CORENet: Cross-Modal 4D Radar Denoising Network with LiDAR Supervision for Autonomous Driving19 Aug 2025
- 2025DoppDrive: Doppler-Driven Temporal Aggregation for Improved Radar Object Detection17 Aug 2025
- 2025AttentiveGRU: Recurrent Spatio-Temporal Modeling for Advanced Radar-Based BEV Object Detection1 Apr 2025
- 2025Class-Aware PillarMix: Can Mixed Sample Data Augmentation Enhance 3D Object Detection with Radar Point Clouds?4 Mar 2025
- 2024RCTrans: Radar-Camera Transformer via Radar Densifier and Sequential Decoder for 3D Object Detection17 Dec 2024
- 2024SpaRC: Sparse Radar-Camera Fusion for 3D Object Detection29 Nov 2024
- 2024CRT-Fusion: Camera, Radar, Temporal Fusion Using Motion Information for 3D Object Detection5 Nov 2024
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey24 Oct 2024
- 2024RCBEVDet++: Toward High-accuracy Radar-Camera Fusion 3D Perception Network8 Sep 2024
12 newest of 33 All 33 (JSON)