Full-Velocity Radar Returns by Radar-Camera Fusion
Not on the map. Why?
Abstract (arXiv)
A distinctive feature of Doppler radar is the measurement of velocity in the radial direction for radar points. However, the missing tangential velocity component hampers object velocity estimation as well as temporal integration of radar sweeps in dynamic scenes. Recognizing that fusing camera with radar provides complementary information to radar, in this paper we present a closed-form solution for the point-wise, full-velocity estimate of Doppler returns using the corresponding optical flow from camera images. Additionally, we address the association problem between radar returns and camera images with a neural network that is trained to estimate radar-camera correspondences. Experimental results on the nuScenes dataset verify the validity of the method and show significant improvements over the state-of-the-art in velocity estimation and accumulation of radar points.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 24 Aug 2021.
Builds on
25 of 38 references.
References · 25
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2018Object Detection with Deep Learning: A Reviewcited by 524
- 2019M3D-RPN: Monocular 3D Region Proposal Network for Object Detectioncited by 251
- 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 159
- 2019The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Datasetcited by 133
- 2020Kinematic 3D Object Detection in Monocular Videocited by 116
- 2020Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Reviewcited by 114
- 2020Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systemscited by 100
- 2020A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detectioncited by 70
13 more
- 2021Radar-Camera Pixel Depth Association for Depth Completioncited by 49
- 2020RadarNet: Exploiting Radar for Robust Perception of Dynamic Objectscited by 48
- 2020CNN based Road User Detection using the 3D Radar Cubecited by 47
- 2019Distant Vehicle Detection Using Radar and Visioncited by 44
- 2019Depth Coefficients for Depth Completioncited by 41
- 2021Depth Completion with Twin Surface Extrapolation at Occlusion Boundariescited by 41
- 20192D Car Detection in Radar Data with PointNetscited by 38
- 2019Deep Radar Detectorcited by 22
- 2020RSS-Net: Weakly-Supervised Multi-Class Semantic Segmentation with FMCW Radarcited by 22
- 2018ConnNet: A Long-Range Relation-Aware Pixel-Connectivity Network for Salient Segmentationcited by 15
- 2019A Multi-Stage Clustering Framework for Automotive Radar Datacited by 6
- 2019BoxNet: A Deep Learning Method for 2D Bounding Box Estimation from Bird's-Eye View Point Cloudcited by 3
- 2018A Pyramid CNN for Dense-Leaves Segmentationcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 6; 2024: 4; 2025: 5.
16 papers.
Sort:
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 57
- 2023MVFusion: Multi-View 3D Object Detection with Semantic-aligned Radar and Camera Fusioncited by 29
- 2023Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Reviewcited by 22
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scalecited by 20
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2023Sparse Beats Dense: Rethinking Supervision in Radar-Camera Depth Completioncited by 12
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challengescited by 10
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
- 2025RICCARDO: Radar Hit Prediction and Convolution for Camera-Radar 3D Object Detectioncited by 9
- 2024RIDERS: Radar-Infrared Depth Estimation for Robust Sensingcited by 5
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimationcited by 5
4 more
- 2025Structure-Aware Radar-Camera Depth Estimationcited by 5
- 2023Ego-Motion Estimation and Dynamic Motion Separation from 3D Point Clouds for Accumulating Data and Improving 3D Object Detectioncited by 4
- 2025DoGFlow: Self-Supervised LiDAR Scene Flow via Cross-Modal Doppler Guidancecited by 4
- 2025RaCalNet: Radar Calibration Network for Sparse-Supervised Metric Depth Estimationcited by 2
- 2025DoGFlow: Self-Supervised LiDAR Scene Flow via Cross-Modal Doppler Guidance25 Aug 2025
- 2025RaCalNet: Radar Calibration Network for Sparse-Supervised Metric Depth Estimation18 Jun 2025
- 2025Structure-Aware Radar-Camera Depth Estimation5 Jun 2025
- 2025RICCARDO: Radar Hit Prediction and Convolution for Camera-Radar 3D Object Detection12 Apr 2025
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimation21 Mar 2025
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey24 Oct 2024
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024RIDERS: Radar-Infrared Depth Estimation for Robust Sensing3 Feb 2024
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale9 Jan 2024
- 2023Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review8 Dec 2023
- 2023Sparse Beats Dense: Rethinking Supervision in Radar-Camera Depth Completion1 Dec 2023
- 2023Ego-Motion Estimation and Dynamic Motion Separation from 3D Point Clouds for Accumulating Data and Improving 3D Object Detection29 Aug 2023
4 more
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challenges15 Jun 2023
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review20 Apr 2023
- 2023MVFusion: Multi-View 3D Object Detection with Semantic-aligned Radar and Camera Fusion21 Feb 2023
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformer14 Sep 2022
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 57
- 2023MVFusion: Multi-View 3D Object Detection with Semantic-aligned Radar and Camera Fusioncited by 29
- 2023Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Reviewcited by 22
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scalecited by 20
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2023Sparse Beats Dense: Rethinking Supervision in Radar-Camera Depth Completioncited by 12
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challengescited by 10
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
- 2025RICCARDO: Radar Hit Prediction and Convolution for Camera-Radar 3D Object Detectioncited by 9
- 2024RIDERS: Radar-Infrared Depth Estimation for Robust Sensingcited by 5
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimationcited by 5
12 most cited of 16 All 16 (JSON)
- 2025DoGFlow: Self-Supervised LiDAR Scene Flow via Cross-Modal Doppler Guidance25 Aug 2025
- 2025RaCalNet: Radar Calibration Network for Sparse-Supervised Metric Depth Estimation18 Jun 2025
- 2025Structure-Aware Radar-Camera Depth Estimation5 Jun 2025
- 2025RICCARDO: Radar Hit Prediction and Convolution for Camera-Radar 3D Object Detection12 Apr 2025
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimation21 Mar 2025
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey24 Oct 2024
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024RIDERS: Radar-Infrared Depth Estimation for Robust Sensing3 Feb 2024
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale9 Jan 2024
- 2023Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review8 Dec 2023
- 2023Sparse Beats Dense: Rethinking Supervision in Radar-Camera Depth Completion1 Dec 2023
- 2023Ego-Motion Estimation and Dynamic Motion Separation from 3D Point Clouds for Accumulating Data and Improving 3D Object Detection29 Aug 2023
12 newest of 16 All 16 (JSON)