Radar Occupancy Prediction with Lidar Supervision while Preserving Long-Range Sensing and Penetrating Capabilities
Not on the map. Why?
Abstract (arXiv)
Radar shows great potential for autonomous driving by accomplishing long-range sensing under diverse weather conditions. But radar is also a particularly challenging sensing modality due to the radar noises. Recent works have made enormous progress in classifying free and occupied spaces in radar images by leveraging lidar label supervision. However, there are still several unsolved issues. Firstly, the sensing distance of the results is limited by the sensing range of lidar. Secondly, the performance of the results is degenerated by lidar due to the physical sensing discrepancies between the two sensors. For example, some objects visible to lidar are invisible to radar, and some objects occluded in lidar scans are visible in radar images because of the radar's penetrating capability. These sensing differences cause false positive and penetrating capability degeneration, respectively. In this paper, we propose training data preprocessing and polar sliding window inference to solve the issues. The data preprocessing aims to reduce the effect caused by radar-invisible measurements in lidar scans. The polar sliding window inference aims to solve the limited sensing range issue by applying a near-range trained network to the long-range region. Instead of using common Cartesian representation, we propose to use polar representation to reduce the shape dissimilarity between long-range and near-range data. We find that extending a near-range trained network to long-range region inference in the polar space has 4.2 times better IoU than in Cartesian space. Besides, the polar sliding window inference can preserve the radar penetrating capability by changing the viewpoint of the inference region, which makes some occluded measurements seem non-occluded for a pretrained network.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 8 Dec 2021.
Builds on
17 of 21 references.
References · 17
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016An overview of gradient descent optimization algorithmscited by 1,021
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2017Tversky loss function for image segmentation using 3D fully convolutional deep networkscited by 228
- 2019The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Datasetcited by 133
- 2020RSS-Net: Weakly-Supervised Multi-Class Semantic Segmentation with FMCW Radarcited by 22
- 2020Under the Radar: Learning to Predict Robust Keypoints for Odometry Estimation and Metric Localisation in Radarcited by 17
- 2018Probably Unknown: Deep Inverse Sensor Modelling In Radarcited by 16
- 2020Kidnapped Radar: Topological Radar Localisation using Rotationally-Invariant Metric Learningcited by 16
- 2019Masking by Moving: Learning Distraction-Free Radar Odometry from Pose Informationcited by 15
- 2020RadarSLAM: Radar based Large-Scale SLAM in All Weatherscited by 14
5 more
- 2020There and Back Again: Learning to Simulate Radar Data for Real-World Applicationscited by 11
- 2021Radar Odometry Combining Probabilistic Estimation and Unsupervised Feature Learningcited by 10
- 2021A Normal Distribution Transform-Based Radar Odometry Designed For Scanning and Automotive Radarscited by 7
- 2019Radar-only ego-motion estimation in difficult settings via graph matchingcited by 6
- 2020Radar-on-Lidar: metric radar localization on prior lidar mapscited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 1; 2025: 2.
5 papers.
- 2025RadarSplat: Radar Gaussian Splatting for High-Fidelity Data Synthesis and 3D Reconstruction of Autonomous Driving Scenescited by 15
- 2023Bootstrapping Autonomous Driving Radars with Self-Supervised Learningcited by 9
- 2024FSF-Net: Enhance 4D Occupancy Forecasting with Coarse BEV Scene Flow for Autonomous Drivingcited by 5
- 2025RF4D:Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenescited by 4
- 2022Deep learning for radar data exploitation of autonomous vehiclecited by 1
- 2025RadarSplat: Radar Gaussian Splatting for High-Fidelity Data Synthesis and 3D Reconstruction of Autonomous Driving Scenes2 Jun 2025
- 2025RF4D:Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenes27 May 2025
- 2024FSF-Net: Enhance 4D Occupancy Forecasting with Coarse BEV Scene Flow for Autonomous Driving24 Sep 2024
- 2023Bootstrapping Autonomous Driving Radars with Self-Supervised Learning7 Dec 2023
- 2022Deep learning for radar data exploitation of autonomous vehicle15 Mar 2022