Probably Unknown: Deep Inverse Sensor Modelling In Radar
Not on the map. Why?
Abstract (arXiv)
Radar presents a promising alternative to lidar and vision in autonomous vehicle applications, able to detect objects at long range under a variety of weather conditions. However, distinguishing between occupied and free space from raw radar power returns is challenging due to complex interactions between sensor noise and occlusion. To counter this we propose to learn an Inverse Sensor Model (ISM) converting a raw radar scan to a grid map of occupancy probabilities using a deep neural network. Our network is self-supervised using partial occupancy labels generated by lidar, allowing a robot to learn about world occupancy from past experience without human supervision. We evaluate our approach on five hours of data recorded in a dynamic urban environment. By accounting for the scene context of each grid cell our model is able to successfully segment the world into occupied and free space, outperforming standard CFAR filtering approaches. Additionally by incorporating heteroscedastic uncertainty into our model formulation, we are able to quantify the variance in the uncertainty throughout the sensor observation. Through this mechanism we are able to successfully identify regions of space that are likely to be occluded.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 7; 2024: 3; 2025: 1; 2026: 1.
16 papers.
Sort:
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2022Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillationcited by 19
- 2022NVRadarNet: Real-Time Radar Obstacle and Free Space Detection for Autonomous Drivingcited by 12
- 2024Enabling Visual Recognition at Radio Frequencycited by 11
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challengescited by 10
- 2023Bootstrapping Autonomous Driving Radars with Self-Supervised Learningcited by 9
- 2021Radar Occupancy Prediction with Lidar Supervision while Preserving Long-Range Sensing and Penetrating Capabilitiescited by 5
- 2023Quantification of Uncertainties in Deep Learning-based Environment Perceptioncited by 4
- 2025RF4D:Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenescited by 4
- 2023Deep Radar Inverse Sensor Models for Dynamic Occupancy Grid Mapscited by 2
- 2022Sensor Visibility Estimation: Metrics and Methods for Systematic Performance Evaluation and Improvementcited by 1
- 2023ROSS: Radar Off-road Semantic Segmentationcited by 1
4 more
- 2024Masked Gamma-SSL: Learning Uncertainty Estimation via Masked Image Modelingcited by 1
- 2024Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Datacited by 1
- 2023RadarLCD: Learnable Radar-based Loop Closure Detection Pipelinecited by 0
- 2026On Learning Spatial Structure from Pre-Beamforming Per-Antenna Range-Doppler Radar Measurementscited by 0
- 2026On Learning Spatial Structure from Pre-Beamforming Per-Antenna Range-Doppler Radar Measurements2 Apr 2026
- 2025RF4D:Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenes27 May 2025
- 2024Enabling Visual Recognition at Radio Frequency29 May 2024
- 2024Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Data27 Feb 2024
- 2024Masked Gamma-SSL: Learning Uncertainty Estimation via Masked Image Modeling27 Feb 2024
- 2023Bootstrapping Autonomous Driving Radars with Self-Supervised Learning7 Dec 2023
- 2023ROSS: Radar Off-road Semantic Segmentation20 Oct 2023
- 2023RadarLCD: Learnable Radar-based Loop Closure Detection Pipeline13 Sep 2023
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challenges15 Jun 2023
- 2023Quantification of Uncertainties in Deep Learning-based Environment Perception5 Jun 2023
- 2023Deep Radar Inverse Sensor Models for Dynamic Occupancy Grid Maps21 May 2023
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perception3 Apr 2023
4 more
- 2022Sensor Visibility Estimation: Metrics and Methods for Systematic Performance Evaluation and Improvement11 Nov 2022
- 2022NVRadarNet: Real-Time Radar Obstacle and Free Space Detection for Autonomous Driving29 Sep 2022
- 2022Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation21 Mar 2022
- 2021Radar Occupancy Prediction with Lidar Supervision while Preserving Long-Range Sensing and Penetrating Capabilities8 Dec 2021
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2022Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillationcited by 19
- 2022NVRadarNet: Real-Time Radar Obstacle and Free Space Detection for Autonomous Drivingcited by 12
- 2024Enabling Visual Recognition at Radio Frequencycited by 11
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challengescited by 10
- 2023Bootstrapping Autonomous Driving Radars with Self-Supervised Learningcited by 9
- 2021Radar Occupancy Prediction with Lidar Supervision while Preserving Long-Range Sensing and Penetrating Capabilitiescited by 5
- 2023Quantification of Uncertainties in Deep Learning-based Environment Perceptioncited by 4
- 2025RF4D:Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenescited by 4
- 2023Deep Radar Inverse Sensor Models for Dynamic Occupancy Grid Mapscited by 2
- 2022Sensor Visibility Estimation: Metrics and Methods for Systematic Performance Evaluation and Improvementcited by 1
- 2023ROSS: Radar Off-road Semantic Segmentationcited by 1
12 most cited of 16 All 16 (JSON)
- 2026On Learning Spatial Structure from Pre-Beamforming Per-Antenna Range-Doppler Radar Measurements2 Apr 2026
- 2025RF4D:Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenes27 May 2025
- 2024Enabling Visual Recognition at Radio Frequency29 May 2024
- 2024Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Data27 Feb 2024
- 2024Masked Gamma-SSL: Learning Uncertainty Estimation via Masked Image Modeling27 Feb 2024
- 2023Bootstrapping Autonomous Driving Radars with Self-Supervised Learning7 Dec 2023
- 2023ROSS: Radar Off-road Semantic Segmentation20 Oct 2023
- 2023RadarLCD: Learnable Radar-based Loop Closure Detection Pipeline13 Sep 2023
- 2023Radars for Autonomous Driving: A Review of Deep Learning Methods and Challenges15 Jun 2023
- 2023Quantification of Uncertainties in Deep Learning-based Environment Perception5 Jun 2023
- 2023Deep Radar Inverse Sensor Models for Dynamic Occupancy Grid Maps21 May 2023
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perception3 Apr 2023
12 newest of 16 All 16 (JSON)