Depth Estimation from Monocular Images and Sparse radar using Deep Ordinal Regression Network
Not on the map. Why?
Abstract (arXiv)
We integrate sparse radar data into a monocular depth estimation model and introduce a novel preprocessing method for reducing the sparseness and limited field of view provided by radar. We explore the intrinsic error of different radar modalities and show our proposed method results in more data points with reduced error. We further propose a novel method for estimating dense depth maps from monocular 2D images and sparse radar measurements using deep learning based on the deep ordinal regression network by Fu et al. Radar data are integrated by first converting the sparse 2D points to a height-extended 3D measurement and then including it into the network using a late fusion approach. Experiments are conducted on the nuScenes dataset. Our experiments demonstrate state-of-the-art performance in both day and night scenes.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 16 of its 18 references that are in the map. First posted on arXiv 15 Jul 2021.
Builds on
16 of 18 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2017Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Imagecited by 159
- 2018Self-supervised Sparse-to-Dense: Self-supervised Depth Completion from LiDAR and Monocular Cameracited by 140
- 2020ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentationcited by 95
- 2018Sparse and Dense Data with CNNs: Depth Completion and Semantic Segmentationcited by 76
4 more
- 2020A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detectioncited by 70
- 2020Bidirectional Attention Network for Monocular Depth Estimationcited by 48
- 2020Depth Estimation from Monocular Images and Sparse Radar Datacited by 44
- 2020Multi-Modal Depth Estimation Using Convolutional Neural Networkscited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 3; 2024: 9; 2025: 7; 2026: 7.
32 papers.
Sort:
By area:
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2024OMNI-DC: Highly Robust Depth Completion with Multiresolution Depth Integrationcited by 28
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scalecited by 20
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2023EVEN: An Event-Based Framework for Monocular Depth Estimation at Adverse Night Conditionscited by 19
- 2023Sparse Beats Dense: Rethinking Supervision in Radar-Camera Depth Completioncited by 12
- 2024CaFNet: A Confidence-Driven Framework for Radar Camera Depth Estimationcited by 12
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sourcescited by 10
- 2025TacoDepth: Towards Efficient Radar-Camera Depth Estimation with One-stage Fusioncited by 9
- 2021Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Visioncited by 7
- 2022RCDPT: Radar-Camera fusion Dense Prediction Transformercited by 7
- 2024GET-UP: GEomeTric-aware Depth Estimation with Radar Points UPsamplingcited by 7
20 more
- 2021Advancing Autonomous Driving: DepthSense with Radar and Spatial Attentioncited by 5
- 2024RIDERS: Radar-Infrared Depth Estimation for Robust Sensingcited by 5
- 2024Enhanced Radar Perception via Multi-Task Learning: Towards Refined Data for Sensor Fusion Applicationscited by 5
- 2024LiRCDepth: Lightweight Radar-Camera Depth Estimation via Knowledge Distillation and Uncertainty Guidancecited by 5
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimationcited by 5
- 2025SpINR: Neural Volumetric Reconstruction for FMCW Radarscited by 5
- 2025Structure-Aware Radar-Camera Depth Estimationcited by 5
- 2022On Monocular Depth Estimation and Uncertainty Quantification using Classification Approaches for Regressioncited by 2
- 2022How Much Depth Information can Radar Contribute to a Depth Estimation Model?cited by 2
- 2025RaCalNet: Radar Calibration Network for Sparse-Supervised Metric Depth Estimationcited by 2
- 2026JustDepth: Real-Time Radar-Camera Depth Estimation with Single-Scan LiDAR Supervisioncited by 2
- 2023LiDAR Meta Depth Completioncited by 1
- 2025SpINRv2: Implicit Neural Representation for Passband FMCW Radarscited by 1
- 2025TRIDE: A Text-assisted Radar-Image weather-aware fusion network for Depth Estimationcited by 1
- 2026Selection, Not Fusion: Radar-Modulated State Space Models for Radar-Camera Depth Estimationcited by 1
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Drivingcited by 0
- 2026Instance-Guided Radar Depth Estimation for 3D Object Detectioncited by 0
- 2026Geometry-Aware Representation Denoising for Robust Multi-view 3D Reconstructioncited by 0
- 2026Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Drivingcited by 0
- 2026RbFT-Net: Rectify-Before-Fuse Temporal Radar Anchors for 4D Radar-Camera Depth Completioncited by 0
- 2026RbFT-Net: Rectify-Before-Fuse Temporal Radar Anchors for 4D Radar-Camera Depth Completion13 Aug 2026
- 2026JustDepth: Real-Time Radar-Camera Depth Estimation with Single-Scan LiDAR Supervision24 Jul 2026
- 2026Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving23 Jul 2026
- 2026Geometry-Aware Representation Denoising for Robust Multi-view 3D Reconstruction25 May 2026
- 2026Selection, Not Fusion: Radar-Modulated State Space Models for Radar-Camera Depth Estimation12 May 2026
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources29 Jan 2026
- 2026Instance-Guided Radar Depth Estimation for 3D Object Detection27 Jan 2026
- 2025TRIDE: A Text-assisted Radar-Image weather-aware fusion network for Depth Estimation11 Aug 2025
- 2025RaCalNet: Radar Calibration Network for Sparse-Supervised Metric Depth Estimation18 Jun 2025
- 2025SpINRv2: Implicit Neural Representation for Passband FMCW Radars9 Jun 2025
- 2025Structure-Aware Radar-Camera Depth Estimation5 Jun 2025
- 2025TacoDepth: Towards Efficient Radar-Camera Depth Estimation with One-stage Fusion16 Apr 2025
20 more
- 2025SpINR: Neural Volumetric Reconstruction for FMCW Radars30 Mar 2025
- 2025Radar-Guided Polynomial Fitting for Metric Depth Estimation21 Mar 2025
- 2024LiRCDepth: Lightweight Radar-Camera Depth Estimation via Knowledge Distillation and Uncertainty Guidance20 Dec 2024
- 2024OMNI-DC: Highly Robust Depth Completion with Multiresolution Depth Integration28 Nov 2024
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving31 Oct 2024
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024GET-UP: GEomeTric-aware Depth Estimation with Radar Points UPsampling2 Sep 2024
- 2024CaFNet: A Confidence-Driven Framework for Radar Camera Depth Estimation30 Jun 2024
- 2024Enhanced Radar Perception via Multi-Task Learning: Towards Refined Data for Sensor Fusion Applications9 Apr 2024
- 2024RIDERS: Radar-Infrared Depth Estimation for Robust Sensing3 Feb 2024
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale9 Jan 2024
- 2023Sparse Beats Dense: Rethinking Supervision in Radar-Camera Depth Completion1 Dec 2023
- 2023LiDAR Meta Depth Completion24 Jul 2023
- 2023EVEN: An Event-Based Framework for Monocular Depth Estimation at Adverse Night Conditions8 Feb 2023
- 2022RCDPT: Radar-Camera fusion Dense Prediction Transformer4 Nov 2022
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimation3 Apr 2022
- 2022How Much Depth Information can Radar Contribute to a Depth Estimation Model?26 Feb 2022
- 2022On Monocular Depth Estimation and Uncertainty Quantification using Classification Approaches for Regression24 Feb 2022
- 2021Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Vision18 Sep 2021
- 2021Advancing Autonomous Driving: DepthSense with Radar and Spatial Attention11 Sep 2021
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2024OMNI-DC: Highly Robust Depth Completion with Multiresolution Depth Integrationcited by 28
- 2024RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scalecited by 20
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2023EVEN: An Event-Based Framework for Monocular Depth Estimation at Adverse Night Conditionscited by 19
- 2023Sparse Beats Dense: Rethinking Supervision in Radar-Camera Depth Completioncited by 12
- 2024CaFNet: A Confidence-Driven Framework for Radar Camera Depth Estimationcited by 12
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sourcescited by 10
- 2025TacoDepth: Towards Efficient Radar-Camera Depth Estimation with One-stage Fusioncited by 9
- 2021Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Visioncited by 7
- 2022RCDPT: Radar-Camera fusion Dense Prediction Transformercited by 7
- 2024GET-UP: GEomeTric-aware Depth Estimation with Radar Points UPsamplingcited by 7
12 most cited of 31 All 31 (JSON)
- 2026RbFT-Net: Rectify-Before-Fuse Temporal Radar Anchors for 4D Radar-Camera Depth Completion13 Aug 2026
- 2026JustDepth: Real-Time Radar-Camera Depth Estimation with Single-Scan LiDAR Supervision24 Jul 2026
- 2026Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving23 Jul 2026
- 2026Geometry-Aware Representation Denoising for Robust Multi-view 3D Reconstruction25 May 2026
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources29 Jan 2026
- 2026Instance-Guided Radar Depth Estimation for 3D Object Detection27 Jan 2026
- 2025TRIDE: A Text-assisted Radar-Image weather-aware fusion network for Depth Estimation11 Aug 2025
- 2025RaCalNet: Radar Calibration Network for Sparse-Supervised Metric Depth Estimation18 Jun 2025
- 2025SpINRv2: Implicit Neural Representation for Passband FMCW Radars9 Jun 2025
- 2025Structure-Aware Radar-Camera Depth Estimation5 Jun 2025
- 2025TacoDepth: Towards Efficient Radar-Camera Depth Estimation with One-stage Fusion16 Apr 2025
- 2025SpINR: Neural Volumetric Reconstruction for FMCW Radars30 Mar 2025
12 newest of 31 All 31 (JSON)