DurLAR: A High-fidelity 128-channel LiDAR Dataset with Panoramic Ambient and Reflectivity Imagery for Multi-modal Autonomous Driving Applications

arXiv 2406.10068 ↗First posted 14 Jun 2024cs.CV cs.ROcited by 7

Not on the map. Why?

Abstract (arXiv)

We present DurLAR, a high-fidelity 128-channel 3D LiDAR dataset with panoramic ambient (near infrared) and reflectivity imagery, as well as a sample benchmark task using depth estimation for autonomous driving applications. Our driving platform is equipped with a high resolution 128 channel LiDAR, a 2MPix stereo camera, a lux meter and a GNSS/INS system. Ambient and reflectivity images are made available along with the LiDAR point clouds to facilitate multi-modal use of concurrent ambient and reflectivity scene information. Leveraging DurLAR, with a resolution exceeding that of prior benchmarks, we consider the task of monocular depth estimation and use this increased availability of higher resolution, yet sparse ground truth scene depth information to propose a novel joint supervised/self-supervised loss formulation. We compare performance over both our new DurLAR dataset, the established KITTI benchmark and the Cityscapes dataset. Our evaluation shows our joint use supervised and self-supervised loss terms, enabled via the superior ground truth resolution and availability within DurLAR improves the quantitative and qualitative performance of leading contemporary monocular depth estimation approaches (RMSE=3.639, Sq Rel=0.936).

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 46 of its 75 references that are in the map. First posted on arXiv 14 Jun 2024.

Builds on

46 of 75 references.

References · 46

2015Deep Residual Learning for Image Recognitioncited by 51,809
2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
2020AdaBins: Depth Estimation using Adaptive Binscited by 596
2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483

34 more

2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 388
2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
2017Sparsity Invariant CNNscited by 325
2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
2019Self-Supervised Monocular Depth Hintscited by 127
2017Semi-Supervised Deep Learning for Monocular Depth Map Predictioncited by 109
2019The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenescited by 80
2016Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networkscited by 72
2020Don't Forget The Past: Recurrent Depth Estimation from Monocular Videocited by 71
2019Neural RGB->D Sensing: Depth and Uncertainty from a Video Cameracited by 69
2019Exploiting temporal consistency for real-time video depth estimationcited by 61
2020MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Cameracited by 59
2020Uncertainty-Aware CNNs for Depth Completion: Uncertainty from Beginning to Endcited by 55
2018Anytime Stereo Image Depth Estimation on Mobile Devicescited by 54
2019Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depthcited by 50
2019Multi-View Stereo by Temporal Nonparametric Fusioncited by 46
2023General, Single-shot, Target-less, and Automatic LiDAR-Camera Extrinsic Calibration Toolboxcited by 41
2019Learning Unsupervised Multi-View Stereopsis via Robust Photometric Consistencycited by 40
2020Wasserstein Distances for Stereo Disparity Estimationcited by 38
2023Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentationcited by 33
2019MVS^2: Deep Unsupervised Multi-view Stereo with Multi-View Symmetrycited by 30
2020Real-time Kinematic Ground Truth for the Oxford RobotCar Datasetcited by 28
2021Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setupscited by 25
2019Gated2Depth: Real-time Dense Lidar from Gated Imagescited by 23
2019Video Depth Estimation by Fusing Flow-to-Depth Proposalscited by 23
2020Self-Supervised Joint Learning Framework of Depth Estimation via Implicit Cuescited by 19
2017LiDAR-Camera Calibration using 3D-3D Point correspondencescited by 18
2019Pixel-Accurate Depth Evaluation in Realistic Driving Scenarioscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 1.

7 papers.