Deep Multi-Sensor Lane Detection
Not on the map. Why?
Abstract (arXiv)
Reliable and accurate lane detection has been a long-standing problem in the field of autonomous driving. In recent years, many approaches have been developed that use images (or videos) as input and reason in image space. In this paper we argue that accurate image estimates do not translate to precise 3D lane boundaries, which are the input required by modern motion planning algorithms. To address this issue, we propose a novel deep neural network that takes advantage of both LiDAR and camera sensors and produces very accurate estimates directly in 3D space. We demonstrate the performance of our approach on both highways and in cities, and show very accurate estimates in complex scenarios such as heavy traffic (which produces occlusion), fork, merges and intersections.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 8; 2023: 1; 2024: 6; 2025: 3; 2026: 2.
30 papers.
Sort:
By area:
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2023Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detectioncited by 48
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detectioncited by 44
- 2021LaneAF: Robust Multi-Lane Detection with Affinity Fieldscited by 41
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
- 2021Lane Graph Estimation for Scene Understanding in Urban Drivingcited by 18
- 2021A Simple and Efficient Multi-task Network for 3D Object Detection and Road Understandingcited by 17
- 2021K-Lane: Lidar Lane Dataset and Benchmark for Urban Roads and Highwayscited by 11
- 2022WS-3D-Lane: Weakly Supervised 3D Lane Detection With 2D Lane Labelscited by 9
18 more
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlookscited by 9
- 2024DV-3DLane: End-to-end Multi-modal 3D Lane Detection with Dual-view Representationcited by 9
- 2024Anchor3DLane++: 3D Lane Detection via Sample-Adaptive Sparse 3D Anchor Regressioncited by 8
- 2022M2-3DLaneNet: Exploring Multi-Modal 3D Lane Detectioncited by 7
- 2022BEV-LaneDet: a Simple and Effective 3D Lane Detection Baselinecited by 7
- 2021A novel multimodal fusion network based on a joint coding model for lane line segmentationcited by 6
- 2022Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Trackingcited by 4
- 2022Row-wise LiDAR Lane Detection Network with Lane Correlation Refinementcited by 4
- 2024Monocular Lane Detection Based on Deep Learning: A Surveycited by 4
- 2022Reconstruct from BEV: A 3D Lane Detection Approach based on Geometry Structure Priorcited by 2
- 2024Online Temporal Fusion for Vectorized Map Construction in Mapless Autonomous Drivingcited by 2
- 2021Non-parametric Memory for Spatio-Temporal Segmentation of Construction Zones for Self-Drivingcited by 1
- 2025Datasets for Lane Detection in Autonomous Driving: A Comprehensive Reviewcited by 1
- 2025Learning Isometric Embeddings of Road Networks using Multidimensional Scalingcited by 1
- 2026Efficient Sequential Neural Network with Spatial-Temporal Attention and Linear LSTM for Robust Lane Detection Using Multi-Frame Imagescited by 1
- 2024Enhance DNN Adversarial Robustness and Efficiency via Injecting Noise to Non-Essential Neuronscited by 0
- 2025Pandar128 dataset for lane line detectioncited by 0
- 20263D Lane Detection with Odometry for High-Speed Vehicle Racingcited by 0
- 20263D Lane Detection with Odometry for High-Speed Vehicle Racing15 Jul 2026
- 2026Efficient Sequential Neural Network with Spatial-Temporal Attention and Linear LSTM for Robust Lane Detection Using Multi-Frame Images3 Feb 2026
- 2025Pandar128 dataset for lane line detection10 Nov 2025
- 2025Learning Isometric Embeddings of Road Networks using Multidimensional Scaling24 Apr 2025
- 2025Datasets for Lane Detection in Autonomous Driving: A Comprehensive Review11 Apr 2025
- 2024Anchor3DLane++: 3D Lane Detection via Sample-Adaptive Sparse 3D Anchor Regression22 Dec 2024
- 2024Monocular Lane Detection Based on Deep Learning: A Survey25 Nov 2024
- 2024Online Temporal Fusion for Vectorized Map Construction in Mapless Autonomous Driving1 Sep 2024
- 2024DV-3DLane: End-to-end Multi-modal 3D Lane Detection with Dual-view Representation23 Jun 2024
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlooks10 Apr 2024
- 2024Enhance DNN Adversarial Robustness and Efficiency via Injecting Noise to Non-Essential Neurons6 Feb 2024
- 2023Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detection6 Jan 2023
18 more
- 2022Row-wise LiDAR Lane Detection Network with Lane Correlation Refinement17 Oct 2022
- 2022BEV-LaneDet: a Simple and Effective 3D Lane Detection Baseline12 Oct 2022
- 2022WS-3D-Lane: Weakly Supervised 3D Lane Detection With 2D Lane Labels23 Sep 2022
- 2022M2-3DLaneNet: Exploring Multi-Modal 3D Lane Detection13 Sep 2022
- 2022Reconstruct from BEV: A 3D Lane Detection Approach based on Geometry Structure Prior21 Jun 2022
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detection30 Apr 2022
- 2022Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Tracking30 Mar 2022
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark21 Mar 2022
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraints31 Dec 2021
- 2021K-Lane: Lidar Lane Dataset and Benchmark for Urban Roads and Highways21 Oct 2021
- 2021HDMapNet: An Online HD Map Construction and Evaluation Framework13 Jul 2021
- 2021Lane Graph Estimation for Scene Understanding in Urban Driving1 May 2021
- 2021LaneAF: Robust Multi-Lane Detection with Affinity Fields22 Mar 2021
- 2021A novel multimodal fusion network based on a joint coding model for lane line segmentation20 Mar 2021
- 2021A Simple and Efficient Multi-task Network for 3D Object Detection and Road Understanding6 Mar 2021
- 2021Non-parametric Memory for Spatio-Temporal Segmentation of Construction Zones for Self-Driving18 Jan 2021
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plan18 Jan 2021
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Survey2 Jan 2021
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2023Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detectioncited by 48
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detectioncited by 44
- 2021LaneAF: Robust Multi-Lane Detection with Affinity Fieldscited by 41
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
- 2021Lane Graph Estimation for Scene Understanding in Urban Drivingcited by 18
- 2021A Simple and Efficient Multi-task Network for 3D Object Detection and Road Understandingcited by 17
- 2021K-Lane: Lidar Lane Dataset and Benchmark for Urban Roads and Highwayscited by 11
- 2022WS-3D-Lane: Weakly Supervised 3D Lane Detection With 2D Lane Labelscited by 9
12 most cited of 29 All 29 (JSON)
- 20263D Lane Detection with Odometry for High-Speed Vehicle Racing15 Jul 2026
- 2026Efficient Sequential Neural Network with Spatial-Temporal Attention and Linear LSTM for Robust Lane Detection Using Multi-Frame Images3 Feb 2026
- 2025Pandar128 dataset for lane line detection10 Nov 2025
- 2025Learning Isometric Embeddings of Road Networks using Multidimensional Scaling24 Apr 2025
- 2025Datasets for Lane Detection in Autonomous Driving: A Comprehensive Review11 Apr 2025
- 2024Anchor3DLane++: 3D Lane Detection via Sample-Adaptive Sparse 3D Anchor Regression22 Dec 2024
- 2024Monocular Lane Detection Based on Deep Learning: A Survey25 Nov 2024
- 2024DV-3DLane: End-to-end Multi-modal 3D Lane Detection with Dual-view Representation23 Jun 2024
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlooks10 Apr 2024
- 2024Enhance DNN Adversarial Robustness and Efficiency via Injecting Noise to Non-Essential Neurons6 Feb 2024
- 2023Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detection6 Jan 2023
- 2022Row-wise LiDAR Lane Detection Network with Lane Correlation Refinement17 Oct 2022
12 newest of 29 All 29 (JSON)