M2-3DLaneNet: Exploring Multi-Modal 3D Lane Detection
Not on the map. Why?
Abstract (arXiv)
Estimating accurate lane lines in 3D space remains challenging due to their sparse and slim nature. Previous works mainly focused on using images for 3D lane detection, leading to inherent projection error and loss of geometry information. To address these issues, we explore the potential of leveraging LiDAR for 3D lane detection, either as a standalone method or in combination with existing monocular approaches. In this paper, we propose M2-3DLaneNet to integrate complementary information from multiple sensors. Specifically, M2-3DLaneNet lifts 2D features into 3D space by incorporating geometry information from LiDAR data through depth completion. Subsequently, the lifted 2D features are further enhanced with LiDAR features through cross-modality BEV fusion. Extensive experiments on the large-scale OpenLane dataset demonstrate the effectiveness of M2-3DLaneNet, regardless of the range (75m or 100m).
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 39 of its 49 references that are in the map. First posted on arXiv 13 Sep 2022.
Builds on
39 of 49 references.
References · 39
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
27 more
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2019Learning Lightweight Lane Detection CNNs by Self Attention Distillationcited by 162
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 137
- 2018Towards End-to-End Lane Detection: an Instance Segmentation Approachcited by 129
- 2020Ultra Fast Structure-aware Deep Lane Detectioncited by 121
- 2020End-to-end Lane Shape Prediction with Transformerscited by 111
- 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 106
- 2018In Defense of Classical Image Processing: Fast Depth Completion on the CPUcited by 96
- 2020PolyLaneNet: Lane Estimation via Deep Polynomial Regressioncited by 95
- 2021CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolutioncited by 95
- 2022Rethinking Efficient Lane Detection via Curve Modelingcited by 87
- 2021YOLOP: You Only Look Once for Panoptic Driving Perceptioncited by 82
- 2022Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completioncited by 82
- 2022CLRNet: Cross Layer Refinement Network for Lane Detectioncited by 82
- 2020Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detectioncited by 75
- 2022AutoAlign: Pixel-Instance Feature Aggregation for Multi-Modal 3D Object Detectioncited by 70
- 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
- 2021Focus on Local: Detecting Lane Marker from Bottom Up via Key Pointcited by 65
- 2017VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognitioncited by 56
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detectioncited by 44
- 20203D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representationcited by 32
- 2019Deep Multi-Sensor Lane Detectioncited by 30
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
- 2022Laneformer: Object-aware Row-Column Transformers for Lane Detectioncited by 25
Built on by
Citing papers per year: 2024: 4; 2025: 2; 2026: 1.
7 papers.
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlookscited by 9
- 2024SparseFusion: Efficient Sparse Multi-Modal Fusion Framework for Long-Range 3D Perceptioncited by 8
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understandingcited by 5
- 2024Monocular Lane Detection Based on Deep Learning: A Surveycited by 4
- 2025GLane3D : Detecting Lanes with Graph of 3D Keypointscited by 3
- 2025Depth3DLane: Fusing Monocular 3D Lane Detection with Self-Supervised Monocular Depth Estimationcited by 0
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detectioncited by 0
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detection20 Mar 2026
- 2025Depth3DLane: Fusing Monocular 3D Lane Detection with Self-Supervised Monocular Depth Estimation18 Jul 2025
- 2025GLane3D : Detecting Lanes with Graph of 3D Keypoints31 Mar 2025
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understanding25 Dec 2024
- 2024Monocular Lane Detection Based on Deep Learning: A Survey25 Nov 2024
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlooks10 Apr 2024
- 2024SparseFusion: Efficient Sparse Multi-Modal Fusion Framework for Long-Range 3D Perception15 Mar 2024