mlsanityData to 7 Oct 2026

M2-3DLaneNet: Exploring Multi-Modal 3D Lane Detection

arXiv 2209.05996 ↗First posted 13 Sep 2022cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Estimating accurate lane lines in 3D space remains challenging due to their sparse and slim nature. Previous works mainly focused on using images for 3D lane detection, leading to inherent projection error and loss of geometry information. To address these issues, we explore the potential of leveraging LiDAR for 3D lane detection, either as a standalone method or in combination with existing monocular approaches. In this paper, we propose M2-3DLaneNet to integrate complementary information from multiple sensors. Specifically, M2-3DLaneNet lifts 2D features into 3D space by incorporating geometry information from LiDAR data through depth completion. Subsequently, the lifted 2D features are further enhanced with LiDAR features through cross-modality BEV fusion. Extensive experiments on the large-scale OpenLane dataset demonstrate the effectiveness of M2-3DLaneNet, regardless of the range (75m or 100m).

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 39 of its 49 references that are in the map. First posted on arXiv 13 Sep 2022.

Builds on

39 of 49 references.

References · 39

  1. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  4. 2017Squeeze-and-Excitation Networkscited by 4,763
  5. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  8. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  9. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  10. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  11. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  12. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
27 more
  1. 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
  2. 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
  3. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
  4. 2019Learning Lightweight Lane Detection CNNs by Self Attention Distillationcited by 162
  5. 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
  6. 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 137
  7. 2018Towards End-to-End Lane Detection: an Instance Segmentation Approachcited by 129
  8. 2020Ultra Fast Structure-aware Deep Lane Detectioncited by 121
  9. 2020End-to-end Lane Shape Prediction with Transformerscited by 111
  10. 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 106
  11. 2018In Defense of Classical Image Processing: Fast Depth Completion on the CPUcited by 96
  12. 2020PolyLaneNet: Lane Estimation via Deep Polynomial Regressioncited by 95
  13. 2021CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolutioncited by 95
  14. 2022Rethinking Efficient Lane Detection via Curve Modelingcited by 87
  15. 2021YOLOP: You Only Look Once for Panoptic Driving Perceptioncited by 82
  16. 2022Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completioncited by 82
  17. 2022CLRNet: Cross Layer Refinement Network for Lane Detectioncited by 82
  18. 2020Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detectioncited by 75
  19. 2022AutoAlign: Pixel-Instance Feature Aggregation for Multi-Modal 3D Object Detectioncited by 70
  20. 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
  21. 2021Focus on Local: Detecting Lane Marker from Bottom Up via Key Pointcited by 65
  22. 2017VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognitioncited by 56
  23. 2022ONCE-3DLanes: Building Monocular 3D Lane Detectioncited by 44
  24. 20203D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representationcited by 32
  25. 2019Deep Multi-Sensor Lane Detectioncited by 30
  26. 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
  27. 2022Laneformer: Object-aware Row-Column Transformers for Lane Detectioncited by 25

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 2; 2026: 1.

7 papers.