mlsanityData to 7 Oct 2026

3D Lane Detection from Front or Surround-View using Joint-Modeling & Matching

arXiv 2401.08036 ↗First posted 16 Jan 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

3D lanes offer a more comprehensive understanding of the road surface geometry than 2D lanes, thereby providing crucial references for driving decisions and trajectory planning. While many efforts aim to improve prediction accuracy, we recognize that an efficient network can bring results closer to lane modeling. However, if the modeling data is imprecise, the results might not accurately capture the real-world scenario. Therefore, accurate lane modeling is essential to align prediction results closely with the environment. This study centers on efficient and accurate lane modeling, proposing a joint modeling approach that combines Bezier curves and interpolation methods. Furthermore, based on this lane modeling approach, we developed a Global2Local Lane Matching method with Bezier Control-Point and Key-Point, which serve as a comprehensive solution that leverages hierarchical features with two mathematical models to ensure a precise match. We also introduce a novel 3D Spatial Encoder, representing an exploration of 3D surround-view lane detection research. The framework is suitable for front-view or surround-view 3D lane detection. By directly outputting the key points of lanes in 3D space, it overcomes the limitations of anchor-based methods, enabling accurate prediction of closed-loop or U-shaped lanes and effective adaptation to complex road conditions. This innovative method establishes a new benchmark in front-view 3D lane detection on the Openlane dataset and achieves competitive performance in surround-view 2D lane detection on the Argoverse2 dataset.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 16 Jan 2024.

Builds on

26 of 43 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  3. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  4. 2015Fast R-CNNcited by 2,930
  5. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  6. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  7. 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 539
  8. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
  9. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
  10. 2021Voxel Transformer for 3D Object Detectioncited by 247
  11. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
  12. 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
14 more
  1. 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
  2. 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 137
  3. 2022Vision-Centric BEV Perception: A Surveycited by 126
  4. 2020End-to-end Lane Shape Prediction with Transformerscited by 111
  5. 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 106
  6. 2022Rethinking Efficient Lane Detection via Curve Modelingcited by 87
  7. 2020Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detectioncited by 75
  8. 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
  9. 2020A Sim2Real Deep Learning Approach for the Transformation of Images from Multiple Vehicle-Mounted Cameras to a Semantically Segmented Image in Bird's Eye Viewcited by 71
  10. 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
  11. 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Imagescited by 48
  12. 2022CurveFormer: 3D Lane Detection by Curve Propagation with Curve Queries and Attentioncited by 40
  13. 20203D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representationcited by 32
  14. 2020SUPER: A Novel Lane Detection Systemcited by 10

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.