Rethinking Lanes and Points in Complex Scenarios for Monocular 3D Lane Detection
Not on the map. Why?
Abstract (arXiv)
Monocular 3D lane detection is a fundamental task in autonomous driving. Although sparse-point methods lower computational load and maintain high accuracy in complex lane geometries, current methods fail to fully leverage the geometric structure of lanes in both lane geometry representations and model design. In lane geometry representations, we present a theoretical analysis alongside experimental validation to verify that current sparse lane representation methods contain inherent flaws, resulting in potential errors of up to 20 m, which raise significant safety concerns for driving. To address this issue, we propose a novel patching strategy to completely represent the full lane structure. To enable existing models to match this strategy, we introduce the EndPoint head (EP-head), which adds a patching distance to endpoints. The EP-head enables the model to predict more complete lane representations even with fewer preset points, effectively addressing existing limitations and paving the way for models that are faster and require fewer parameters in the future. In model design, to enhance the model's perception of lane structures, we propose the PointLane attention (PL-attention), which incorporates prior geometric knowledge into the attention mechanism. Extensive experiments demonstrate the effectiveness of the proposed methods on various state-of-the-art models. For instance, in terms of the overall F1-score, our methods improve Persformer by 4.4 points, Anchor3DLane by 3.2 points, and LATR by 2.8 points. The code will be available soon.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 51 of its 58 references that are in the map. First posted on arXiv 8 Mar 2025.
Builds on
51 of 58 references.
References · 51
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017Mask R-CNNcited by 7,259
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
38 more
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
- 2019Learning Lightweight Lane Detection CNNs by Self Attention Distillationcited by 162
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
- 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 137
- 2018Towards End-to-End Lane Detection: an Instance Segmentation Approachcited by 129
- 2020Ultra Fast Structure-aware Deep Lane Detectioncited by 121
- 2019HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarizationcited by 120
- 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 106
- 2020PolyLaneNet: Lane Estimation via Deep Polynomial Regressioncited by 95
- 2021CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolutioncited by 95
- 2022Rethinking Efficient Lane Detection via Curve Modelingcited by 87
- 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 84
- 2022CLRNet: Cross Layer Refinement Network for Lane Detectioncited by 82
- 2020RESA: Recurrent Feature-Shift Aggregator for Lane Detectioncited by 77
- 2020Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detectioncited by 75
- 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
- 2021Focus on Local: Detecting Lane Marker from Bottom Up via Key Pointcited by 65
- 2023Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detectioncited by 48
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detectioncited by 44
- 2023LATR: 3D Lane Detection from Monocular Images with Transformercited by 44
- 2022CurveFormer: 3D Lane Detection by Curve Propagation with Curve Queries and Attentioncited by 40
- 2022Ultra Fast Deep Lane Detection with Hybrid Anchor Driven Ordinal Classificationcited by 39
- 2019End-to-end Lane Detection through Differentiable Least-Squares Fittingcited by 36
- 2015An Empirical Evaluation of Deep Learning on Highway Drivingcited by 35
- 2021Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modelingcited by 35
- 20203D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representationcited by 32
- 2022Eigenlanes: Data-Driven Lane Descriptors for Structurally Diverse Lanescited by 32
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
- 2022Laneformer: Object-aware Row-Column Transformers for Lane Detectioncited by 25
- 2023MachMap: End-to-End Vectorized Solution for Compact HD-Map Constructioncited by 17
- 2024LaneCPP: Continuous 3D Lane Detection using Physical Priorscited by 17
- 2023GroupLane: End-to-End 3D Lane Detection with Channel-wise Groupingcited by 11
- 2020SUPER: A Novel Lane Detection Systemcited by 10
- 2024CurveFormer++: 3D Lane Detection by Curve Propagation with Temporal Curve Queries and Attentioncited by 10
- 2024Monocular 3D lane detection for Autonomous Driving: Recent Achievements, Challenges, and Outlookscited by 9
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.