SparseLaneSTP: Leveraging Spatio-Temporal Priors with Sparse Transformers for 3D Lane Detection
Not on the map. Why?
Abstract (arXiv)
3D lane detection has emerged as a critical challenge in autonomous driving, encompassing identification and localization of lane markings and the 3D road surface. Conventional 3D methods detect lanes from dense birds-eye-viewed (BEV) features, though erroneous transformations often result in a poor feature representation misaligned with the true 3D road surface. While recent sparse lane detectors have surpassed dense BEV approaches, they completely disregard valuable lane-specific priors. Furthermore, existing methods fail to utilize historic lane observations, which yield the potential to resolve ambiguities in situations of poor visibility. To address these challenges, we present SparseLaneSTP, a novel method that integrates both geometric properties of the lane structure and temporal information into a sparse lane transformer. It introduces a new lane-specific spatio-temporal attention mechanism, a continuous lane representation tailored for sparse architectures as well as temporal regularization. Identifying weaknesses of existing 3D lane datasets, we also introduce a precise and consistent 3D lane dataset using a simple yet effective auto-labeling strategy. Our experimental section proves the benefits of our contributions and demonstrates state-of-the-art performance across all detection and error metrics on existing 3D lane detection benchmarks as well as on our novel dataset.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 44 of its 58 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
44 of 58 references.
References · 44
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
32 more
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2017Spatial As Deep: Spatial CNN for Traffic Scene Understandingcited by 187
- 2019Learning Lightweight Lane Detection CNNs by Self Attention Distillationcited by 162
- 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 162
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 138
- 2018Towards End-to-End Lane Detection: an Instance Segmentation Approachcited by 129
- 2020End-to-end Lane Shape Prediction with Transformerscited by 111
- 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 107
- 2020PolyLaneNet: Lane Estimation via Deep Polynomial Regressioncited by 95
- 2023Sparse4D v2: Recurrent Temporal Fusion with Sparse Modelcited by 93
- 2022Rethinking Efficient Lane Detection via Curve Modelingcited by 88
- 2020Key Points Estimation and Point Instance Segmentation Approach for Lane Detectioncited by 77
- 2020Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detectioncited by 75
- 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
- 2021Focus on Local: Detecting Lane Marker from Bottom Up via Key Pointcited by 65
- 2023Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detectioncited by 48
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detectioncited by 44
- 2023LATR: 3D Lane Detection from Monocular Images with Transformercited by 44
- 2019Robust Lane Detection from Continuous Driving Scenes Using Deep Neural Networkscited by 41
- 2022CurveFormer: 3D Lane Detection by Curve Propagation with Curve Queries and Attentioncited by 40
- 2015An Empirical Evaluation of Deep Learning on Highway Drivingcited by 35
- 2018EL-GAN: Embedding Loss Driven Generative Adversarial Networks for Lane Detectioncited by 35
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
- 2021Structure Guided Lane Detectioncited by 27
- 2022DETR4D: Direct Multi-View 3D Object Detection with Sparse Attentioncited by 21
- 2024LaneCPP: Continuous 3D Lane Detection using Physical Priorscited by 17
- 2019Lane Detection and Classification using Cascaded CNNscited by 14
- 2023GroupLane: End-to-End 3D Lane Detection with Channel-wise Groupingcited by 11
- 2025Rethinking Lanes and Points in Complex Scenarios for Monocular 3D Lane Detectioncited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Collaborative Learning for Semi-Supervised LiDAR Semantic Segmentationcited by 1
- 2026HSDF-Lane: Height-Aligned Signed Distance Field with Semantic Lane Prior for 3D Lane Detectioncited by 0
- 20263D Lane Detection with Odometry for High-Speed Vehicle Racingcited by 0
- 2026WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zonescited by 0
- 2026WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones16 Sep 2026
- 20263D Lane Detection with Odometry for High-Speed Vehicle Racing15 Jul 2026
- 2026HSDF-Lane: Height-Aligned Signed Distance Field with Semantic Lane Prior for 3D Lane Detection30 Jun 2026
- 2026Collaborative Learning for Semi-Supervised LiDAR Semantic Segmentation16 May 2026