# Enhancing 3D Lane Detection and Topology Reasoning with 2D Lane Priors

arXiv: https://arxiv.org/abs/2406.03105 · HTML: https://mlsanity.com/paper/2406.03105/

## Key facts

- Cited by 21 papers in the map (data through 14 Oct 2026).
- Builds on 35 of its 41 references that are in the map.
- First posted on arXiv 5 Jun 2024.

## Builds on (most cited first, 30 of 35)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [End-to-End Object Detection with Transformers](https://mlsanity.com/paper/2005.12872/) (2020)
- [SGDR: Stochastic Gradient Descent with Warm Restarts](https://mlsanity.com/paper/1608.03983/) (2016)
- [Feature Pyramid Networks for Object Detection](https://mlsanity.com/paper/1612.03144/) (2016)
- [nuScenes: A multimodal dataset for autonomous driving](https://mlsanity.com/paper/1903.11027/) (2019)
- [Deformable DETR: Deformable Transformers for End-to-End Object Detection](https://mlsanity.com/paper/2010.04159/) (2020)
- [Scalability in Perception for Autonomous Driving: Waymo Open Dataset](https://mlsanity.com/paper/1912.04838/) (2019)
- [V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation](https://mlsanity.com/paper/1606.04797/) (2016)
- [BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers](https://mlsanity.com/paper/2203.17270/) (2022)
- [Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting](https://mlsanity.com/paper/2301.00493/) (2023)
- [PETR: Position Embedding Transformation for Multi-View 3D Object Detection](https://mlsanity.com/paper/2203.05625/) (2022)
- [PETRv2: A Unified Framework for 3D Perception from Multi-Camera Images](https://mlsanity.com/paper/2206.01256/) (2022)
- [MapTR: Structured Modeling and Learning for Online Vectorized HD Map Construction](https://mlsanity.com/paper/2208.14437/) (2022)
- [HDMapNet: An Online HD Map Construction and Evaluation Framework](https://mlsanity.com/paper/2107.06307/) (2021)
- [Cross-view Transformers for real-time Map-view Semantic Segmentation](https://mlsanity.com/paper/2205.02833/) (2022)
- [VectorMapNet: End-to-end Vectorized HD Map Learning](https://mlsanity.com/paper/2206.08920/) (2022)
- [MapTRv2: An End-to-End Framework for Online Vectorized HD Map Construction](https://mlsanity.com/paper/2308.05736/) (2023)
- [LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping](https://mlsanity.com/paper/2007.00258/) (2020)
- [Cross-view Semantic Segmentation for Sensing Surroundings](https://mlsanity.com/paper/1906.03560/) (2019)
- [PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark](https://mlsanity.com/paper/2203.11089/) (2022)
- [Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection](https://mlsanity.com/paper/2010.12035/) (2020)
- [Ultra Fast Structure-aware Deep Lane Detection](https://mlsanity.com/paper/2004.11757/) (2020)
- [3D-LaneNet: End-to-End 3D Multiple Lane Detection](https://mlsanity.com/paper/1811.10203/) (2018)
- [Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Images](https://mlsanity.com/paper/2110.01997/) (2021)
- [PivotNet: Vectorized Pivot Learning for End-to-end HD Map Construction](https://mlsanity.com/paper/2308.16477/) (2023)
- [OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mapping](https://mlsanity.com/paper/2304.10440/) (2023)
- [CLRNet: Cross Layer Refinement Network for Lane Detection](https://mlsanity.com/paper/2203.10350/) (2022)
- [Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformer](https://mlsanity.com/paper/2206.04584/) (2022)
- [Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detection](https://mlsanity.com/paper/2003.10656/) (2020)

## Built on by (most cited first, 21 of 21)

- [SMART: Advancing Scalable Map Priors for Driving Topology Reasoning](https://mlsanity.com/paper/2502.04329/) (2025)
- [PriorMapNet: Enhancing Online Vectorized HD Map Construction with Priors](https://mlsanity.com/paper/2408.08802/) (2024)
- [Topo2Seq: Enhanced Topology Reasoning via Topology Sequence Learning](https://mlsanity.com/paper/2502.08974/) (2025)
- [LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation](https://mlsanity.com/paper/2511.06272/) (2025)
- [TopoBDA: Towards Bezier Deformable Attention for Road Topology Understanding](https://mlsanity.com/paper/2412.18951/) (2024)
- [Uncertainty-Instructed Structure Injection for Generalizable HD Map Construction](https://mlsanity.com/paper/2503.23109/) (2025)
- [Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenes](https://mlsanity.com/paper/2506.13553/) (2025)
- [TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Driving](https://mlsanity.com/paper/2507.00709/) (2025)
- [Coherent Online Road Topology Estimation and Reasoning with Standard-Definition Maps](https://mlsanity.com/paper/2507.01397/) (2025)
- [RATopo: Improving Lane Topology Reasoning via Redundancy Assignment](https://mlsanity.com/paper/2508.15272/) (2025)
- [A Concise Survey on Lane Topology Reasoning for HD Mapping](https://mlsanity.com/paper/2504.01989/) (2025)
- [Inferring Driving Maps by Deep Learning-based Trail Map Extraction](https://mlsanity.com/paper/2505.10258/) (2025)
- [From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving](https://mlsanity.com/paper/2509.23641/) (2025)
- [Geometry-Grounded Unified 3D Perception for Autonomous Driving](https://mlsanity.com/paper/2608.13147/) (2026)
- [Control Map Distribution using Map Query Bank for Online Map Generation](https://mlsanity.com/paper/2504.03868/) (2025)
- [TopoMaskV3: 3D Mask Head with Dense Offset and Height Predictions for Road Topology Understanding](https://mlsanity.com/paper/2603.01558/) (2026)
- [Failure Modes for Deep Learning-Based Online Mapping: How to Measure and Address Them](https://mlsanity.com/paper/2603.19852/) (2026)
- [Unified Modeling of Lane and Lane Topology for Driving Scene Reasoning](https://mlsanity.com/paper/2605.08911/) (2026)
- [Generative Lane Topology Reasoning via Autoregressive Model with Geometry Prior](https://mlsanity.com/paper/2606.31814/) (2026)
- [HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priors](https://mlsanity.com/paper/2607.21281/) (2026)
- [Refine Connections, Close the Gap: A Reliable Enhancement Framework for Driving Scene Topology](https://mlsanity.com/paper/2610.11058/) (2026)

## Abstract (arXiv)

3D lane detection and topology reasoning are essential tasks in autonomous driving scenarios, requiring not only detecting the accurate 3D coordinates on lane lines, but also reasoning the relationship between lanes and traffic elements. Current vision-based methods, whether explicitly constructing BEV features or not, all establish the lane anchors/queries in 3D space while ignoring the 2D lane priors. In this study, we propose Topo2D, a novel framework based on Transformer, leveraging 2D lane instances to initialize 3D queries and 3D positional embeddings. Furthermore, we explicitly incorporate 2D lane features into the recognition of topology relationships among lane centerlines and between lane centerlines and traffic elements. Topo2D achieves 44.5% OLS on multi-view topology reasoning benchmark OpenLane-V2 and 62.6% F-Socre on single-view 3D lane detection benchmark OpenLane, exceeding the performance of existing state-of-the-art methods.