Unified Modeling of Lane and Lane Topology for Driving Scene Reasoning
Not on the map. Why?
Abstract (arXiv)
Autonomous vehicles need to perceive not only physical elements in the driving scene, such as lane lines and traffic lights, but also logical elements like lane centerlines and their topology. Existing lane topology reasoning methods typically follow a reasoning-by-detection paradigm, where lane topological relationships are primarily derived from lane detection results. In this paper, we propose an innovative method called Unified Modeling of Lane and Lane Topology (UniTopo), which represents the topological relationships between lanes as connected lanes, encompassing predecessor lanes, successor lanes, and their interconnections. This unified representation of lanes and lane topology allows us to simultaneously obtain both the positions and topological information of lanes within a shared perception pipeline, establishing a new paradigm for directly perceiving lane topology from original image features. We validate our method on the driving scene reasoning benchmark OpenLane-V2, which consists of two subsets, built based on Argoverse2 and nuScenes, respectively. Our method achieves TOP_ll of 30.1% and 31.8% on the two subsets, significantly surpassing the existing state-of-the-art method T^2SG by 6.0% and 8.6%.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 56 of its 69 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
56 of 69 references.
References · 56
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
38 more
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2018Taking A Closer Look at Domain Shift: Category-level Adversaries for Semantics Consistent Domain Adaptationcited by 295
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 173
- 2022DETRs with Hybrid Matchingcited by 149
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 143
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 137
- 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 106
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2022Group DETR: Fast DETR Training with Group-Wise One-to-Many Assignmentcited by 96
- 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
- 2022CLRNet: Cross Layer Refinement Network for Lane Detectioncited by 82
- 2022Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformercited by 80
- 2020Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detectioncited by 75
- 2018Attentive Relational Networks for Mapping Images to Scene Graphscited by 72
- 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Drivingcited by 57
- 2023Graph-based Topology Reasoning for Driving Scenescited by 53
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2023Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detectioncited by 48
- 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
- 2023LATR: 3D Lane Detection from Monocular Images with Transformercited by 44
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2024T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Drivingcited by 35
- 20203D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representationcited by 32
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
- 2023SGFormer: Semantic Graph Transformer for Point Cloud-based 3D Scene Graph Generationcited by 27
- 2021VIL-100: A New Dataset and A Baseline Model for Video Instance Lane Detectioncited by 21
- 2024Enhancing 3D Lane Detection and Topology Reasoning with 2D Lane Priorscited by 21
- 2024RoadPainter: Points Are Ideal Navigators for Topology transformERcited by 17
- 2022CenterLineDet: CenterLine Graph Detection for Road Lanes with Vehicle-mounted Sensors by Transformer for HD Map Generationcited by 15
- 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generationcited by 14
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.