Topology Preserving Local Road Network Estimation from Single Onboard Camera Image
Not on the map. Why?
Abstract (arXiv)
Knowledge of the road network topology is crucial for autonomous planning and navigation. Yet, recovering such topology from a single image has only been explored in part. Furthermore, it needs to refer to the ground plane, where also the driving actions are taken. This paper aims at extracting the local road network topology, directly in the bird's-eye-view (BEV), all in a complex urban setting. The only input consists of a single onboard, forward looking camera image. We represent the road topology using a set of directed lane curves and their interactions, which are captured using their intersection points. To better capture topology, we introduce the concept of minimal cycles and their covers. A minimal cycle is the smallest cycle formed by the directed curve segments (between two intersections). The cover is a set of curves whose segments are involved in forming a minimal cycle. We first show that the covers suffice to uniquely represent the road topology. The covers are then used to supervise deep neural networks, along with the lane curve supervision. These learn to predict the road topology from a single input image. The results on the NuScenes and Argoverse benchmarks are significantly better than those obtained with baselines. Code: https://github.com/ybarancan/TopologicalLaneGraph
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 36 of its 44 references that are in the map. First posted on arXiv 19 Dec 2021.
Builds on
36 of 44 references.
References · 36
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
- 2019Learning by Cheatingcited by 383
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
- 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 174
24 more
- 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
- 2018Towards End-to-End Lane Detection: an Instance Segmentation Approachcited by 129
- 2018Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++cited by 120
- 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
- 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 107
- 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2020HDNET: Exploiting HD Maps for 3D Object Detectioncited by 78
- 2020Key Points Estimation and Point Instance Segmentation Approach for Lane Detectioncited by 77
- 2020FISHING Net: Future Inference of Semantic Heatmaps In Gridscited by 55
- 2020MonoLayout: Amodal scene layout from a single imagecited by 49
- 2020DAGMapper: Learning to Map by Discovering Lane Topologycited by 49
- 2020Hierarchical Recurrent Attention Networks for Structured Online Mapscited by 38
- 2019End-to-end Lane Detection through Differentiable Least-Squares Fittingcited by 36
- 2020Convolutional Recurrent Network for Road Boundary Extractioncited by 33
- 20203D-LaneNet+: Anchor Free Lane Detection using a Semi-Local Representationcited by 32
- 2019Exploiting Sparse Semantic HD Maps for Self-Driving Vehicle Localizationcited by 24
- 2019Leveraging Crowdsourced GPS Data for Road Extraction from Aerial Imagerycited by 23
- 2018Real-time Dynamic Object Detection for Autonomous Driving using Prior 3D-Mapscited by 17
- 2020Probabilistic Semantic Mapping for Urban Autonomous Driving Applicationscited by 15
- 2021Decoder Fusion RNN: Context and Interaction Aware Decoders for Trajectory Predictioncited by 12
- 2018Iterative Deep Learning for Road Topology Extractioncited by 9
- 2020End-to-End Deep Structured Models for Drawing Crosswalkscited by 9
- 2020Action Sequence Predictions of Vehicles in Urban Environments using Map and Social Contextcited by 8
Built on by
Citing papers per year: 2022: 3; 2023: 13; 2024: 12; 2025: 6.
34 papers.
Sort:
By area:
- 2022Vision-Centric BEV Perception: A Surveycited by 126
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Drivingcited by 57
- 2023Graph-based Topology Reasoning for Driving Scenescited by 54
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2024T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Drivingcited by 35
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
- 2024Enhancing Vectorized Map Perception with Historical Rasterized Mapscited by 29
- 2023Learning and Aggregating Lane Graphs for Urban Automated Drivingcited by 20
- 2023InsMapper: Exploring Inner-instance Information for Vectorized HD Mappingcited by 19
- 2024RoadPainter: Points Are Ideal Navigators for Topology transformERcited by 17
22 more
- 2022CenterLineDet: CenterLine Graph Detection for Road Lanes with Vehicle-mounted Sensors by Transformer for HD Map Generationcited by 15
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Constructioncited by 10
- 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Drivingcited by 9
- 2023Improving Online Lane Graph Extraction by Object-Lane Clusteringcited by 7
- 2024LaneGraph2Seq: Lane Topology Extraction with Language Model via Vertex-Edge Encoding and Connectivity Enhancementcited by 7
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
- 2023Mind the map! Accounting for existing map information when estimating online HDMaps from sensorcited by 6
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generationcited by 6
- 2023TopoMask: Instance-Mask-Based Formulation for the Road Topology Problem via Transformer-Based Architecturecited by 5
- 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Modelscited by 5
- 2024Continuity Preserving Online CenterLine Graph Learningcited by 5
- 2024Enhancing Lane Segment Perception and Topology Reasoning with Crowdsourcing Trajectory Priorscited by 5
- 2024GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Constructioncited by 4
- 2024Monocular Lane Detection Based on Deep Learning: A Surveycited by 4
- 2024Translating Images to Road Network: A Sequence-to-Sequence Perspectivecited by 3
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenescited by 3
- 2023URA*: Uncertainty-aware Path Planning using Image-based Aerial-to-Ground Traversability Estimation for Off-road Environmentscited by 2
- 2025A Concise Survey on Lane Topology Reasoning for HD Mappingcited by 2
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Drivingcited by 2
- 2023A Dual-Perspective Approach to Evaluating Feature Attribution Methodscited by 1
- 2023Online Lane Graph Extraction from Onboard Videocited by 0
- 2025Fine-Grained Representation for Lane Topology Reasoningcited by 0
- 2025Fine-Grained Representation for Lane Topology Reasoning16 Nov 2025
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation9 Nov 2025
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving28 Sep 2025
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenes16 Jun 2025
- 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Driving23 May 2025
- 2025A Concise Survey on Lane Topology Reasoning for HD Mapping31 Mar 2025
- 2024T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Driving28 Nov 2024
- 2024Enhancing Lane Segment Perception and Topology Reasoning with Crowdsourcing Trajectory Priors26 Nov 2024
- 2024Monocular Lane Detection Based on Deep Learning: A Survey25 Nov 2024
- 2024GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction13 Sep 2024
- 2024Enhancing Vectorized Map Perception with Historical Rasterized Maps1 Sep 2024
- 2024RoadPainter: Points Are Ideal Navigators for Topology transformER22 Jul 2024
22 more
- 2024Continuity Preserving Online CenterLine Graph Learning16 Jul 2024
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenes23 May 2024
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Construction9 May 2024
- 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Models1 May 2024
- 2024Translating Images to Road Network: A Sequence-to-Sequence Perspective13 Feb 2024
- 2024LaneGraph2Seq: Lane Topology Extraction with Language Model via Vertex-Edge Encoding and Connectivity Enhancement31 Jan 2024
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving26 Dec 2023
- 2023Mind the map! Accounting for existing map information when estimating online HDMaps from sensor17 Nov 2023
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoning10 Oct 2023
- 2023URA*: Uncertainty-aware Path Planning using Image-based Aerial-to-Ground Traversability Estimation for Off-road Environments15 Sep 2023
- 2023A Dual-Perspective Approach to Evaluating Feature Attribution Methods17 Aug 2023
- 2023InsMapper: Exploring Inner-instance Information for Vectorized HD Mapping16 Aug 2023
- 2023Improving Online Lane Graph Extraction by Object-Lane Clustering20 Jul 2023
- 2023TopoMask: Instance-Mask-Based Formulation for the Road Topology Problem via Transformer-Based Architecture8 Jun 2023
- 2023Graph-based Topology Reasoning for Driving Scenes11 Apr 2023
- 2023Online Lane Graph Extraction from Onboard Video3 Apr 2023
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Construction15 Mar 2023
- 2023Learning and Aggregating Lane Graphs for Urban Automated Driving13 Feb 2023
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Images10 Jan 2023
- 2022Behavioral Intention Prediction in Driving Scenes: A Survey1 Nov 2022
- 2022CenterLineDet: CenterLine Graph Detection for Road Lanes with Vehicle-mounted Sensors by Transformer for HD Map Generation16 Sep 2022
- 2022Vision-Centric BEV Perception: A Survey4 Aug 2022
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Drivingcited by 57
- 2023Graph-based Topology Reasoning for Driving Scenescited by 54
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenescited by 3
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Drivingcited by 2
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving28 Sep 2025
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenes16 Jun 2025
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving26 Dec 2023
- 2023Graph-based Topology Reasoning for Driving Scenes11 Apr 2023
- 2022Vision-Centric BEV Perception: A Surveycited by 126
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2024T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Drivingcited by 35
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
- 2024Enhancing Vectorized Map Perception with Historical Rasterized Mapscited by 29
- 2023Learning and Aggregating Lane Graphs for Urban Automated Drivingcited by 20
- 2023InsMapper: Exploring Inner-instance Information for Vectorized HD Mappingcited by 19
- 2024RoadPainter: Points Are Ideal Navigators for Topology transformERcited by 17
- 2022CenterLineDet: CenterLine Graph Detection for Road Lanes with Vehicle-mounted Sensors by Transformer for HD Map Generationcited by 15
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Constructioncited by 10
12 most cited of 29 All 29 (JSON)
- 2025Fine-Grained Representation for Lane Topology Reasoning16 Nov 2025
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation9 Nov 2025
- 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Driving23 May 2025
- 2025A Concise Survey on Lane Topology Reasoning for HD Mapping31 Mar 2025
- 2024T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Driving28 Nov 2024
- 2024Enhancing Lane Segment Perception and Topology Reasoning with Crowdsourcing Trajectory Priors26 Nov 2024
- 2024Monocular Lane Detection Based on Deep Learning: A Survey25 Nov 2024
- 2024GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction13 Sep 2024
- 2024Enhancing Vectorized Map Perception with Historical Rasterized Maps1 Sep 2024
- 2024RoadPainter: Points Are Ideal Navigators for Topology transformER22 Jul 2024
- 2024Continuity Preserving Online CenterLine Graph Learning16 Jul 2024
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenes23 May 2024
12 newest of 29 All 29 (JSON)