Hierarchical Recurrent Attention Networks for Structured Online Maps
Not on the map. Why?
Abstract (arXiv)
In this paper, we tackle the problem of online road network extraction from sparse 3D point clouds. Our method is inspired by how an annotator builds a lane graph, by first identifying how many lanes there are and then drawing each one in turn. We develop a hierarchical recurrent network that attends to initial regions of a lane boundary and traces them out completely by outputting a structured polyline. We also propose a novel differentiable loss function that measures the deviation of the edges of the ground truth polylines and their predictions. This is more suitable than distances on vertices, as there exists many ways to draw equivalent polylines. We demonstrate the effectiveness of our method on a 90 km stretch of highway, and show that we can recover the right topology 92% of the time.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 7; 2023: 9; 2024: 4; 2025: 2.
38 papers.
Sort:
By area:
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detectioncited by 44
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
- 2022E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentationcited by 27
- 2022RNGDet: Road Network Graph Detection by Transformer in Aerial Imagescited by 26
- 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detectioncited by 25
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
26 more
- 2022RNGDet++: Road Network Graph Detection by Transformer with Instance Segmentation and Multi-scale Features Enhancementcited by 24
- 2021iCurb: Imitation Learning-based Detection of Road Curbs using Aerial Images for Autonomous Drivingcited by 21
- 2023Learning and Aggregating Lane Graphs for Urban Automated Drivingcited by 20
- 2021Topo-boundary: A Benchmark Dataset on Topological Road-boundary Detection Using Aerial Images for Autonomous Drivingcited by 19
- 2023InsMapper: Exploring Inner-instance Information for Vectorized HD Mappingcited by 19
- 2021Lane Graph Estimation for Scene Understanding in Urban Drivingcited by 18
- 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Constructioncited by 16
- 2022CenterLineDet: CenterLine Graph Detection for Road Lanes with Vehicle-mounted Sensors by Transformer for HD Map Generationcited by 15
- 2021csBoundary: City-scale Road-boundary Detection in Aerial Images for High-definition Mapscited by 12
- 2021CP-loss: Connectivity-preserving Loss for Road Curb Detection in Autonomous Driving with Aerial Imagescited by 9
- 2021VideoClick: Video Object Segmentation with a Single Clickcited by 8
- 2023Improving Online Lane Graph Extraction by Object-Lane Clusteringcited by 7
- 2021A Scenario-Based Platform for Testing Autonomous Vehicle Behavior Prediction Models in Simulationcited by 6
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
- 2024Continuity Preserving Online CenterLine Graph Learningcited by 5
- 2021Hierarchical Road Topology Learning for Urban Map-less Drivingcited by 4
- 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Modelscited by 4
- 2023Learning to Predict Navigational Patterns from Partial Observationscited by 3
- 2021Learning a Model for Inferring a Spatial Road Lane Network Graph using Self-Supervisioncited by 2
- 2023Prior Based Online Lane Graph Extraction from Single Onboard Camera Imagecited by 2
- 2024Flexible 3D Lane Detection by Hierarchical Shape MatchingFlexible 3D Lane Detection by Hierarchical Shape Matchingcited by 2
- 2024MeasureNet: Measurement Based Celiac Disease Identificationcited by 1
- 2025Learning Isometric Embeddings of Road Networks using Multidimensional Scalingcited by 1
- 2021End-to-End Segmentation via Patch-wise Polygons Predictioncited by 0
- 2023Online Lane Graph Extraction from Onboard Videocited by 0
- 2025Monocular 3D Lane Detection via Structure Uncertainty-Aware Network with Curve-Point Queriescited by 0
- 2025Monocular 3D Lane Detection via Structure Uncertainty-Aware Network with Curve-Point Queries17 Nov 2025
- 2025Learning Isometric Embeddings of Road Networks using Multidimensional Scaling24 Apr 2025
- 2024MeasureNet: Measurement Based Celiac Disease Identification2 Dec 2024
- 2024Flexible 3D Lane Detection by Hierarchical Shape MatchingFlexible 3D Lane Detection by Hierarchical Shape Matching13 Aug 2024
- 2024Continuity Preserving Online CenterLine Graph Learning16 Jul 2024
- 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Models1 May 2024
- 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Construction20 Oct 2023
- 2023InsMapper: Exploring Inner-instance Information for Vectorized HD Mapping16 Aug 2023
- 2023Prior Based Online Lane Graph Extraction from Single Onboard Camera Image25 Jul 2023
- 2023Improving Online Lane Graph Extraction by Object-Lane Clustering20 Jul 2023
- 2023Learning to Predict Navigational Patterns from Partial Observations26 Apr 2023
- 2023Online Lane Graph Extraction from Onboard Video3 Apr 2023
26 more
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Review2 Mar 2023
- 2023Learning and Aggregating Lane Graphs for Urban Automated Driving13 Feb 2023
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Images10 Jan 2023
- 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detection14 Dec 2022
- 2022RNGDet++: Road Network Graph Detection by Transformer with Instance Segmentation and Multi-scale Features Enhancement21 Sep 2022
- 2022CenterLineDet: CenterLine Graph Detection for Road Lanes with Vehicle-mounted Sensors by Transformer for HD Map Generation16 Sep 2022
- 2022VectorMapNet: End-to-end Vectorized HD Map Learning17 Jun 2022
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detection30 Apr 2022
- 2022E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentation8 Mar 2022
- 2022RNGDet: Road Network Graph Detection by Transformer in Aerial Images16 Feb 2022
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraints31 Dec 2021
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Image19 Dec 2021
- 2021End-to-End Segmentation via Patch-wise Polygons Prediction5 Dec 2021
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Prediction29 Nov 2021
- 2021csBoundary: City-scale Road-boundary Detection in Aerial Images for High-definition Maps11 Nov 2021
- 2021A Scenario-Based Platform for Testing Autonomous Vehicle Behavior Prediction Models in Simulation28 Oct 2021
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Images5 Oct 2021
- 2021CP-loss: Connectivity-preserving Loss for Road Curb Detection in Autonomous Driving with Aerial Images26 Jul 2021
- 2021Learning a Model for Inferring a Spatial Road Lane Network Graph using Self-Supervision5 Jul 2021
- 2021Lane Graph Estimation for Scene Understanding in Urban Driving1 May 2021
- 2021Hierarchical Road Topology Learning for Urban Map-less Driving31 Mar 2021
- 2021Topo-boundary: A Benchmark Dataset on Topological Road-boundary Detection Using Aerial Images for Autonomous Driving31 Mar 2021
- 2021iCurb: Imitation Learning-based Detection of Road Curbs using Aerial Images for Autonomous Driving31 Mar 2021
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plan18 Jan 2021
- 2021VideoClick: Video Object Segmentation with a Single Click16 Jan 2021
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Survey2 Jan 2021
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022ONCE-3DLanes: Building Monocular 3D Lane Detectioncited by 44
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2021Learning to Predict 3D Lane Shape and Camera Pose from a Single Image via Geometry Constraintscited by 30
- 2022E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentationcited by 27
- 2022RNGDet: Road Network Graph Detection by Transformer in Aerial Imagescited by 26
- 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detectioncited by 25
- 2022RNGDet++: Road Network Graph Detection by Transformer with Instance Segmentation and Multi-scale Features Enhancementcited by 24
12 most cited of 35 All 35 (JSON)
- 2025Monocular 3D Lane Detection via Structure Uncertainty-Aware Network with Curve-Point Queries17 Nov 2025
- 2025Learning Isometric Embeddings of Road Networks using Multidimensional Scaling24 Apr 2025
- 2024MeasureNet: Measurement Based Celiac Disease Identification2 Dec 2024
- 2024Flexible 3D Lane Detection by Hierarchical Shape MatchingFlexible 3D Lane Detection by Hierarchical Shape Matching13 Aug 2024
- 2024Continuity Preserving Online CenterLine Graph Learning16 Jul 2024
- 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Construction20 Oct 2023
- 2023InsMapper: Exploring Inner-instance Information for Vectorized HD Mapping16 Aug 2023
- 2023Prior Based Online Lane Graph Extraction from Single Onboard Camera Image25 Jul 2023
- 2023Improving Online Lane Graph Extraction by Object-Lane Clustering20 Jul 2023
- 2023Learning to Predict Navigational Patterns from Partial Observations26 Apr 2023
- 2023Online Lane Graph Extraction from Onboard Video3 Apr 2023
- 2023Learning and Aggregating Lane Graphs for Urban Automated Driving13 Feb 2023
12 newest of 35 All 35 (JSON)