Exploiting Sparse Semantic HD Maps for Self-Driving Vehicle Localization
Not on the map. Why?
Abstract (arXiv)
In this paper we propose a novel semantic localization algorithm that exploits multiple sensors and has precision on the order of a few centimeters. Our approach does not require detailed knowledge about the appearance of the world, and our maps require orders of magnitude less storage than maps utilized by traditional geometry- and LiDAR intensity-based localizers. This is important as self-driving cars need to operate in large environments. Towards this goal, we formulate the problem in a Bayesian filtering framework, and exploit lanes, traffic signs, as well as vehicle dynamics to localize robustly with respect to a sparse semantic map. We validate the effectiveness of our method on a new highway dataset consisting of 312km of roads. Our experiments show that the proposed approach is able to achieve 0.05m lateral accuracy and 1.12m longitudinal accuracy on average while taking up only 0.3% of the storage required by previous LiDAR intensity-based approaches.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 10; 2024: 3; 2025: 1.
24 papers.
Sort:
By area:
- 2022Learning from All Vehiclescited by 135
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2021MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Squarecited by 27
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Predictioncited by 22
- 2023Walking Your LiDOG: A Journey Through Multiple Domains for LiDAR Semantic Segmentationcited by 13
- 2022Online Pole Segmentation on Range Images for Long-term LiDAR Localization in Urban Environmentscited by 12
- 2022BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Imagescited by 12
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Mapscited by 11
- 2023Improving Online Lane Graph Extraction by Object-Lane Clusteringcited by 7
12 more
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
- 2021Coarse-to-fine Semantic Localization with HD Map for Autonomous Driving in Structural Scenescited by 5
- 2024Structure from Duplicates: Neural Inverse Graphics from a Pile of Objectscited by 5
- 2023Energy-Based Models for Cross-Modal Localization using Convolutional Transformerscited by 3
- 2024Translating Images to Road Network: A Sequence-to-Sequence Perspectivecited by 3
- 2023Why semantics matters: A deep study on semantic particle-filtering localization in a LiDAR semantic pole-mapcited by 2
- 2023Prior Based Online Lane Graph Extraction from Single Onboard Camera Imagecited by 2
- 2021Semantic Image Alignment for Vehicle Localizationcited by 1
- 2023Online Lane Graph Extraction from Onboard Videocited by 0
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehiclecited by 0
- 2024Robust Vehicle Localization and Tracking in Rain using Street Mapscited by 0
- 2025Robust Robotic Exploration and Mapping Using Generative Occupancy Map Synthesiscited by 0
- 2025Robust Robotic Exploration and Mapping Using Generative Occupancy Map Synthesis24 Jun 2025
- 2024Robust Vehicle Localization and Tracking in Rain using Street Maps2 Sep 2024
- 2024Translating Images to Road Network: A Sequence-to-Sequence Perspective13 Feb 2024
- 2024Structure from Duplicates: Neural Inverse Graphics from a Pile of Objects10 Jan 2024
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
- 2023Prior Based Online Lane Graph Extraction from Single Onboard Camera Image25 Jul 2023
- 2023Improving Online Lane Graph Extraction by Object-Lane Clustering20 Jul 2023
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Maps18 Jul 2023
- 2023Energy-Based Models for Cross-Modal Localization using Convolutional Transformers6 Jun 2023
- 2023Why semantics matters: A deep study on semantic particle-filtering localization in a LiDAR semantic pole-map23 May 2023
- 2023Walking Your LiDOG: A Journey Through Multiple Domains for LiDAR Semantic Segmentation23 Apr 2023
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matching4 Apr 2023
12 more
- 2023Online Lane Graph Extraction from Onboard Video3 Apr 2023
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Images10 Jan 2023
- 2022BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Images27 Nov 2022
- 2022Online Pole Segmentation on Range Images for Long-term LiDAR Localization in Urban Environments15 Aug 2022
- 2022Learning from All Vehicles22 Mar 2022
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Image19 Dec 2021
- 2021Semantic Image Alignment for Vehicle Localization8 Oct 2021
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Images5 Oct 2021
- 2021Coarse-to-fine Semantic Localization with HD Map for Autonomous Driving in Structural Scenes6 Jul 2021
- 2021MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Square7 Feb 2021
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Prediction17 Jan 2021
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Survey2 Jan 2021
- 2022Learning from All Vehiclescited by 135
- 2022Learning from All Vehicles22 Mar 2022
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2021MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Squarecited by 27
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Predictioncited by 22
- 2023Walking Your LiDOG: A Journey Through Multiple Domains for LiDAR Semantic Segmentationcited by 13
- 2022Online Pole Segmentation on Range Images for Long-term LiDAR Localization in Urban Environmentscited by 12
- 2022BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Imagescited by 12
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Mapscited by 11
- 2023Improving Online Lane Graph Extraction by Object-Lane Clusteringcited by 7
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
12 most cited of 23 All 23 (JSON)
- 2025Robust Robotic Exploration and Mapping Using Generative Occupancy Map Synthesis24 Jun 2025
- 2024Robust Vehicle Localization and Tracking in Rain using Street Maps2 Sep 2024
- 2024Translating Images to Road Network: A Sequence-to-Sequence Perspective13 Feb 2024
- 2024Structure from Duplicates: Neural Inverse Graphics from a Pile of Objects10 Jan 2024
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
- 2023Prior Based Online Lane Graph Extraction from Single Onboard Camera Image25 Jul 2023
- 2023Improving Online Lane Graph Extraction by Object-Lane Clustering20 Jul 2023
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Maps18 Jul 2023
- 2023Energy-Based Models for Cross-Modal Localization using Convolutional Transformers6 Jun 2023
- 2023Why semantics matters: A deep study on semantic particle-filtering localization in a LiDAR semantic pole-map23 May 2023
- 2023Walking Your LiDOG: A Journey Through Multiple Domains for LiDAR Semantic Segmentation23 Apr 2023
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matching4 Apr 2023
12 newest of 23 All 23 (JSON)