Learning to Localize Using a LiDAR Intensity Map
Not on the map. Why?
Abstract (arXiv)
In this paper we propose a real-time, calibration-agnostic and effective localization system for self-driving cars. Our method learns to embed the online LiDAR sweeps and intensity map into a joint deep embedding space. Localization is then conducted through an efficient convolutional matching between the embeddings. Our full system can operate in real-time at 15Hz while achieving centimeter level accuracy across different LiDAR sensors and environments. Our experiments illustrate the performance of the proposed approach over a large-scale dataset consisting of over 4000km of driving.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 11; 2024: 0; 2025: 4.
28 papers.
Sort:
By area:
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022Visual Cross-View Metric Localization with Dense Uncertainty Estimatescited by 48
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
- 2023Convolutional Cross-View Pose Estimationcited by 36
- 2022PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Trainingcited by 24
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Predictioncited by 22
- 2023MapPrior: Bird's-Eye View Map Layout Estimation with Generative Modelscited by 21
- 2021Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimationcited by 16
- 2023View Consistent Purification for Accurate Cross-View Localizationcited by 15
- 2021Graph-based Thermal-Inertial SLAM with Probabilistic Neural Networkscited by 12
- 2021MinkLoc3D-SI: 3D LiDAR place recognition with sparse convolutions, spherical coordinates, and intensitycited by 12
16 more
- 2022BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Imagescited by 12
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Mapscited by 11
- 2023C-BEV: Contrastive Bird's Eye View Training for Cross-View Image Retrieval and 3-DoF Pose Estimationcited by 10
- 2021Robust Place Recognition using an Imaging Lidarcited by 9
- 2022DICP: Doppler Iterative Closest Point Algorithmcited by 8
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
- 2023GRID: A Platform for General Robot Intelligence Developmentcited by 6
- 2023RaLF: Flow-based Global and Metric Radar Localization in LiDAR Mapscited by 5
- 2025U-ViLAR: Uncertainty-Aware Visual Localization for Autonomous Driving via Differentiable Association and Registrationcited by 5
- 2023Energy-Based Models for Cross-Modal Localization using Convolutional Transformerscited by 3
- 2021(Just) A Spoonful of Refinements Helps the Registration Error Go Downcited by 2
- 2022View-Invariant Localization using Semantic Objects in Changing Environmentscited by 2
- 2025DiffVL: Diffusion-Based Visual Localization on 2D Maps via BEV-Conditioned GPS Denoisingcited by 2
- 2025Evaluating Global Geo-alignment for Precision Learned Autonomous Vehicle Localization using Aerial Datacited by 1
- 2022On the Application of Efficient Neural Mapping to Real-Time Indoor Localisation for Unmanned Ground Vehiclescited by 0
- 2025GroundLoc: Efficient Large-Scale Outdoor LiDAR-Only Localizationcited by 0
- 2025GroundLoc: Efficient Large-Scale Outdoor LiDAR-Only Localization28 Oct 2025
- 2025DiffVL: Diffusion-Based Visual Localization on 2D Maps via BEV-Conditioned GPS Denoising18 Sep 2025
- 2025U-ViLAR: Uncertainty-Aware Visual Localization for Autonomous Driving via Differentiable Association and Registration6 Jul 2025
- 2025Evaluating Global Geo-alignment for Precision Learned Autonomous Vehicle Localization using Aerial Data18 Mar 2025
- 2023C-BEV: Contrastive Bird's Eye View Training for Cross-View Image Retrieval and 3-DoF Pose Estimation13 Dec 2023
- 2023GRID: A Platform for General Robot Intelligence Development2 Oct 2023
- 2023RaLF: Flow-based Global and Metric Radar Localization in LiDAR Maps18 Sep 2023
- 2023MapPrior: Bird's-Eye View Map Layout Estimation with Generative Models24 Aug 2023
- 2023View Consistent Purification for Accurate Cross-View Localization16 Aug 2023
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Maps18 Jul 2023
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understanding8 Jun 2023
- 2023Energy-Based Models for Cross-Modal Localization using Convolutional Transformers6 Jun 2023
16 more
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matching4 Apr 2023
- 2023Convolutional Cross-View Pose Estimation9 Mar 2023
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Images10 Jan 2023
- 2022BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Images27 Nov 2022
- 2022On the Application of Efficient Neural Mapping to Real-Time Indoor Localisation for Unmanned Ground Vehicles9 Nov 2022
- 2022View-Invariant Localization using Semantic Objects in Changing Environments28 Sep 2022
- 2022PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training22 Sep 2022
- 2022Visual Cross-View Metric Localization with Dense Uncertainty Estimates17 Aug 2022
- 2022DICP: Doppler Iterative Closest Point Algorithm28 Jan 2022
- 2021MinkLoc3D-SI: 3D LiDAR place recognition with sparse convolutions, spherical coordinates, and intensity13 Dec 2021
- 2021(Just) A Spoonful of Refinements Helps the Registration Error Go Down6 Aug 2021
- 2021Graph-based Thermal-Inertial SLAM with Probabilistic Neural Networks15 Apr 2021
- 2021Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimation3 Mar 2021
- 2021Robust Place Recognition using an Imaging Lidar3 Mar 2021
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Prediction17 Jan 2021
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Survey2 Jan 2021
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022Visual Cross-View Metric Localization with Dense Uncertainty Estimatescited by 48
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
- 2023Convolutional Cross-View Pose Estimationcited by 36
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Predictioncited by 22
- 2023MapPrior: Bird's-Eye View Map Layout Estimation with Generative Modelscited by 21
- 2021Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimationcited by 16
- 2023View Consistent Purification for Accurate Cross-View Localizationcited by 15
- 2021Graph-based Thermal-Inertial SLAM with Probabilistic Neural Networkscited by 12
- 2021MinkLoc3D-SI: 3D LiDAR place recognition with sparse convolutions, spherical coordinates, and intensitycited by 12
- 2022BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Imagescited by 12
12 most cited of 26 All 26 (JSON)
- 2025GroundLoc: Efficient Large-Scale Outdoor LiDAR-Only Localization28 Oct 2025
- 2025U-ViLAR: Uncertainty-Aware Visual Localization for Autonomous Driving via Differentiable Association and Registration6 Jul 2025
- 2025Evaluating Global Geo-alignment for Precision Learned Autonomous Vehicle Localization using Aerial Data18 Mar 2025
- 2023C-BEV: Contrastive Bird's Eye View Training for Cross-View Image Retrieval and 3-DoF Pose Estimation13 Dec 2023
- 2023GRID: A Platform for General Robot Intelligence Development2 Oct 2023
- 2023RaLF: Flow-based Global and Metric Radar Localization in LiDAR Maps18 Sep 2023
- 2023MapPrior: Bird's-Eye View Map Layout Estimation with Generative Models24 Aug 2023
- 2023View Consistent Purification for Accurate Cross-View Localization16 Aug 2023
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Maps18 Jul 2023
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understanding8 Jun 2023
- 2023Energy-Based Models for Cross-Modal Localization using Convolutional Transformers6 Jun 2023
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matching4 Apr 2023
12 newest of 26 All 26 (JSON)