# OneShot Global Localization: Instant LiDAR-Visual Pose Estimation

arXiv: https://arxiv.org/abs/2003.13279 · HTML: https://mlsanity.com/paper/2003.13279/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Mar 2020.

## Built on by (most cited first, 9 of 9)

- [AdaFusion: Visual-LiDAR Fusion with Adaptive Weights for Place Recognition](https://mlsanity.com/paper/2111.11739/) (2021)
- [LIP-Loc: LiDAR Image Pretraining for Cross-Modal Localization](https://mlsanity.com/paper/2312.16648/) (2023)
- [BVMatch: Lidar-based Place Recognition Using Bird's-eye View Images](https://mlsanity.com/paper/2109.00317/) (2021)
- [(LC)2: LiDAR-Camera Loop Constraints For Cross-Modal Place Recognition](https://mlsanity.com/paper/2304.08660/) (2023)
- [Visual Localization in 3D Maps: Comparing Point Cloud, Mesh, and NeRF Representations](https://mlsanity.com/paper/2408.11966/) (2024)
- [Energy-Based Models for Cross-Modal Localization using Convolutional Transformers](https://mlsanity.com/paper/2306.04021/) (2023)
- [BEV2PR: BEV-Enhanced Visual Place Recognition with Structural Cues](https://mlsanity.com/paper/2403.06600/) (2024)
- [Single-Shot Global Localization via Graph-Theoretic Correspondence Matching](https://mlsanity.com/paper/2306.03641/) (2023)
- [GeoUniPR: A Geometry-Consistent Unified Framework for Cross-Modal Place Recognition](https://mlsanity.com/paper/2608.11263/) (2026)

## Abstract (arXiv)

Globally localizing in a given map is a crucial ability for robots to perform a wide range of autonomous navigation tasks. This paper presents OneShot - a global localization algorithm that uses only a single 3D LiDAR scan at a time, while outperforming approaches based on integrating a sequence of point clouds. Our approach, which does not require the robot to move, relies on learning-based descriptors of point cloud segments and computes the full 6 degree-of-freedom pose in a map. The segments are extracted from the current LiDAR scan and are matched against a database using the computed descriptors. Candidate matches are then verified with a geometric consistency test. We additionally present a strategy to further improve the performance of the segment descriptors by augmenting them with visual information provided by a camera. For this purpose, a custom-tailored neural network architecture is proposed. We demonstrate that our LiDAR-only approach outperforms a state-of-the-art baseline on a sequence of the KITTI dataset and also evaluate its performance on the challenging NCLT dataset. Finally, we show that fusing in visual information boosts segment retrieval rates by up to 26% compared to LiDAR-only description.
