# LDL: Line Distance Functions for Panoramic Localization

arXiv: https://arxiv.org/abs/2308.13989 · HTML: https://mlsanity.com/paper/2308.13989/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 30 of its 60 references that are in the map.
- First posted on arXiv 27 Aug 2023.

## Builds on (most cited first, 30 of 30)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [SuperGlue: Learning Feature Matching with Graph Neural Networks](https://mlsanity.com/paper/1911.11763/) (2019)
- [Matterport3D: Learning from RGB-D Data in Indoor Environments](https://mlsanity.com/paper/1709.06158/) (2017)
- [SuperPoint: Self-Supervised Interest Point Detection and Description](https://mlsanity.com/paper/1712.07629/) (2017)
- [NetVLAD: CNN architecture for weakly supervised place recognition](https://mlsanity.com/paper/1511.07247/) (2015)
- [From Coarse to Fine: Robust Hierarchical Localization at Large Scale](https://mlsanity.com/paper/1812.03506/) (2018)
- [Joint 2D-3D-Semantic Data for Indoor Scene Understanding](https://mlsanity.com/paper/1702.01105/) (2017)
- [DSAC - Differentiable RANSAC for Camera Localization](https://mlsanity.com/paper/1611.05705/) (2016)
- [Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition](https://mlsanity.com/paper/2103.01486/) (2021)
- [Self-supervising Fine-grained Region Similarities for Large-scale Image Localization](https://mlsanity.com/paper/2006.03926/) (2020)
- [Hierarchical Scene Coordinate Classification and Regression for Visual Localization](https://mlsanity.com/paper/1909.06216/) (2019)
- [Revealing Scenes by Inverting Structure from Motion Reconstructions](https://mlsanity.com/paper/1904.03303/) (2019)
- [Robust Image Retrieval-based Visual Localization using Kapture](https://mlsanity.com/paper/2007.13867/) (2020)
- [Learning Attraction Field Representation for Robust Line Segment Detection](https://mlsanity.com/paper/1812.02122/) (2018)
- [Privacy Preserving Image-Based Localization](https://mlsanity.com/paper/1903.05572/) (2019)
- [Benchmarking Image Retrieval for Visual Localization](https://mlsanity.com/paper/2011.11946/) (2020)
- [PPGNet: Learning Point-Pair Graph for Line Segment Detection](https://mlsanity.com/paper/1905.03415/) (2019)
- [NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learning](https://mlsanity.com/paper/2112.12785/) (2021)
- [Object Detection in Equirectangular Panorama](https://mlsanity.com/paper/1805.08009/) (2018)
- [The Alignment of the Spheres: Globally-Optimal Spherical Mixture Alignment for Camera Pose Estimation](https://mlsanity.com/paper/1812.01232/) (2018)
- [PICCOLO: Point Cloud-Centric Omnidirectional Localization](https://mlsanity.com/paper/2108.06545/) (2021)
- [Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localization](https://mlsanity.com/paper/2109.04753/) (2021)
- [Pose Refinement with Joint Optimization of Visual Points and Lines](https://mlsanity.com/paper/2110.03940/) (2021)
- [VLASE: Vehicle Localization by Aggregating Semantic Edges](https://mlsanity.com/paper/1807.02536/) (2018)
- [Fast 3D Line Segment Detection From Unorganized Point Cloud](https://mlsanity.com/paper/1901.02532/) (2019)
- [Analysis and Mitigations of Reverse Engineering Attacks on Local Feature Descriptors](https://mlsanity.com/paper/2105.03812/) (2021)
- [LCD -- Line Clustering and Description for Place Recognition](https://mlsanity.com/paper/2010.10867/) (2020)
- [CPO: Change Robust Panorama to Point Cloud Localization](https://mlsanity.com/paper/2207.05317/) (2022)

## Built on by (most cited first, 3 of 3)

- [Fully Geometric Panoramic Localization](https://mlsanity.com/paper/2403.19904/) (2024)
- [Scene Representation using 360deg Saliency Graph and its Application in Vision-based Indoor Navigation](https://mlsanity.com/paper/2603.20353/) (2026)
- [Privacy-Preserving Structureless Visual Localization via Image Obfuscation](https://mlsanity.com/paper/2604.12068/) (2026)

## Abstract (arXiv)

We introduce LDL, a fast and robust algorithm that localizes a panorama to a 3D map using line segments. LDL focuses on the sparse structural information of lines in the scene, which is robust to illumination changes and can potentially enable efficient computation. While previous line-based localization approaches tend to sacrifice accuracy or computation time, our method effectively observes the holistic distribution of lines within panoramic images and 3D maps. Specifically, LDL matches the distribution of lines with 2D and 3D line distance functions, which are further decomposed along principal directions of lines to increase the expressiveness. The distance functions provide coarse pose estimates by comparing the distributional information, where the poses are further optimized using conventional local feature matching. As our pipeline solely leverages line geometry and local features, it does not require costly additional training of line-specific features or correspondence matching. Nevertheless, our method demonstrates robust performance on challenging scenarios including object layout changes, illumination shifts, and large-scale scenes, while exhibiting fast pose search terminating within a matter of milliseconds. We thus expect our method to serve as a practical solution for line-based localization, and complement the well-established point-based paradigm. The code for LDL is available through the following link: https://github.com/82magnolia/panoramic-localization.
