# Fully Geometric Panoramic Localization

arXiv: https://arxiv.org/abs/2403.19904 · HTML: https://mlsanity.com/paper/2403.19904/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 34 of its 69 references that are in the map.
- First posted on arXiv 29 Mar 2024.

## Builds on (most cited first, 30 of 34)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [SuperGlue: Learning Feature Matching with Graph Neural Networks](https://mlsanity.com/paper/1911.11763/) (2019)
- [SuperPoint: Self-Supervised Interest Point Detection and Description](https://mlsanity.com/paper/1712.07629/) (2017)
- [LoFTR: Detector-Free Local Feature Matching with Transformers](https://mlsanity.com/paper/2104.00680/) (2021)
- [NetVLAD: CNN architecture for weakly supervised place recognition](https://mlsanity.com/paper/1511.07247/) (2015)
- [LightGlue: Local Feature Matching at Light Speed](https://mlsanity.com/paper/2306.13643/) (2023)
- [Joint 2D-3D-Semantic Data for Indoor Scene Understanding](https://mlsanity.com/paper/1702.01105/) (2017)
- [Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling](https://mlsanity.com/paper/1908.00222/) (2019)
- [Self-supervising Fine-grained Region Similarities for Large-scale Image Localization](https://mlsanity.com/paper/2006.03926/) (2020)
- [Revealing Scenes by Inverting Structure from Motion Reconstructions](https://mlsanity.com/paper/1904.03303/) (2019)
- [GlueStick: Robust Image Matching by Sticking Points and Lines Together](https://mlsanity.com/paper/2304.02008/) (2023)
- [DeepLSD: Line Segment Detection and Refinement with Deep Image Gradients](https://mlsanity.com/paper/2212.07766/) (2022)
- [Is Geometry Enough for Matching in Visual Localization?](https://mlsanity.com/paper/2203.12979/) (2022)
- [Privacy Preserving Image-Based Localization](https://mlsanity.com/paper/1903.05572/) (2019)
- [SOLD2: Self-supervised Occlusion-aware Line Description and Detection](https://mlsanity.com/paper/2104.03362/) (2021)
- [3D Line Mapping Revisited](https://mlsanity.com/paper/2303.17504/) (2023)
- [Solving the Blind Perspective-n-Point Problem End-To-End With Robust Differentiable Geometric Optimization](https://mlsanity.com/paper/2007.14628/) (2020)
- [LaLaLoc: Latent Layout Localisation in Dynamic, Unvisited Environments](https://mlsanity.com/paper/2104.09169/) (2021)
- [LASER: LAtent SpacE Rendering for 2D Visual Localization](https://mlsanity.com/paper/2204.00157/) (2022)
- [ELSED: Enhanced Line SEgment Drawing](https://mlsanity.com/paper/2108.03144/) (2021)
- [The Alignment of the Spheres: Globally-Optimal Spherical Mixture Alignment for Camera Pose Estimation](https://mlsanity.com/paper/1812.01232/) (2018)
- [PICCOLO: Point Cloud-Centric Omnidirectional Localization](https://mlsanity.com/paper/2108.06545/) (2021)
- [Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localization](https://mlsanity.com/paper/2109.04753/) (2021)
- [Pose Refinement with Joint Optimization of Visual Points and Lines](https://mlsanity.com/paper/2110.03940/) (2021)
- [CvxPnPL: A Unified Convex Solution to the Absolute Pose Estimation Problem from Point and Line Correspondences](https://mlsanity.com/paper/1907.10545/) (2019)
- [VLASE: Vehicle Localization by Aggregating Semantic Edges](https://mlsanity.com/paper/1807.02536/) (2018)
- [Fast 3D Line Segment Detection From Unorganized Point Cloud](https://mlsanity.com/paper/1901.02532/) (2019)
- [Analysis and Mitigations of Reverse Engineering Attacks on Local Feature Descriptors](https://mlsanity.com/paper/2105.03812/) (2021)
- [LCD -- Line Clustering and Description for Place Recognition](https://mlsanity.com/paper/2010.10867/) (2020)
- [Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction](https://mlsanity.com/paper/2308.10694/) (2023)

## Built on by (most cited first, 11 of 11)

- [LoD-Loc: Aerial Visual Localization using LoD 3D Map with Neural Wireframe Alignment](https://mlsanity.com/paper/2410.12269/) (2024)
- [Omnidirectional Multi-Object Tracking](https://mlsanity.com/paper/2503.04565/) (2025)
- [Supercharging Floorplan Localization with Semantic Rays](https://mlsanity.com/paper/2507.09291/) (2025)
- [SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environments](https://mlsanity.com/paper/2404.10527/) (2024)
- [OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback](https://mlsanity.com/paper/2511.00510/) (2025)
- [SceneAligner: 3D-Grounded Floorplan Localization in the Wild](https://mlsanity.com/paper/2605.22581/) (2026)
- [Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives](https://mlsanity.com/paper/2606.04788/) (2026)
- [RoEL: Robust Event-based 3D Line Reconstruction](https://mlsanity.com/paper/2602.18258/) (2026)
- [Scene Representation using 360deg Saliency Graph and its Application in Vision-based Indoor Navigation](https://mlsanity.com/paper/2603.20353/) (2026)
- [Privacy-Preserving Structureless Visual Localization via Image Obfuscation](https://mlsanity.com/paper/2604.12068/) (2026)
- [GALoc: Gravity Aligned Wireframes for Depth-Free Monocular Floorplan Localization](https://mlsanity.com/paper/2609.08385/) (2026)

## Abstract (arXiv)

We introduce a lightweight and accurate localization method that only utilizes the geometry of 2D-3D lines. Given a pre-captured 3D map, our approach localizes a panorama image, taking advantage of the holistic 360 view. The system mitigates potential privacy breaches or domain discrepancies by avoiding trained or hand-crafted visual descriptors. However, as lines alone can be ambiguous, we express distinctive yet compact spatial contexts from relationships between lines, namely the dominant directions of parallel lines and the intersection between non-parallel lines. The resulting representations are efficient in processing time and memory compared to conventional visual descriptor-based methods. Given the groups of dominant line directions and their intersections, we accelerate the search process to test thousands of pose candidates in less than a millisecond without sacrificing accuracy. We empirically show that the proposed 2D-3D matching can localize panoramas for challenging scenes with similar structures, dramatic domain shifts or illumination changes. Our fully geometric approach does not involve extensive parameter tuning or neural network training, making it a practical algorithm that can be readily deployed in the real world. Project page including the code is available through this link: https://82magnolia.github.io/fgpl/.
