# LASER: LAtent SpacE Rendering for 2D Visual Localization

arXiv: https://arxiv.org/abs/2204.00157 · HTML: https://mlsanity.com/paper/2204.00157/

## Key facts

- Cited by 24 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 45 references that are in the map.
- First posted on arXiv 1 Apr 2022.

## Builds on (most cited first, 25 of 25)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation](https://mlsanity.com/paper/1612.00593/) (2016)
- [FaceNet: A Unified Embedding for Face Recognition and Clustering](https://mlsanity.com/paper/1503.03832/) (2015)
- [SuperGlue: Learning Feature Matching with Graph Neural Networks](https://mlsanity.com/paper/1911.11763/) (2019)
- [NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections](https://mlsanity.com/paper/2008.02268/) (2020)
- [LoFTR: Detector-Free Local Feature Matching with Transformers](https://mlsanity.com/paper/2104.00680/) (2021)
- [From Coarse to Fine: Robust Hierarchical Localization at Large Scale](https://mlsanity.com/paper/1812.03506/) (2018)
- [Deep metric learning using Triplet network](https://mlsanity.com/paper/1412.6622/) (2014)
- [Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling](https://mlsanity.com/paper/1908.00222/) (2019)
- [DSAC - Differentiable RANSAC for Camera Localization](https://mlsanity.com/paper/1611.05705/) (2016)
- [Back to the Feature: Learning Robust Camera Localization from Pixels to Pose](https://mlsanity.com/paper/2103.09213/) (2021)
- [DeepV2D: Video to Depth with Differentiable Structure from Motion](https://mlsanity.com/paper/1812.04605/) (2018)
- [Learning to Find Good Correspondences](https://mlsanity.com/paper/1711.05971/) (2017)
- [BA-Net: Dense Bundle Adjustment Network](https://mlsanity.com/paper/1806.04807/) (2018)
- [Patch2Pix: Epipolar-Guided Pixel-Level Correspondences](https://mlsanity.com/paper/2012.01909/) (2020)
- [DeepTAM: Deep Tracking and Mapping](https://mlsanity.com/paper/1808.01900/) (2018)
- [DeepSFM: Structure From Motion Via Deep Bundle Adjustment](https://mlsanity.com/paper/1912.09697/) (2019)
- [Particle Filter Networks with Application to Visual Localization](https://mlsanity.com/paper/1805.08975/) (2018)
- [Differentiable Particle Filters: End-to-End Learning with Algorithmic Priors](https://mlsanity.com/paper/1805.11122/) (2018)
- [LaLaLoc: Latent Layout Localisation in Dynamic, Unvisited Environments](https://mlsanity.com/paper/2104.09169/) (2021)
- [Robot Localization in Floor Plans Using a Room Layout Edge Extraction Network](https://mlsanity.com/paper/1903.01804/) (2019)
- [VOLDOR: Visual Odometry from Log-logistic Dense Optical flow Residuals](https://mlsanity.com/paper/2104.06789/) (2021)
- [VOLDOR-SLAM: For the Times When Feature-Based or Direct Methods Are Not Good Enough](https://mlsanity.com/paper/2104.06800/) (2021)
- [SeDAR - Semantic Detection and Ranging: Humans can localise without LiDAR, can robots?](https://mlsanity.com/paper/1709.01500/) (2017)

## Built on by (most cited first, 24 of 24)

- [OrienterNet: Visual Localization in 2D Public Maps with Neural Matching](https://mlsanity.com/paper/2304.02009/) (2023)
- [SliceMatch: Geometry-guided Aggregation for Cross-View Pose Estimation](https://mlsanity.com/paper/2211.14651/) (2022)
- [Convolutional Cross-View Pose Estimation](https://mlsanity.com/paper/2303.05915/) (2023)
- [FG2: Fine-Grained Cross-View Localization by Fine-Grained Feature Matching](https://mlsanity.com/paper/2503.18725/) (2025)
- [F3Loc: Fusion and Filtering for Floorplan Localization](https://mlsanity.com/paper/2403.03370/) (2024)
- [IR-MCL: Implicit Representation-Based Online Global Localization](https://mlsanity.com/paper/2210.03113/) (2022)
- [NeurOCS: Neural NOCS Supervision for Monocular 3D Object Localization](https://mlsanity.com/paper/2305.17763/) (2023)
- [Fully Geometric Panoramic Localization](https://mlsanity.com/paper/2403.19904/) (2024)
- [Supercharging Floorplan Localization with Semantic Rays](https://mlsanity.com/paper/2507.09291/) (2025)
- [FloNa: Floor Plan Guided Embodied Visual Navigation](https://mlsanity.com/paper/2412.18335/) (2024)
- [UnLoc: Leveraging Depth Uncertainties for Floorplan Localization](https://mlsanity.com/paper/2509.11301/) (2025)
- [SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environments](https://mlsanity.com/paper/2404.10527/) (2024)
- [Perspective from a Higher Dimension: Can 3D Geometric Priors Help Visual Floorplan Localization?](https://mlsanity.com/paper/2507.18881/) (2025)
- [PALMS+: Modular Image-Based Floor Plan Localization Leveraging Depth Foundation Model](https://mlsanity.com/paper/2511.09724/) (2025)
- [Perspective from a Broader Context: Can Room Style Knowledge Help Visual Floorplan Localization?](https://mlsanity.com/paper/2508.01216/) (2025)
- [DisCo-FLoc: Semantic-Free Floorplan Localization via SE(2)-Aware Contrastive Disambiguation](https://mlsanity.com/paper/2601.01822/) (2026)
- [SceneAligner: 3D-Grounded Floorplan Localization in the Wild](https://mlsanity.com/paper/2605.22581/) (2026)
- [Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives](https://mlsanity.com/paper/2606.04788/) (2026)
- [Fusing Satellite Imagery and Planimetric Maps for Cross-View Localization](https://mlsanity.com/paper/2606.10166/) (2026)
- [From Uncertainty to Determinism: Coarse-to-Fine Visual Floorplan Localization without Ray Matching](https://mlsanity.com/paper/2607.26817/) (2026)
- [AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels](https://mlsanity.com/paper/2609.02798/) (2026)
- [GALoc: Gravity Aligned Wireframes for Depth-Free Monocular Floorplan Localization](https://mlsanity.com/paper/2609.08385/) (2026)
- [Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations](https://mlsanity.com/paper/2609.12723/) (2026)
- [FreeLoc: Online Floorplan Localization via Diffusion-Aided Pose Refinement](https://mlsanity.com/paper/2610.05011/) (2026)

## Abstract (arXiv)

We present LASER, an image-based Monte Carlo Localization (MCL) framework for 2D floor maps. LASER introduces the concept of latent space rendering, where 2D pose hypotheses on the floor map are directly rendered into a geometrically-structured latent space by aggregating viewing ray features. Through a tightly coupled rendering codebook scheme, the viewing ray features are dynamically determined at rendering-time based on their geometries (i.e. length, incident-angle), endowing our representation with view-dependent fine-grain variability. Our codebook scheme effectively disentangles feature encoding from rendering, allowing the latent space rendering to run at speeds above 10KHz. Moreover, through metric learning, our geometrically-structured latent space is common to both pose hypotheses and query images with arbitrary field of views. As a result, LASER achieves state-of-the-art performance on large-scale indoor localization datasets (i.e. ZInD and Structured3D) for both panorama and perspective image queries, while significantly outperforming existing learning-based methods in speed.
