F3Loc: Fusion and Filtering for Floorplan Localization
Not on the map. Why?
Abstract (arXiv)
In this paper we propose an efficient data-driven solution to self-localization within a floorplan. Floorplan data is readily available, long-term persistent and inherently robust to changes in the visual appearance. Our method does not require retraining per map and location or demand a large database of images of the area of interest. We propose a novel probabilistic model consisting of an observation and a novel temporal filtering module. Operating internally with an efficient ray-based representation, the observation module consists of a single and a multiview module to predict horizontal depth from images and fuses their results to benefit from advantages offered by either methodology. Our method operates on conventional consumer hardware and overcomes a common limitation of competing methods that often demand upright images. Our full system meets real-time requirements, while outperforming the state-of-the-art by a significant margin.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 29 of its 58 references that are in the map. First posted on arXiv 5 Mar 2024.
Builds on
29 of 58 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
17 more
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
- 2020VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrievalcited by 188
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2019Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awarenesscited by 151
- 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
- 2016Image-based localization using LSTMs for structured feature correlationcited by 136
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2018DeepTAM: Deep Tracking and Mappingcited by 87
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
- 2018Particle Filter Networks with Application to Visual Localizationcited by 64
- 2022Visual Cross-View Metric Localization with Dense Uncertainty Estimatescited by 48
- 2021LaLaLoc: Latent Layout Localisation in Dynamic, Unvisited Environmentscited by 28
- 2019Robot Localization in Floor Plans Using a Room Layout Edge Extraction Networkcited by 26
- 2022LASER: LAtent SpacE Rendering for 2D Visual Localizationcited by 23
- 2019You Are Here: Geolocation by Embedding Maps and Imagescited by 19
Built on by
Citing papers per year: 2024: 3; 2025: 6; 2026: 8.
17 papers.
Sort:
- 2025Supercharging Floorplan Localization with Semantic Rayscited by 10
- 2024PolyRoom: Room-aware Transformer for Floorplan Reconstructioncited by 8
- 2025UnLoc: Leveraging Depth Uncertainties for Floorplan Localizationcited by 7
- 2024SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environmentscited by 5
- 2025Perspective from a Higher Dimension: Can 3D Geometric Priors Help Visual Floorplan Localization?cited by 4
- 2025CAGE: Continuity-Aware edGE Network Unlocks Robust Floorplan Reconstructioncited by 3
- 2025PALMS+: Modular Image-Based Floor Plan Localization Leveraging Depth Foundation Modelcited by 3
- 2024NaVIP: An Image-Centric Indoor Navigation Solution for Visually Impaired Peoplecited by 2
- 2025Perspective from a Broader Context: Can Room Style Knowledge Help Visual Floorplan Localization?cited by 2
- 2026DisCo-FLoc: Semantic-Free Floorplan Localization via SE(2)-Aware Contrastive Disambiguationcited by 1
- 2026SceneAligner: 3D-Grounded Floorplan Localization in the Wildcited by 1
- 2026PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matchingcited by 0
5 more
- 2026Fusing Satellite Imagery and Planimetric Maps for Cross-View Localizationcited by 0
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labelscited by 0
- 2026GALoc: Gravity Aligned Wireframes for Depth-Free Monocular Floorplan Localizationcited by 0
- 2026Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representationscited by 0
- 2026SlugTrails: An Egocentric Benchmark for Floor Plan Localization in Large Buildingscited by 0
- 2026SlugTrails: An Egocentric Benchmark for Floor Plan Localization in Large Buildings17 Sep 2026
- 2026Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations11 Sep 2026
- 2026GALoc: Gravity Aligned Wireframes for Depth-Free Monocular Floorplan Localization8 Sep 2026
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026Fusing Satellite Imagery and Planimetric Maps for Cross-View Localization8 Jun 2026
- 2026SceneAligner: 3D-Grounded Floorplan Localization in the Wild21 May 2026
- 2026PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matching21 Mar 2026
- 2026DisCo-FLoc: Semantic-Free Floorplan Localization via SE(2)-Aware Contrastive Disambiguation5 Jan 2026
- 2025PALMS+: Modular Image-Based Floor Plan Localization Leveraging Depth Foundation Model12 Nov 2025
- 2025CAGE: Continuity-Aware edGE Network Unlocks Robust Floorplan Reconstruction18 Sep 2025
- 2025UnLoc: Leveraging Depth Uncertainties for Floorplan Localization14 Sep 2025
- 2025Perspective from a Broader Context: Can Room Style Knowledge Help Visual Floorplan Localization?2 Aug 2025
5 more
- 2025Perspective from a Higher Dimension: Can 3D Geometric Priors Help Visual Floorplan Localization?25 Jul 2025
- 2025Supercharging Floorplan Localization with Semantic Rays12 Jul 2025
- 2024NaVIP: An Image-Centric Indoor Navigation Solution for Visually Impaired People8 Oct 2024
- 2024PolyRoom: Room-aware Transformer for Floorplan Reconstruction15 Jul 2024
- 2024SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environments16 Apr 2024
- 2025Supercharging Floorplan Localization with Semantic Rayscited by 10
- 2024PolyRoom: Room-aware Transformer for Floorplan Reconstructioncited by 8
- 2025UnLoc: Leveraging Depth Uncertainties for Floorplan Localizationcited by 7
- 2024SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environmentscited by 5
- 2025Perspective from a Higher Dimension: Can 3D Geometric Priors Help Visual Floorplan Localization?cited by 4
- 2025CAGE: Continuity-Aware edGE Network Unlocks Robust Floorplan Reconstructioncited by 3
- 2025PALMS+: Modular Image-Based Floor Plan Localization Leveraging Depth Foundation Modelcited by 3
- 2024NaVIP: An Image-Centric Indoor Navigation Solution for Visually Impaired Peoplecited by 2
- 2025Perspective from a Broader Context: Can Room Style Knowledge Help Visual Floorplan Localization?cited by 2
- 2026DisCo-FLoc: Semantic-Free Floorplan Localization via SE(2)-Aware Contrastive Disambiguationcited by 1
- 2026SceneAligner: 3D-Grounded Floorplan Localization in the Wildcited by 1
- 2026PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matchingcited by 0
12 most cited of 17 All 17 (JSON)
- 2026SlugTrails: An Egocentric Benchmark for Floor Plan Localization in Large Buildings17 Sep 2026
- 2026Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations11 Sep 2026
- 2026GALoc: Gravity Aligned Wireframes for Depth-Free Monocular Floorplan Localization8 Sep 2026
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026Fusing Satellite Imagery and Planimetric Maps for Cross-View Localization8 Jun 2026
- 2026SceneAligner: 3D-Grounded Floorplan Localization in the Wild21 May 2026
- 2026PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matching21 Mar 2026
- 2026DisCo-FLoc: Semantic-Free Floorplan Localization via SE(2)-Aware Contrastive Disambiguation5 Jan 2026
- 2025PALMS+: Modular Image-Based Floor Plan Localization Leveraging Depth Foundation Model12 Nov 2025
- 2025CAGE: Continuity-Aware edGE Network Unlocks Robust Floorplan Reconstruction18 Sep 2025
- 2025UnLoc: Leveraging Depth Uncertainties for Floorplan Localization14 Sep 2025
- 2025Perspective from a Broader Context: Can Room Style Knowledge Help Visual Floorplan Localization?2 Aug 2025
12 newest of 17 All 17 (JSON)