On-the-Fly Adaptation of Regression Forests for Online Camera Relocalisation
Not on the map. Why?
Abstract (arXiv)
Camera relocalisation is an important problem in computer vision, with applications in simultaneous localisation and mapping, virtual/augmented reality and navigation. Common techniques either match the current image against keyframes with known poses coming from a tracker, or establish 2D-to-3D correspondences between keypoints in the current image and points in the scene in order to estimate the camera pose. Recently, regression forests have become a popular alternative to establish such correspondences. They achieve accurate results, but must be trained offline on the target scene, preventing relocalisation in new environments. In this paper, we show how to circumvent this limitation by adapting a pre-trained forest to a new scene on the fly. Our adapted forests achieve relocalisation performance that is on par with that of offline forests, and our approach runs in under 150ms, making it desirable for real-time systems that require online relocalisation.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 6; 2023: 9; 2024: 6; 2025: 7; 2026: 2.
38 papers.
Sort:
By area:
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2021On the Limits of Pseudo Ground Truth in Visual Camera Re-localisationcited by 63
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2024GLACE: Global Local Accelerated Coordinate Encodingcited by 48
- 2021Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervisioncited by 37
- 2022Visual Localization via Few-Shot Scene Region Classificationcited by 36
- 2022Camera Pose Auto-Encoders for Improving Pose Regressioncited by 28
- 2023HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformercited by 26
- 2023PNeRFLoc: Visual Localization with Point-based Neural Radiance Fieldscited by 22
26 more
- 2023Visual Localization using Imperfect 3D Models from the Internetcited by 20
- 2021How Privacy-Preserving are Line Clouds? Recovering Scene Details from 3D Linescited by 19
- 2022Satellite Image Based Cross-view Localization for Autonomous Vehiclecited by 19
- 2021Continual Learning for Image-Based Camera Localizationcited by 18
- 2023FocusTune: Tuning Visual Localization through Focus-Guided Samplingcited by 16
- 2025R-SCoRe: Revisiting Scene Coordinate Regression for Robust Large-Scale Visual Localizationcited by 16
- 2024GSplatLoc: Grounding Keypoint Descriptors into 3D Gaussian Splatting for Improved Visual Localizationcited by 15
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2021CrowdDriven: A New Challenging Dataset for Outdoor Visual Localizationcited by 13
- 2023Leveraging Neural Radiance Fields for Uncertainty-Aware Visual Localizationcited by 12
- 2023Lazy Visual Localization via Motion Averagingcited by 8
- 2025ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Trainingcited by 8
- 2024Self-supervised Learning of Neural Implicit Feature Fields for Camera Pose Refinementcited by 5
- 2023Predictive World Models from Real-World Partial Observationscited by 4
- 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Featurescited by 4
- 2022Fast and Lightweight Scene Regressor for Camera Relocalizationcited by 3
- 2024Combining Absolute and Semi-Generalized Relative Poses for Visual Localizationcited by 3
- 2025Scene Coordinate Reconstruction Priorscited by 2
- 2024Weatherproofing Retrieval for Localization with Generative AI and Geometric Consistencycited by 1
- 2021Domain Adaptation of Networks for Camera Pose Estimation: Learning Camera Pose Estimation Without Pose Labelscited by 0
- 2022Graph Attention Network for Camera Relocalization on Dynamic Scenescited by 0
- 2025Improved 3D Point-Line Mapping Regression for Camera Relocalizationcited by 0
- 2025Relative Pose Regression with Pose Auto-Encoders: Enhancing Accuracy and Data Efficiency for Retail Applicationscited by 0
- 2025Robust Scene Coordinate Regression via Geometrically-Consistent Global Descriptorscited by 0
- 2026L3:Scene-agnostic Visual Localization in the Wildcited by 0
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labelscited by 0
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026L3:Scene-agnostic Visual Localization in the Wild9 Mar 2026
- 2025Robust Scene Coordinate Regression via Geometrically-Consistent Global Descriptors19 Dec 2025
- 2025Scene Coordinate Reconstruction Priors14 Oct 2025
- 2025ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Training13 Oct 2025
- 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Features1 Oct 2025
- 2025Relative Pose Regression with Pose Auto-Encoders: Enhancing Accuracy and Data Efficiency for Retail Applications12 Aug 2025
- 2025Improved 3D Point-Line Mapping Regression for Camera Relocalization28 Feb 2025
- 2025R-SCoRe: Revisiting Scene Coordinate Regression for Robust Large-Scale Visual Localization2 Jan 2025
- 2024GSplatLoc: Grounding Keypoint Descriptors into 3D Gaussian Splatting for Improved Visual Localization24 Sep 2024
- 2024Combining Absolute and Semi-Generalized Relative Poses for Visual Localization21 Sep 2024
- 2024Self-supervised Learning of Neural Implicit Feature Fields for Camera Pose Refinement12 Jun 2024
26 more
- 2024GLACE: Global Local Accelerated Coordinate Encoding6 Jun 2024
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizer22 Apr 2024
- 2024Weatherproofing Retrieval for Localization with Generative AI and Geometric Consistency14 Feb 2024
- 2023PNeRFLoc: Visual Localization with Point-based Neural Radiance Fields17 Dec 2023
- 2023FocusTune: Tuning Visual Localization through Focus-Guided Sampling6 Nov 2023
- 2023Leveraging Neural Radiance Fields for Uncertainty-Aware Visual Localization10 Oct 2023
- 2023Deep Learning for Visual Localization and Mapping: A Survey27 Aug 2023
- 2023Lazy Visual Localization via Motion Averaging19 Jul 2023
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Poses23 May 2023
- 2023HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformer5 May 2023
- 2023Visual Localization using Imperfect 3D Models from the Internet12 Apr 2023
- 2023Predictive World Models from Real-World Partial Observations12 Jan 2023
- 2022Fast and Lightweight Scene Regressor for Camera Relocalization4 Dec 2022
- 2022Graph Attention Network for Camera Relocalization on Dynamic Scenes29 Sep 2022
- 2022Visual Localization via Few-Shot Scene Region Classification14 Aug 2022
- 2022Satellite Image Based Cross-view Localization for Autonomous Vehicle27 Jul 2022
- 2022MeshLoc: Mesh-Based Visual Localization21 Jul 2022
- 2022Camera Pose Auto-Encoders for Improving Pose Regression12 Jul 2022
- 2021Domain Adaptation of Networks for Camera Pose Estimation: Learning Camera Pose Estimation Without Pose Labels29 Nov 2021
- 2021CrowdDriven: A New Challenging Dataset for Outdoor Visual Localization9 Sep 2021
- 2021On the Limits of Pseudo Ground Truth in Visual Camera Re-localisation1 Sep 2021
- 2021Continual Learning for Image-Based Camera Localization20 Aug 2021
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Clouds8 Apr 2021
- 2021Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervision6 Apr 2021
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Pose16 Mar 2021
- 2021How Privacy-Preserving are Line Clouds? Recovering Scene Details from 3D Lines8 Mar 2021
- 2023Predictive World Models from Real-World Partial Observations12 Jan 2023
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2021On the Limits of Pseudo Ground Truth in Visual Camera Re-localisationcited by 63
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2024GLACE: Global Local Accelerated Coordinate Encodingcited by 48
- 2021Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervisioncited by 37
- 2022Visual Localization via Few-Shot Scene Region Classificationcited by 36
- 2022Camera Pose Auto-Encoders for Improving Pose Regressioncited by 28
- 2023HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformercited by 26
- 2023PNeRFLoc: Visual Localization with Point-based Neural Radiance Fieldscited by 22
12 most cited of 37 All 37 (JSON)
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026L3:Scene-agnostic Visual Localization in the Wild9 Mar 2026
- 2025Robust Scene Coordinate Regression via Geometrically-Consistent Global Descriptors19 Dec 2025
- 2025Scene Coordinate Reconstruction Priors14 Oct 2025
- 2025ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Training13 Oct 2025
- 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Features1 Oct 2025
- 2025Relative Pose Regression with Pose Auto-Encoders: Enhancing Accuracy and Data Efficiency for Retail Applications12 Aug 2025
- 2025Improved 3D Point-Line Mapping Regression for Camera Relocalization28 Feb 2025
- 2025R-SCoRe: Revisiting Scene Coordinate Regression for Robust Large-Scale Visual Localization2 Jan 2025
- 2024GSplatLoc: Grounding Keypoint Descriptors into 3D Gaussian Splatting for Improved Visual Localization24 Sep 2024
- 2024Combining Absolute and Semi-Generalized Relative Poses for Visual Localization21 Sep 2024
- 2024Self-supervised Learning of Neural Implicit Feature Fields for Camera Pose Refinement12 Jun 2024
12 newest of 37 All 37 (JSON)