Learning Where to Look: Self-supervised Viewpoint Selection for Active Localization using Geometrical Information
Not on the map. Why?
Abstract (arXiv)
Accurate localization in diverse environments is a fundamental challenge in computer vision and robotics. The task involves determining a sensor's precise position and orientation, typically a camera, within a given space. Traditional localization methods often rely on passive sensing, which may struggle in scenarios with limited features or dynamic environments. In response, this paper explores the domain of active localization, emphasizing the importance of viewpoint selection to enhance localization accuracy. Our contributions involve using a data-driven approach with a simple architecture designed for real-time operation, a self-supervised data training method, and the capability to consistently integrate our map into a planning framework tailored for real-world robotics applications. Our results demonstrate that our method performs better than the existing one, targeting similar problems and generalizing on synthetic and real data. We also release an open-source implementation to benefit the community.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 22 Jul 2024.
Builds on
28 of 56 references.
References · 28
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 326
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2017Learning Less is More - 6D Camera Localization via 3D Surface Regressioncited by 146
- 2021LENS: Localization enhanced by NeRF synthesiscited by 117
- 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
- 2019Hierarchical Scene Coordinate Classification and Regression for Visual Localizationcited by 93
- 2019AtLoc: Attention Guided Camera Localizationcited by 92
- 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matchingcited by 82
16 more
- 2019Expert Sample Consensus Applied to Camera Re-Localizationcited by 70
- 2022A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontierscited by 66
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2017VidLoc: A Deep Spatio-Temporal Model for 6-DoF Video-Clip Relocalizationcited by 58
- 2022Visual Localization via Few-Shot Scene Region Classificationcited by 36
- 2018Real-Time RGB-D Camera Pose Estimation in Novel Scenes using a Relocalisation Cascadecited by 35
- 2021Learning Camera Localization via Dense Scene Matchingcited by 28
- 2021CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Datacited by 28
- 2022Camera Pose Auto-Encoders for Improving Pose Regressioncited by 28
- 2018Active Neural Localizationcited by 18
- 2024VBR: A Vision Benchmark in Romecited by 16
- 2022Where to Look Next: Learning Viewpoint Recommendations for Informative Trajectory Planningcited by 14
- 2020Towards Accurate Active Camera Localizationcited by 9
- 2023AgriSORT: A Simple Online Real-time Tracking-by-Detection framework for robotics in precision agriculturecited by 7
- 2016Perception-aware Path Planningcited by 5
- 2023Active Visual Localization for Multi-Agent Collaboration: A Data-Driven Approachcited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2026Scaling Single Human Demonstrations for Imitation Learning using Generative Foundational Modelscited by 4
- 2025ActLoc: Learning to Localize on the Move via Active Viewpoint Selectioncited by 2
- 2025Active View Selection for Scene-level Multi-view Crowd Counting and Localization with Limited Labeling Budgetcited by 0
- 2026See, Act, Adapt: Active Perception for Unsupervised Cross-Domain Visual Adaptation via Personalized VLM-Guided Agentcited by 0
- 2026See, Act, Adapt: Active Perception for Unsupervised Cross-Domain Visual Adaptation via Personalized VLM-Guided Agent27 Feb 2026
- 2026Scaling Single Human Demonstrations for Imitation Learning using Generative Foundational Models13 Feb 2026
- 2025Active View Selection for Scene-level Multi-view Crowd Counting and Localization with Limited Labeling Budget20 Sep 2025
- 2025ActLoc: Learning to Localize on the Move via Active Viewpoint Selection28 Aug 2025