ActLoc: Learning to Localize on the Move via Active Viewpoint Selection
Not on the map. Why?
Abstract (arXiv)
Reliable localization is critical for robot navigation, yet most existing systems implicitly assume that all viewing directions at a location are equally informative. In practice, localization becomes unreliable when the robot observes unmapped, ambiguous, or uninformative regions. To address this, we present ActLoc, an active viewpoint-aware planning framework for enhancing localization accuracy for general robot navigation tasks. At its core, ActLoc employs a largescale trained attention-based model for viewpoint selection. The model encodes a metric map and the camera poses used during map construction, and predicts localization accuracy across yaw and pitch directions at arbitrary 3D locations. These per-point accuracy distributions are incorporated into a path planner, enabling the robot to actively select camera orientations that maximize localization robustness while respecting task and motion constraints. ActLoc achieves stateof-the-art results on single-viewpoint selection and generalizes effectively to fulltrajectory planning. Its modular design makes it readily applicable to diverse robot navigation and inspection tasks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 59 references that are in the map. First posted on arXiv 28 Aug 2025.
Builds on
39 of 59 references.
References · 39
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 326
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2017Learning Less is More - 6D Camera Localization via 3D Surface Regressioncited by 146
- 2021LENS: Localization enhanced by NeRF synthesiscited by 117
- 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
- 2019Hierarchical Scene Coordinate Classification and Regression for Visual Localizationcited by 93
27 more
- 2019AtLoc: Attention Guided Camera Localizationcited by 92
- 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matchingcited by 82
- 2019Expert Sample Consensus Applied to Camera Re-Localizationcited by 70
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2017VidLoc: A Deep Spatio-Temporal Model for 6-DoF Video-Clip Relocalizationcited by 58
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistencycited by 42
- 2021CT-ICP: Real-time Elastic LiDAR Odometry with Loop Closurecited by 38
- 2022Visual Localization via Few-Shot Scene Region Classificationcited by 36
- 2018Real-Time RGB-D Camera Pose Estimation in Novel Scenes using a Relocalisation Cascadecited by 35
- 2021Learning Camera Localization via Dense Scene Matchingcited by 28
- 2021CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Datacited by 28
- 2022Camera Pose Auto-Encoders for Improving Pose Regressioncited by 28
- 2018Active Neural Localizationcited by 18
- 2020Kimera-Multi: a System for Distributed Multi-Robot Metric-Semantic Simultaneous Localization and Mappingcited by 18
- 2022Where to Look Next: Learning Viewpoint Recommendations for Informative Trajectory Planningcited by 14
- 2022maplab 2.0 -- A Modular and Multi-Modal Mapping Frameworkcited by 14
- 2020Towards Accurate Active Camera Localizationcited by 9
- 2024Hilti SLAM Challenge 2023: Benchmarking Single + Multi-session SLAM across Sensor Constellations in Constructioncited by 8
- 2023A 3D Mixed Reality Interface for Human-Robot Teamingcited by 6
- 2016Perception-aware Path Planningcited by 5
- 2022MD-SLAM: Multi-cue Direct SLAMcited by 5
- 2023Active Implicit Reconstruction Using One-Shot View Planningcited by 4
- 2024MAD-ICP: It Is All About Matching Data -- Robust and Informed LiDAR Odometrycited by 4
- 2024Learning Where to Look: Self-supervised Viewpoint Selection for Active Localization using Geometrical Informationcited by 4
- 2023Active Visual Localization for Multi-Agent Collaboration: A Data-Driven Approachcited by 3
- 2025MAD-BA: 3D LiDAR Bundle Adjustment -- from Uncertainty Modelling to Structure Optimizationcited by 1
- 2025Intuitive Human-Drone Collaborative Navigation in Unknown Environments through Mixed Realitycited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.