Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization
Not on the map. Why?
Abstract (arXiv)
Visual localization aims to determine the camera pose of a query image relative to a database of posed images. In recent years, deep neural networks that directly regress camera poses have gained popularity due to their fast inference capabilities. However, existing methods struggle to either generalize well to new scenes or provide accurate camera pose estimates. To address these issues, we present Reloc3r, a simple yet effective visual localization framework. It consists of an elegantly designed relative pose regression network, and a minimalist motion averaging module for absolute pose estimation. Trained on approximately eight million posed image pairs, Reloc3r achieves surprisingly good performance and generalization ability. We conduct extensive experiments on six public datasets, consistently demonstrating the effectiveness and efficiency of the proposed method. It provides high-quality camera pose estimates in real time and generalizes to novel scenes. Code: https://github.com/ffrivera0/reloc3r.
Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). Builds on 97 of its 138 references that are in the map. First posted on arXiv 11 Dec 2024.
Builds on
97 of 138 references.
References · 97
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2023Qwen Technical Reportcited by 3,273
38 more
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2024Large Language Models: A Surveycited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 324
- 2023RoMa: Robust Dense Feature Matchingcited by 296
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 20243D Reconstruction with Spatial Memorycited by 269
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
- 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
- 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2020Visual Camera Re-Localization from RGB and RGB-D Images Using DSACcited by 176
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161
50 most cited of 97 All 97 (JSON)
Built on by
Citing papers per year: 2025: 40; 2026: 41.
81 papers.
Sort:
By area:
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2025Streaming 4D Visual Geometry Transformercited by 147
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 44
- 2025YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splattingcited by 34
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 26
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
38 more
- 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 14
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Associationcited by 13
- 2025Rig3R: Rig-Aware Conditioning for Learned 3D Reconstructioncited by 11
- 2025Alligat0R: Pre-Training Through Co-Visibility Segmentation for Relative Camera Pose Regressioncited by 10
- 2025Can Video Diffusion Model Reconstruct 4D Geometry?cited by 10
- 2025A Guide to Structureless Visual Localizationcited by 9
- 2025Co-Me: Confidence-Guided Token Merging for Visual Geometric Transformerscited by 9
- 2025Review of Feed-forward 3D Reconstruction: From DUSt3R to VGGTcited by 8
- 2025ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Trainingcited by 8
- 2025Deep Learning Reforms Image Matching: A Survey and Outlookcited by 7
- 2025Endo-FASt3r: Endoscopic Foundation model Adaptation for Structure from motioncited by 5
- 2025Spatio-Temporal LLM: Reasoning about Environments and Actionscited by 5
- 2025PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-Forward Planar Splattingcited by 5
- 2025Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillationcited by 5
- 2025Reloc-VGGT: Visual Re-localization with Geometry Grounded Transformercited by 5
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2025Puzzles: Unbounded Video-Depth Augmentation for Scalable End-to-End 3D Reconstructioncited by 4
- 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Featurescited by 4
- 2025MuM: Multi-View Masked Image Modeling for 3D Visioncited by 4
- 2025GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelerscited by 3
- 2025GeLoc3r: Enhancing Relative Camera Pose Regression with Geometric Consistency Regularizationcited by 2
- 2025Multi-modal Loop Closure Detection with Foundation Models in Severely Unstructured Environmentscited by 2
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimationcited by 2
- 2026Region Matters: Efficient and Reliable Region-Aware Visual Place Recognitioncited by 2
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representationscited by 1
- 2025GRLoc: Geometric Representation Regression for Visual Localizationcited by 1
- 2025ShelfAware: Real-Time Semantic Localization in Quasi-Static Environments with Low-Cost Sensorscited by 1
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimationcited by 1
- 2026UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimizationcited by 1
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparisoncited by 1
- 2025ViewBridge: Curriculum Knowledge Distillation for Activity View-Invariance Under Extreme Viewpoint Changescited by 0
- 2025PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimizationcited by 0
- 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Videocited by 0
- 2025Robust Scene Coordinate Regression via Geometrically-Consistent Global Descriptorscited by 0
- 2026HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Mapscited by 0
- 2026OpenNavMap: Multi-Session Appearance-Based Topometric Mapping for Scalable Visual Navigationcited by 0
- 2026From Single Scan to Sequential Consistency: A New Paradigm for LIDAR Relocalizationcited by 0
- 2025Learning to Anchor Visual Odometry: KAN-Based Pose Regression for Planetary Landingcited by 0
50 most cited of 81 All 81 (JSON)
- 2026StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry30 Sep 2026
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026Temporal-Aware Fusion for Robust Outdoor LiDAR Localization29 Sep 2026
- 2026SlackDrive: Reclaiming Runtime Slack for Adaptive Driving Inference23 Sep 2026
- 2026NaCR: Visual Localization via NeRF-aided Camera Ray Regression22 Sep 2026
- 2026GeoCond: A Conditioning-Aware Reliability Adapter for Feed-Forward 3D Reconstruction16 Sep 2026
- 2026FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometry12 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison1 Sep 2026
- 2026MV2: Multi-View Multi-Vehicle Driving Dataset for Novel View Synthesis12 Aug 2026
- 2026Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation11 Aug 2026
38 more
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimization3 Aug 2026
- 2026PACE: Polar Axis-Conditioned Estimation for PairUAV Relative Localization19 Jul 2026
- 2026RASR: Range-Aware Scale Recovery for Metric UAV Navigation10 Jul 2026
- 2026Reference-Induced Consensus for Selective Posed-Reference Visual Localization6 Jul 2026
- 2026GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training2 Jul 2026
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimation6 Jun 2026
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustment2 Jun 2026
- 2026Landscape-Awareness for Geometric View Diffusion Model19 May 2026
- 20264DVGGT-D: 4D Visual Geometry Transformer with Improved Dynamic Depth Estimation12 May 2026
- 20263DReflecNet: A Large-Scale Dataset for 3D Reconstruction of Reflective, Transparent, and Low-Texture Objects11 May 2026
- 2026Disambiguating 2D-3D Correspondences in Gaussian Splatting-based Feature Fields for Visual Localization8 May 2026
- 2026Region Matters: Efficient and Reliable Region-Aware Visual Place Recognition24 Apr 2026
- 2026Continual Hand-Eye Calibration for Open-world Robotic Manipulation17 Apr 2026
- 2026GIST: Multimodal Knowledge Extraction and Spatial Grounding via Intelligent Semantic Topology16 Apr 2026
- 2026RobotPan: A 360^circ Surround-View Robotic Vision System for Embodied Perception15 Apr 2026
- 2026Privacy-Preserving Structureless Visual Localization via Image Obfuscation13 Apr 2026
- 2026LSGS-Loc: Towards Robust 3DGS-Based Visual Localization for Large-Scale UAV Scenarios7 Apr 2026
- 2026InCaRPose: In-Cabin Relative Camera Pose Estimation Model and Dataset4 Apr 2026
- 2026MultiLoc: Look Around As You Localize for Fast And Robust Visual Re-localization28 Mar 2026
- 2026PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matching21 Mar 2026
- 2026IUP-Pose: Decoupled Iterative Uncertainty Propagation for Real-time Relative Pose Regression via Implicit Dense Alignment v120 Mar 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026S2D: Sparse to Dense Lifting for 3D Reconstruction with Minimal Inputs11 Mar 2026
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimation4 Mar 2026
- 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scale26 Feb 2026
- 2026From Single Scan to Sequential Consistency: A New Paradigm for LIDAR Relocalization3 Feb 2026
- 2026OpenNavMap: Multi-Session Appearance-Based Topometric Mapping for Scalable Visual Navigation18 Jan 2026
- 2026HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Maps6 Jan 2026
- 2025Learning to Anchor Visual Odometry: KAN-Based Pose Regression for Planetary Landing30 Dec 2025
- 2025Reloc-VGGT: Visual Re-localization with Geometry Grounded Transformer26 Dec 2025
- 2025Robust Scene Coordinate Regression via Geometrically-Consistent Global Descriptors19 Dec 2025
- 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video13 Dec 2025
- 2025ShelfAware: Real-Time Semantic Localization in Quasi-Static Environments with Low-Cost Sensors9 Dec 2025
- 2025GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelers5 Dec 2025
- 2025Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation27 Nov 2025
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend25 Nov 2025
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstruction25 Nov 2025
50 newest of 81 All 81 (JSON)
- 2025Can Video Diffusion Model Reconstruct 4D Geometry?cited by 10
- 2026Landscape-Awareness for Geometric View Diffusion Modelcited by 0
- 2026Landscape-Awareness for Geometric View Diffusion Model19 May 2026
- 2025Can Video Diffusion Model Reconstruct 4D Geometry?27 Mar 2025
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2025Streaming 4D Visual Geometry Transformercited by 147
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 44
- 2025YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splattingcited by 34
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 26
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
- 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 14
12 most cited of 75 All 75 (JSON)
- 2026StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry30 Sep 2026
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 2026Temporal-Aware Fusion for Robust Outdoor LiDAR Localization29 Sep 2026
- 2026NaCR: Visual Localization via NeRF-aided Camera Ray Regression22 Sep 2026
- 2026GeoCond: A Conditioning-Aware Reliability Adapter for Feed-Forward 3D Reconstruction16 Sep 2026
- 2026FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometry12 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison1 Sep 2026
- 2026MV2: Multi-View Multi-Vehicle Driving Dataset for Novel View Synthesis12 Aug 2026
- 2026Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation11 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
12 newest of 75 All 75 (JSON)