mlsanityData to 7 Oct 2026

Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization

arXiv 2412.08376 ↗First posted 11 Dec 2024cs.CVcited by 81

Not on the map. Why?

Abstract (arXiv)

Visual localization aims to determine the camera pose of a query image relative to a database of posed images. In recent years, deep neural networks that directly regress camera poses have gained popularity due to their fast inference capabilities. However, existing methods struggle to either generalize well to new scenes or provide accurate camera pose estimates. To address these issues, we present Reloc3r, a simple yet effective visual localization framework. It consists of an elegantly designed relative pose regression network, and a minimalist motion averaging module for absolute pose estimation. Trained on approximately eight million posed image pairs, Reloc3r achieves surprisingly good performance and generalization ability. We conduct extensive experiments on six public datasets, consistently demonstrating the effectiveness and efficiency of the proposed method. It provides high-quality camera pose estimates in real time and generalizes to novel scenes. Code: https://github.com/ffrivera0/reloc3r.

Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). Builds on 97 of its 138 references that are in the map. First posted on arXiv 11 Dec 2024.

Builds on

97 of 138 references.

References · 97

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2023Segment Anythingcited by 8,158
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  9. 2022Scalable Diffusion Models with Transformerscited by 5,931
  10. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  11. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  12. 2023Qwen Technical Reportcited by 3,273
38 more
  1. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  4. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  5. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  6. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  7. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  8. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
  9. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  10. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  11. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  12. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  13. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  14. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
  15. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  16. 2024Large Language Models: A Surveycited by 506
  17. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  18. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  19. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  20. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  21. 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 324
  22. 2023RoMa: Robust Dense Feature Matchingcited by 296
  23. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  24. 20243D Reconstruction with Spatial Memorycited by 269
  25. 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
  26. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
  27. 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
  28. 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
  29. 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
  30. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  31. 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
  32. 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
  33. 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
  34. 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
  35. 2020Visual Camera Re-Localization from RGB and RGB-D Images Using DSACcited by 176
  36. 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
  37. 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
  38. 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161

50 most cited of 97 All 97 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 40; 2026: 41.

81 papers.

Sort:

By area:

  1. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  2. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
  3. 2025Streaming 4D Visual Geometry Transformercited by 147
  4. 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
  5. 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
  6. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
  7. 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
  8. 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 44
  9. 2025YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splattingcited by 34
  10. 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 26
  11. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  12. 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
38 more
  1. 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 14
  2. 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Associationcited by 13
  3. 2025Rig3R: Rig-Aware Conditioning for Learned 3D Reconstructioncited by 11
  4. 2025Alligat0R: Pre-Training Through Co-Visibility Segmentation for Relative Camera Pose Regressioncited by 10
  5. 2025Can Video Diffusion Model Reconstruct 4D Geometry?cited by 10
  6. 2025A Guide to Structureless Visual Localizationcited by 9
  7. 2025Co-Me: Confidence-Guided Token Merging for Visual Geometric Transformerscited by 9
  8. 2025Review of Feed-forward 3D Reconstruction: From DUSt3R to VGGTcited by 8
  9. 2025ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Trainingcited by 8
  10. 2025Deep Learning Reforms Image Matching: A Survey and Outlookcited by 7
  11. 2025Endo-FASt3r: Endoscopic Foundation model Adaptation for Structure from motioncited by 5
  12. 2025Spatio-Temporal LLM: Reasoning about Environments and Actionscited by 5
  13. 2025PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-Forward Planar Splattingcited by 5
  14. 2025Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillationcited by 5
  15. 2025Reloc-VGGT: Visual Re-localization with Geometry Grounded Transformercited by 5
  16. 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
  17. 2025Puzzles: Unbounded Video-Depth Augmentation for Scalable End-to-End 3D Reconstructioncited by 4
  18. 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Featurescited by 4
  19. 2025MuM: Multi-View Masked Image Modeling for 3D Visioncited by 4
  20. 2025GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelerscited by 3
  21. 2025GeLoc3r: Enhancing Relative Camera Pose Regression with Geometric Consistency Regularizationcited by 2
  22. 2025Multi-modal Loop Closure Detection with Foundation Models in Severely Unstructured Environmentscited by 2
  23. 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimationcited by 2
  24. 2026Region Matters: Efficient and Reliable Region-Aware Visual Place Recognitioncited by 2
  25. 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representationscited by 1
  26. 2025GRLoc: Geometric Representation Regression for Visual Localizationcited by 1
  27. 2025ShelfAware: Real-Time Semantic Localization in Quasi-Static Environments with Low-Cost Sensorscited by 1
  28. 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimationcited by 1
  29. 2026UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimizationcited by 1
  30. 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparisoncited by 1
  31. 2025ViewBridge: Curriculum Knowledge Distillation for Activity View-Invariance Under Extreme Viewpoint Changescited by 0
  32. 2025PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimizationcited by 0
  33. 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Videocited by 0
  34. 2025Robust Scene Coordinate Regression via Geometrically-Consistent Global Descriptorscited by 0
  35. 2026HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Mapscited by 0
  36. 2026OpenNavMap: Multi-Session Appearance-Based Topometric Mapping for Scalable Visual Navigationcited by 0
  37. 2026From Single Scan to Sequential Consistency: A New Paradigm for LIDAR Relocalizationcited by 0
  38. 2025Learning to Anchor Visual Odometry: KAN-Based Pose Regression for Planetary Landingcited by 0

50 most cited of 81 All 81 (JSON)