Disambiguating 2D-3D Correspondences in Gaussian Splatting-based Feature Fields for Visual Localization
Not on the map. Why?
Abstract (arXiv)
While Gaussian Splatting-based Feature Fields (GSFFs) have shown promise for visual localization, this paper highlights that photometrically optimized GSFFs are inherently ill-suited for 2D-3D matching. The volumetric extent of each Gaussian induces many-to-one pixel-to-point mappings that destabilize PnP-based pose estimation, while photometric optimization gives rise to superfluous Gaussians devoid of multi-view consistency. To address these issues, we propose SplitGS-Loc, a localization-specialized GSFFs construction framework that disambiguates 2D-3D correspondences by exploiting Gaussian attributes. Our key design, Mixture-of-Gaussians-based splitting, decomposes each Gaussian into smaller Gaussians, replacing ambiguous many-to-one with precise one-to-one correspondences. In parallel, we exploit composition weights from GS rasterization to select Gaussians that significantly and consistently contribute across multiple views and aggregate discriminative features through strong pixel-Gaussian associations, enforcing multi-view consistency. The resulting compact yet discriminative feature fields enable stable PnP convergence, achieving state-of-the-art performance on localization benchmarks. Extensive experiments validate that SplitGS-Loc extends the utility of photometric GSFFs to accurate and efficient localization by exploiting Gaussian attributes, without per-scene training or iterative pose refinement.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 54 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
42 of 54 references.
References · 42
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2023LERF: Language Embedded Radiance Fieldscited by 538
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
- 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
30 more
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2020Visual Camera Re-Localization from RGB and RGB-D Images Using DSACcited by 176
- 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161
- 2017Learning Less is More - 6D Camera Localization via 3D Surface Regressioncited by 146
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
- 2021LENS: Localization enhanced by NeRF synthesiscited by 116
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 85
- 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matchingcited by 82
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
- 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 73
- 2020Robust Image Retrieval-based Visual Localization using Kapturecited by 66
- 2021On the Limits of Pseudo Ground Truth in Visual Camera Re-localisationcited by 63
- 2021Direct-PoseNet: Absolute Pose Regression with Photometric Consistencycited by 61
- 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 50
- 2024GLACE: Global Local Accelerated Coordinate Encodingcited by 48
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
- 2024Map-Relative Pose Regression for Visual Re-Localizationcited by 42
- 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 36
- 2024The NeRFect Match: Exploring NeRF Features for Visual Localizationcited by 32
- 2024GS-CPR: Efficient Camera Pose Refinement via 3D Gaussian Splattingcited by 31
- 2023PNeRFLoc: Visual Localization with Point-based Neural Radiance Fieldscited by 22
- 2024GSplatLoc: Grounding Keypoint Descriptors into 3D Gaussian Splatting for Improved Visual Localizationcited by 15
- 2025From Sparse to Dense: Camera Relocalization with Scene-Specific Detector from Feature Gaussian Splattingcited by 13
- 2023Coarse-to-Fine Multi-Scene Pose Regression with Transformerscited by 11
- 2024Learning to Produce Semi-dense Correspondences for Visual Localizationcited by 10
- 2025Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localizationcited by 10
- 2025GSVisLoc: Generalizable Visual Localization for Gaussian Splatting Scene Representationscited by 5
- 2024Adversarial Exploitation of Data Diversity Improves Visual Localizationcited by 4
- 2024Activating Self-Attention for Multi-Scene Absolute Pose Regressioncited by 2
Built on by
Not cited yet.