mlsanityData to 7 Oct 2026

Disambiguating 2D-3D Correspondences in Gaussian Splatting-based Feature Fields for Visual Localization

arXiv 2605.07351 ↗First posted 8 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

While Gaussian Splatting-based Feature Fields (GSFFs) have shown promise for visual localization, this paper highlights that photometrically optimized GSFFs are inherently ill-suited for 2D-3D matching. The volumetric extent of each Gaussian induces many-to-one pixel-to-point mappings that destabilize PnP-based pose estimation, while photometric optimization gives rise to superfluous Gaussians devoid of multi-view consistency. To address these issues, we propose SplitGS-Loc, a localization-specialized GSFFs construction framework that disambiguates 2D-3D correspondences by exploiting Gaussian attributes. Our key design, Mixture-of-Gaussians-based splitting, decomposes each Gaussian into smaller Gaussians, replacing ambiguous many-to-one with precise one-to-one correspondences. In parallel, we exploit composition weights from GS rasterization to select Gaussians that significantly and consistently contribute across multiple views and aggregate discriminative features through strong pixel-Gaussian associations, enforcing multi-view consistency. The resulting compact yet discriminative feature fields enable stable PnP convergence, achieving state-of-the-art performance on localization benchmarks. Extensive experiments validate that SplitGS-Loc extends the utility of photometric GSFFs to accurate and efficient localization by exploiting Gaussian attributes, without per-scene training or iterative pose refinement.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 54 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

42 of 54 references.

References · 42

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  4. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  5. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  6. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
  7. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
  8. 2023LERF: Language Embedded Radiance Fieldscited by 538
  9. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  10. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
  11. 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
  12. 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
30 more
  1. 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
  2. 2020Visual Camera Re-Localization from RGB and RGB-D Images Using DSACcited by 176
  3. 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161
  4. 2017Learning Less is More - 6D Camera Localization via 3D Surface Regressioncited by 146
  5. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
  6. 2021LENS: Localization enhanced by NeRF synthesiscited by 116
  7. 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
  8. 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 85
  9. 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matchingcited by 82
  10. 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
  11. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 73
  12. 2020Robust Image Retrieval-based Visual Localization using Kapturecited by 66
  13. 2021On the Limits of Pseudo Ground Truth in Visual Camera Re-localisationcited by 63
  14. 2021Direct-PoseNet: Absolute Pose Regression with Photometric Consistencycited by 61
  15. 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 50
  16. 2024GLACE: Global Local Accelerated Coordinate Encodingcited by 48
  17. 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
  18. 2024Map-Relative Pose Regression for Visual Re-Localizationcited by 42
  19. 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 36
  20. 2024The NeRFect Match: Exploring NeRF Features for Visual Localizationcited by 32
  21. 2024GS-CPR: Efficient Camera Pose Refinement via 3D Gaussian Splattingcited by 31
  22. 2023PNeRFLoc: Visual Localization with Point-based Neural Radiance Fieldscited by 22
  23. 2024GSplatLoc: Grounding Keypoint Descriptors into 3D Gaussian Splatting for Improved Visual Localizationcited by 15
  24. 2025From Sparse to Dense: Camera Relocalization with Scene-Specific Detector from Feature Gaussian Splattingcited by 13
  25. 2023Coarse-to-Fine Multi-Scene Pose Regression with Transformerscited by 11
  26. 2024Learning to Produce Semi-dense Correspondences for Visual Localizationcited by 10
  27. 2025Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localizationcited by 10
  28. 2025GSVisLoc: Generalizable Visual Localization for Gaussian Splatting Scene Representationscited by 5
  29. 2024Adversarial Exploitation of Data Diversity Improves Visual Localizationcited by 4
  30. 2024Activating Self-Attention for Multi-Scene Absolute Pose Regressioncited by 2

Built on by

Not cited yet.