SplatPose: Geometry-Aware 6-DoF Pose Estimation from Single RGB Image via 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
6-DoF pose estimation is a fundamental task in computer vision with wide-ranging applications in augmented reality and robotics. Existing single RGB-based methods often compromise accuracy due to their reliance on initial pose estimates and susceptibility to rotational ambiguity, while approaches requiring depth sensors or multi-view setups incur significant deployment costs. To address these limitations, we introduce SplatPose, a novel framework that synergizes 3D Gaussian Splatting (3DGS) with a dual-branch neural architecture to achieve high-precision pose estimation using only a single RGB image. Central to our approach is the Dual-Attention Ray Scoring Network (DARS-Net), which innovatively decouples positional and angular alignment through geometry-domain attention mechanisms, explicitly modeling directional dependencies to mitigate rotational ambiguity. Additionally, a coarse-to-fine optimization pipeline progressively refines pose estimates by aligning dense 2D features between query images and 3DGS-synthesized views, effectively correcting feature misalignment and depth errors from sparse ray sampling. Experiments on three benchmark datasets demonstrate that SplatPose achieves state-of-the-art 6-DoF pose estimation accuracy in single RGB settings, rivaling approaches that depend on depth or multi-view images.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 41 references that are in the map. First posted on arXiv 7 Mar 2025.
Builds on
32 of 41 references.
References · 32
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 382
20 more
- 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 241
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2019Implicit 3D Orientation Learning for 6D Object Detection from RGB Imagescited by 170
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 115
- 2019Hierarchical Scene Coordinate Classification and Regression for Visual Localizationcited by 93
- 2016Learning to Navigate the Energy Landscapecited by 62
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 43
- 2021Single-Stage Keypoint-Based Category-Level Object Pose Estimation from an RGB Imagecited by 42
- 2021NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimationcited by 41
- 2022TransforMatcher: Match-to-Match Attention for Semantic Correspondencecited by 29
- 20246DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Modelcited by 28
- 2022Self-Supervised Equivariant Learning for Oriented Keypoint Detectioncited by 26
- 2023Learning Rotation-Equivariant Features for Visual Correspondencecited by 23
- 2023PNeRFLoc: Visual Localization with Point-based Neural Radiance Fieldscited by 23
- 2022VoGE: A Differentiable Volume Renderer using Gaussian Ellipsoids for Analysis-by-Synthesiscited by 22
- 20243DGS-ReLoc: 3D Gaussian Splatting for Map Representation and Visual ReLocalizationcited by 15
- 2024HGSLoc: 3DGS-based Heuristic Camera Pose Refinementcited by 8
- 2024IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF modelcited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.