GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence
Not on the map. Why?
Abstract (arXiv)
Category-level pose estimation is a challenging task with many potential applications in computer vision and robotics. Recently, deep-learning-based approaches have made great progress, but are typically hindered by the need for large datasets of either pose-labelled real images or carefully tuned photorealistic simulators. This can be avoided by using only geometry inputs such as depth images to reduce the domain-gap but these approaches suffer from a lack of semantic information, which can be vital in the pose estimation problem. To resolve this conflict, we propose to utilize both geometric and semantic features obtained from a pre-trained foundation model.Our approach projects 2D features from this foundation model into 3D for a single object model per category, and then performs matching against this for new single view observations of unseen object instances with a trained matching network. This requires significantly less data to train than prior methods since the semantic features are robust to object texture and appearance. We demonstrate this with a rich evaluation, showing improved performance over prior methods with a fraction of the data required.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 35 of its 41 references that are in the map. First posted on arXiv 23 Nov 2023.
Builds on
35 of 41 references.
References · 35
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2020Shape Prior Deformation for Categorical 6D Object Pose and Size Estimationcited by 161
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 157
- 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 148
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2020Learning Canonical Shape Space for Category-Level 6D Object Pose and Size Estimationcited by 124
23 more
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 121
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 115
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2020Category Level Object Pose Estimation via Neural Analysis-by-Synthesiscited by 100
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2020Self6D: Self-Supervised Monocular 6D Object Pose Estimationcited by 79
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2021RePOSE: Fast 6D Object Pose Refinement via Deep Texture Renderingcited by 63
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimationcited by 49
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimizationcited by 38
- 2023NOPE: Novel Object Pose Estimation from a Single Imagecited by 38
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimationcited by 34
- 20206D Object Pose Regression via Supervised Learning on Point Cloudscited by 33
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wildcited by 28
- 2022TexPose: Neural Texture Learning for Self-Supervised 6D Object Pose Estimationcited by 23
- 2023Learning to Estimate 6DoF Pose from Limited Data: A Few-Shot, Generalizable Approach using RGB Imagescited by 18
- 2022Fusing Local Similarities for Retrieval-based 3D Orientation Estimation of Unseen Objectscited by 17
- 2021DISP6D: Disentangled Implicit Shape and Pose Learning for Scalable 6D Pose Estimationcited by 12
- 2022Sim2Real Instance-Level Style Transfer for 6D Pose Estimationcited by 10
Built on by
Citing papers per year: 2025: 7; 2026: 5.
12 papers.
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimationcited by 18
- 2025Accurate and efficient zero-shot 6D pose estimation with frozen foundation modelscited by 13
- 2025ConceptPose: Training-Free Zero-Shot Object Pose Estimation using Concept Vectorscited by 5
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learningcited by 4
- 2025BoxDreamer: Dreaming Box Corners for Generalizable Object Pose Estimationcited by 3
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimationcited by 1
- 2026Shape-of-You: Fused Gromov-Wasserstein Optimal Transport for Semantic Correspondence in-the-Wildcited by 1
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondencecited by 1
- 2025DynOPETs: A Versatile Benchmark for Dynamic Object Pose Estimation and Tracking in Moving Camera Scenarioscited by 0
- 2025SCOPE: Semantic Conditioning for Sim2Real Category-Level Object Pose Estimation in Roboticscited by 0
- 2026Object Pose Transformer: Unifying Unseen Object Pose Estimationcited by 0
- 2026Demo-Pose: Depth-Monocular Modality Fusion For Object Pose Estimationcited by 0
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence28 May 2026
- 2026Demo-Pose: Depth-Monocular Modality Fusion For Object Pose Estimation29 Mar 2026
- 2026Object Pose Transformer: Unifying Unseen Object Pose Estimation24 Mar 2026
- 2026Shape-of-You: Fused Gromov-Wasserstein Optimal Transport for Semantic Correspondence in-the-Wild12 Mar 2026
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation28 Feb 2026
- 2025ConceptPose: Training-Free Zero-Shot Object Pose Estimation using Concept Vectors9 Dec 2025
- 2025SCOPE: Semantic Conditioning for Sim2Real Category-Level Object Pose Estimation in Robotics29 Sep 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025
- 2025Accurate and efficient zero-shot 6D pose estimation with frozen foundation models11 Jun 2025
- 2025BoxDreamer: Dreaming Box Corners for Generalizable Object Pose Estimation10 Apr 2025
- 2025DynOPETs: A Versatile Benchmark for Dynamic Object Pose Estimation and Tracking in Moving Camera Scenarios25 Mar 2025
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation6 Feb 2025