Shape Prior Deformation for Categorical 6D Object Pose and Size Estimation
Not on the map. Why?
Abstract (arXiv)
We present a novel learning approach to recover the 6D poses and sizes of unseen object instances from an RGB-D image. To handle the intra-class shape variation, we propose a deep network to reconstruct the 3D object model by explicitly modeling the deformation from a pre-learned categorical shape prior. Additionally, our network infers the dense correspondences between the depth observation of the object instance and the reconstructed 3D model to jointly estimate the 6D object pose and size. We design an autoencoder that trains on a collection of object models and compute the mean latent embedding for each category to learn the categorical shape priors. Extensive experiments on both synthetic and real-world datasets demonstrate that our approach significantly outperforms the state of the art. Our code is available at https://github.com/mentian/object-deformnet.
Key facts. Cited by 158 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 37; 2023: 28; 2024: 25; 2025: 34; 2026: 19.
158 papers.
Sort:
By area:
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
- 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 115
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 114
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
38 more
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2022Category-Level 6D Object Pose and Size Estimation using Self-Supervised Deep Prior Deformation Networkscited by 73
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 70
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimationcited by 69
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2022Zero-Shot Category-Level Object Pose Estimationcited by 57
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimationcited by 52
- 2022HouseCat6D -- A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarioscited by 51
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimationcited by 47
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 47
- 2025Any6D: Model-free 6D Pose Estimation of Novel Objectscited by 47
- 2021Leveraging SE(3) Equivariance for Self-Supervised Category-Level Object Pose Estimationcited by 45
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2021Single-Stage Keypoint-Based Category-Level Object Pose Estimation from an RGB Imagecited by 42
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimationcited by 41
- 2024Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimationcited by 41
- 2021Category-Level Metric Scale Object Shape and Pose Estimationcited by 40
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 40
- 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representationscited by 40
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2024HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Datacited by 37
- 2023TTA-COPE: Test-Time Adaptation for Category-Level Object Pose Estimationcited by 32
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2023POPE: 6-DoF Promptable Pose Estimation of Any Object, in Any Scene, with One Referencecited by 30
- 2022Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Imagecited by 29
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wildcited by 28
- 2022CATRE: Iterative Point Clouds Alignment for Category-level Object Pose Refinementcited by 28
- 2021UDA-COPE: Unsupervised Domain Adaptation for Category-level Object Pose Estimationcited by 25
- 2024DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-level Pose Estimationcited by 24
- 2021iCaps: Iterative Category-level Object Pose and Shape Estimationcited by 23
- 2022Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wildcited by 22
- 20216D-ViT: Category-Level 6D Object Pose Estimation via Transformer-based Instance Representation Learningcited by 20
- 2021ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimationcited by 20
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Pickingcited by 20
- 2022Learning 6-DoF Object Poses to Grasp Category-level Objects by Language Instructionscited by 19
50 most cited of 158 All 158 (JSON)
- 2026GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Picking1 Oct 2026
- 2026PriorPose: Reference-Guided Joint Deformation and Alignment for Category-Level Object Pose Estimation15 Sep 2026
- 2026MemPose: Category-level Object Pose Estimation with Memory6 Jul 2026
- 2026Symmetry-Aware 9D Pose Estimation with Sim(3)-Consistent Feature and Spherical Inception Convolution1 Jun 2026
- 2026Category-Level 3D Correspondence in Camera Space via Morphable Object Priors27 May 2026
- 2026Object Pose and Shape Estimation for Grasping: Does it Work?26 May 2026
- 2026ComPose: A Unified Completion-Pose Framework for Robust Category-Level Object Pose Estimation25 May 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimation15 May 2026
- 2026TSM-Pose: Topology-Aware Learning with Semantic Mamba for Category-Level Object Pose Estimation18 Apr 2026
- 2026Event6D: Event-based Novel Object 6D Pose Tracking30 Mar 2026
- 2026Demo-Pose: Depth-Monocular Modality Fusion For Object Pose Estimation29 Mar 2026
38 more
- 2026Object Pose Transformer: Unifying Unseen Object Pose Estimation24 Mar 2026
- 2026UniPR: Unified Object-level Real-to-Sim Perception and Reconstruction from a Single Stereo Pair20 Mar 2026
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation28 Feb 2026
- 2026Learning Positive-Incentive Point Sampling in Neural Implicit Fields for Object Pose Estimation23 Feb 2026
- 2026Picasso: Holistic Scene Reconstruction with Physics-Constrained Sampling8 Feb 2026
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation5 Feb 2026
- 2026MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation11 Jan 2026
- 2025SceneMaker: Open-set 3D Scene Generation with Decoupled De-occlusion and Pose Estimation Model11 Dec 2025
- 2025PoseGAM: Robust Unseen Object Pose Estimation via Geometry-Aware Multi-View Reasoning11 Dec 2025
- 2025THE-Pose: Topological Prior with Hybrid Graph Fusion for Estimating Category-Level 6D Object Pose11 Dec 2025
- 2025AnyBox: Efficient Zero-Shot 9DoF Pose Estimation of Boxes for Robotic Manipulation19 Nov 2025
- 2025SE(3)-PoseFlow: Estimating 6D Pose Distributions for Uncertainty-Aware Robotic Manipulation3 Nov 2025
- 2025Monocular Visual 8D Pose Estimation for Articulated Bicycles and Cyclists23 Oct 2025
- 2025Beyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single View13 Oct 2025
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025SCOPE: Semantic Conditioning for Sim2Real Category-Level Object Pose Estimation in Robotics29 Sep 2025
- 2025Category-Level Object Shape and Pose Estimation in Less Than a Millisecond23 Sep 2025
- 2025Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimation20 Aug 2025
- 2025RCGNet: RGB-based Category-Level 6D Object Pose Estimation with Geometric Guidance19 Aug 2025
- 2025Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes4 Aug 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025
- 2025Box Pose and Shape Estimation and Domain Adaptation for Large-Scale Warehouse Automation1 Jul 2025
- 2025Orientation Matters: Making 3D Generative Models Orientation-Aligned10 Jun 2025
- 2025UA-Pose: Uncertainty-Aware 6D Object Pose Estimation and Online Object Completion with Partial References9 Jun 2025
- 2025You Only Estimate Once: Unified, One-stage, Real-Time Category-level Articulated Object 6D Pose Estimation for Robotic Grasping6 Jun 2025
- 2025Category-Level 6D Object Pose Estimation in Agricultural Settings Using a Lattice-Deformation Framework and Diffusion-Augmented Synthetic Data30 May 2025
- 2025GMatch: A Lightweight, Geometry-Constrained Keypoint Matcher for Zero-Shot 6DoF Pose Estimation in Robotic Grasp Tasks22 May 2025
- 2025GTR: Gaussian Splatting Tracking and Reconstruction of Unknown Objects Based on Appearance and Geometric Complexity17 May 2025
- 2025Category-Level and Open-Set Object Pose Estimation for Robotics28 Apr 2025
- 2025Instance-Adaptive Keypoint Learning with Local-to-Global Geometric Aggregation for Category-Level Object Pose Estimation21 Apr 2025
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image15 Apr 2025
- 2025MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Model14 Apr 2025
- 2025Any6D: Model-free 6D Pose Estimation of Novel Objects24 Mar 2025
- 2025Structure-Aware Correspondence Learning for Relative Pose Estimation24 Mar 2025
- 2025GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimation19 Mar 2025
- 2025Learning Shape-Independent Transformation via Spherical Representations for Category-Level Object Pose Estimation18 Mar 2025
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation9 Mar 2025
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation6 Feb 2025
50 newest of 158 All 158 (JSON)
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 47
- 2024HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Datacited by 37
- 2025Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimationcited by 16
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimationcited by 10
- 2025MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Modelcited by 4
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimationcited by 1
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generationcited by 0
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimationcited by 0
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation5 Feb 2026
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Model14 Apr 2025
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation9 Mar 2025
- 2025Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation4 Feb 2025
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimation19 Mar 2024
- 2024HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data18 Mar 2024
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Models18 Jun 2023
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
- 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 115
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 114
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
12 most cited of 148 All 148 (JSON)
- 2026GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Picking1 Oct 2026
- 2026PriorPose: Reference-Guided Joint Deformation and Alignment for Category-Level Object Pose Estimation15 Sep 2026
- 2026MemPose: Category-level Object Pose Estimation with Memory6 Jul 2026
- 2026Symmetry-Aware 9D Pose Estimation with Sim(3)-Consistent Feature and Spherical Inception Convolution1 Jun 2026
- 2026Category-Level 3D Correspondence in Camera Space via Morphable Object Priors27 May 2026
- 2026Object Pose and Shape Estimation for Grasping: Does it Work?26 May 2026
- 2026ComPose: A Unified Completion-Pose Framework for Robust Category-Level Object Pose Estimation25 May 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimation15 May 2026
- 2026Event6D: Event-based Novel Object 6D Pose Tracking30 Mar 2026
- 2026Demo-Pose: Depth-Monocular Modality Fusion For Object Pose Estimation29 Mar 2026
- 2026Object Pose Transformer: Unifying Unseen Object Pose Estimation24 Mar 2026
12 newest of 148 All 148 (JSON)