RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Category-level object pose estimation aims to predict the 6D pose as well as the 3D metric size of arbitrary objects from a known set of categories. Recent methods harness shape prior adaptation to map the observed point cloud into the canonical space and apply Umeyama algorithm to recover the pose and size. However, their shape prior integration strategy boosts pose estimation indirectly, which leads to insufficient pose-sensitive feature extraction and slow inference speed. To tackle this problem, in this paper, we propose a novel geometry-guided Residual Object Bounding Box Projection network RBP-Pose that jointly predicts object pose and residual vectors describing the displacements from the shape-prior-indicated object surface projections on the bounding box towards the real surface projections. Such definition of residual vectors is inherently zero-mean and relatively small, and explicitly encapsulates spatial cues of the 3D object for robust and accurate pose regression. We enforce geometry-aware consistency terms to align the predicted pose and residual vectors to further boost performance.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 30 Jul 2022.
Builds on
43 of 53 references.
References · 43
- 2017Mask R-CNNcited by 7,277
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
- 2019Lookahead Optimizer: k steps forward, 1 step backcited by 336
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
31 more
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2017Real-Time Seamless Single Shot 6D Object Pose Predictioncited by 210
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2020BOP Challenge 2020 on 6D Object Localizationcited by 193
- 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 172
- 2019Implicit 3D Orientation Learning for 6D Object Detection from RGB Imagescited by 170
- 2020Shape Prior Deformation for Categorical 6D Object Pose and Size Estimationcited by 161
- 2020MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationshipscited by 153
- 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 148
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2020Learning Canonical Shape Space for Category-Level 6D Object Pose and Size Estimationcited by 124
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2020HybridPose: 6D Object Pose Estimation under Hybrid Representationscited by 107
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2019Self-supervised 6D Object Pose Estimation for Robot Manipulationcited by 101
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2019Single-Stage 6D Object Pose Estimationcited by 88
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
- 2020Gradient Centralization: A New Optimization Technique for Deep Neural Networkscited by 82
- 20196-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypointscited by 78
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2018Explaining the Ambiguity of Object Detection and 6D Pose From Visual Datacited by 68
- 2015Learning Descriptors for Object Recognition and 3D Pose Estimationcited by 60
- 2018Deep Model-Based 6D Pose Refinement in RGBcited by 59
- 2019Multi-path Learning for Object Pose Estimation Across Domainscited by 52
- 2018A Unified Framework for Multi-View Multi-Class Object Pose Estimationcited by 49
- 2016Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimationcited by 34
- 2021ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimationcited by 20
Built on by
Citing papers per year: 2022: 2; 2023: 13; 2024: 13; 2025: 8; 2026: 7.
43 papers.
Sort:
By area:
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimationcited by 53
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimationcited by 49
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 48
- 2024Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimationcited by 43
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 41
- 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representationscited by 41
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2022OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detectioncited by 24
- 2022StereoPose: Category-Level 6D Transparent Object Pose Estimation from Stereo Images via Back-View NOCScited by 18
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimationcited by 18
- 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Fieldcited by 17
- 2024CLIPose: Category-Level Object Pose Estimation with Pre-trained Vision-Language Knowledgecited by 16
31 more
- 2025Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimationcited by 16
- 2024LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimationcited by 14
- 2023SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variationscited by 13
- 2023U-RED: Unsupervised 3D Shape Retrieval and Deformation for Partial Point Cloudscited by 12
- 2023MOHO: Learning Single-view Hand-held Object Reconstruction with Multi-view Occlusion-Aware Supervisioncited by 12
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondencecited by 12
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 2024Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimationcited by 11
- 2024PEAR: Phrase-Based Hand-Object Interaction Anticipationcited by 10
- 2023ShapeMatcher: Self-Supervised Joint Shape Canonicalization, Segmentation, Retrieval and Deformationcited by 8
- 2024GeoReF: Geometric Alignment Across Shape Variation for Category-level Object Pose Refinementcited by 8
- 2024KP-RED: Exploiting Semantic Keypoints for Joint 3D Shape Retrieval and Deformationcited by 6
- 2024Polaris: Open-ended Interactive Robotic Manipulation via Syn2Real Visual Grounding and Large Language Modelscited by 6
- 2025GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimationcited by 6
- 2024Street Gaussians without 3D Object Trackercited by 4
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learningcited by 4
- 2026ComPose: A Unified Completion-Pose Framework for Robust Category-Level Object Pose Estimationcited by 4
- 2023RGB-D-Based Categorical Object Pose and Shape Estimation: Methods, Datasets, and Evaluationcited by 2
- 2024ShapeICP: Iterative Category-level Object Pose and Shape Estimation from Depthcited by 2
- 2023MV-ROPE: Multi-view Constraints for Robust Category-level Object Pose and Size Estimationcited by 1
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimationcited by 1
- 2026Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimationcited by 1
- 2026MemPose: Category-level Object Pose Estimation with Memorycited by 1
- 2024Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusioncited by 0
- 2025Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimationcited by 0
- 2025AnyBox: Efficient Zero-Shot 9DoF Pose Estimation of Boxes for Robotic Manipulationcited by 0
- 2025THE-Pose: Topological Prior with Hybrid Graph Fusion for Estimating Category-Level 6D Object Posecited by 0
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimationcited by 0
- 2026DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimationcited by 0
- 2026ComPose: When to Trust Hands for Object Pose Trackingcited by 0
- 2026GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Pickingcited by 0
- 2026GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Picking1 Oct 2026
- 2026MemPose: Category-level Object Pose Estimation with Memory6 Jul 2026
- 2026Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimation22 Jun 2026
- 2026ComPose: A Unified Completion-Pose Framework for Robust Category-Level Object Pose Estimation25 May 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimation15 May 2026
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation5 Feb 2026
- 2025THE-Pose: Topological Prior with Hybrid Graph Fusion for Estimating Category-Level 6D Object Pose11 Dec 2025
- 2025AnyBox: Efficient Zero-Shot 9DoF Pose Estimation of Boxes for Robotic Manipulation19 Nov 2025
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimation20 Aug 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025
31 more
- 2025GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimation19 Mar 2025
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation6 Feb 2025
- 2025Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation4 Feb 2025
- 2024Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion16 Dec 2024
- 2024Street Gaussians without 3D Object Tracker7 Dec 2024
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image25 Nov 2024
- 2024Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimation26 Sep 2024
- 2024LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation24 Sep 2024
- 2024ShapeICP: Iterative Category-level Object Pose and Shape Estimation from Depth23 Aug 2024
- 2024Polaris: Open-ended Interactive Robotic Manipulation via Syn2Real Visual Grounding and Large Language Models15 Aug 2024
- 2024PEAR: Phrase-Based Hand-Object Interaction Anticipation31 Jul 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024GeoReF: Geometric Alignment Across Shape Variation for Category-level Object Pose Refinement17 Apr 2024
- 2024Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation28 Mar 2024
- 2024KP-RED: Exploiting Semantic Keypoints for Joint 3D Shape Retrieval and Deformation15 Mar 2024
- 2024CLIPose: Category-Level Object Pose Estimation with Pre-trained Vision-Language Knowledge24 Feb 2024
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence23 Nov 2023
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation18 Nov 2023
- 2023ShapeMatcher: Self-Supervised Joint Shape Canonicalization, Segmentation, Retrieval and Deformation18 Nov 2023
- 2023MOHO: Learning Single-view Hand-held Object Reconstruction with Multi-view Occlusion-Aware Supervision18 Oct 2023
- 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representations19 Aug 2023
- 2023MV-ROPE: Multi-view Constraints for Robust Category-level Object Pose and Size Estimation17 Aug 2023
- 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Field16 Aug 2023
- 2023U-RED: Unsupervised 3D Shape Retrieval and Deformation for Partial Point Clouds11 Aug 2023
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Models18 Jun 2023
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimation28 Mar 2023
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformation23 Mar 2023
- 2023SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variations18 Mar 2023
- 2023RGB-D-Based Categorical Object Pose and Shape Estimation: Methods, Datasets, and Evaluation19 Jan 2023
- 2022StereoPose: Category-Level 6D Transparent Object Pose Estimation from Stereo Images via Back-View NOCS3 Nov 2022
- 2022OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detection2 Nov 2022
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 48
- 2025Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimationcited by 16
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimationcited by 1
- 2026Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimationcited by 1
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimationcited by 0
- 2026Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimation22 Jun 2026
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation5 Feb 2026
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation4 Feb 2025
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Models18 Jun 2023
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimationcited by 53
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimationcited by 49
- 2024Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimationcited by 43
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 41
- 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representationscited by 41
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2022OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detectioncited by 24
- 2022StereoPose: Category-Level 6D Transparent Object Pose Estimation from Stereo Images via Back-View NOCScited by 18
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimationcited by 18
- 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Fieldcited by 17
- 2024CLIPose: Category-Level Object Pose Estimation with Pre-trained Vision-Language Knowledgecited by 16
- 2024LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimationcited by 14
12 most cited of 38 All 38 (JSON)
- 2026GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Picking1 Oct 2026
- 2026MemPose: Category-level Object Pose Estimation with Memory6 Jul 2026
- 2026ComPose: A Unified Completion-Pose Framework for Robust Category-Level Object Pose Estimation25 May 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimation15 May 2026
- 2025THE-Pose: Topological Prior with Hybrid Graph Fusion for Estimating Category-Level 6D Object Pose11 Dec 2025
- 2025AnyBox: Efficient Zero-Shot 9DoF Pose Estimation of Boxes for Robotic Manipulation19 Nov 2025
- 2025Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimation20 Aug 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025
- 2025GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimation19 Mar 2025
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation6 Feb 2025
- 2024Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion16 Dec 2024
12 newest of 38 All 38 (JSON)