LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation
Not on the map. Why?
Abstract (arXiv)
While RGBD-based methods for category-level object pose estimation hold promise, their reliance on depth data limits their applicability in diverse scenarios. In response, recent efforts have turned to RGB-based methods; however, they face significant challenges stemming from the absence of depth information. On one hand, the lack of depth exacerbates the difficulty in handling intra-class shape variation, resulting in increased uncertainty in shape predictions. On the other hand, RGB-only inputs introduce inherent scale ambiguity, rendering the estimation of object size and translation an ill-posed problem. To tackle these challenges, we propose LaPose, a novel framework that models the object shape as the Laplacian mixture model for Pose estimation. By representing each point as a probabilistic distribution, we explicitly quantify the shape uncertainty. LaPose leverages both a generalized 3D information stream and a specialized feature stream to independently predict the Laplacian distribution for each point, capturing different aspects of object geometry. These two distributions are then integrated as a Laplacian mixture model to establish the 2D-3D correspondences, which are utilized to solve the pose via the PnP module. In order to mitigate scale ambiguity, we introduce a scale-agnostic representation for object size and translation, enhancing training efficiency and overall robustness. Extensive experiments on the NOCS datasets validate the effectiveness of LaPose, yielding state-of-the-art performance in RGB-based category-level object pose estimation. Codes are released at https://github.com/lolrudy/LaPose
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 51 of its 58 references that are in the map. First posted on arXiv 24 Sep 2024.
Builds on
51 of 58 references.
References · 51
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Mask R-CNNcited by 7,259
- 2022A ConvNet for the 2020scited by 3,545
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2019Searching for MobileNetV3cited by 1,984
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
- 2019Lookahead Optimizer: k steps forward, 1 step backcited by 333
38 more
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 170
- 2020Shape Prior Deformation for Categorical 6D Object Pose and Size Estimationcited by 158
- 2020MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationshipscited by 153
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 147
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2020Learning Canonical Shape Space for Category-Level 6D Object Pose and Size Estimationcited by 123
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
- 2020HybridPose: 6D Object Pose Estimation under Hybrid Representationscited by 107
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2019Self-supervised 6D Object Pose Estimation for Robot Manipulationcited by 100
- 2020Category Level Object Pose Estimation via Neural Analysis-by-Synthesiscited by 100
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2020Gradient Centralization: A New Optimization Technique for Deep Neural Networkscited by 82
- 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimationcited by 79
- 2022Category-Level 6D Object Pose and Size Estimation using Self-Supervised Deep Prior Deformation Networkscited by 73
- 2015Learning Descriptors for Object Recognition and 3D Pose Estimationcited by 60
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimationcited by 52
- 2022Coupled Iterative Refinement for 6D Multi-Object Pose Estimationcited by 48
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimationcited by 47
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimationcited by 41
- 2021Category-Level Metric Scale Object Shape and Pose Estimationcited by 40
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 40
- 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representationscited by 40
- 2016Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimationcited by 34
- 2022Perspective Flow Aggregation for Data-Limited 6D Object Pose Estimationcited by 32
- 2022Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Imagecited by 29
- 2021ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimationcited by 20
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 8; 2026: 2.
13 papers.
Sort:
By area:
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 2025GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimationcited by 5
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Imagecited by 5
- 2024Street Gaussians without 3D Object Trackercited by 4
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learningcited by 4
- 2025Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypescited by 3
- 2025Beyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single Viewcited by 2
- 2025You Only Pose Once: A Minimalist's Detection Transformer for Monocular RGB Category-level 9D Multi-Object Pose Estimationcited by 1
- 2024Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusioncited by 0
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generationcited by 0
- 2025RCGNet: RGB-based Category-Level 6D Object Pose Estimation with Geometric Guidancecited by 0
- 2026Object Pose Transformer: Unifying Unseen Object Pose Estimationcited by 0
1 more
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videos29 Jun 2026
- 2026Object Pose Transformer: Unifying Unseen Object Pose Estimation24 Mar 2026
- 2025Beyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single View13 Oct 2025
- 2025You Only Pose Once: A Minimalist's Detection Transformer for Monocular RGB Category-level 9D Multi-Object Pose Estimation20 Aug 2025
- 2025RCGNet: RGB-based Category-Level 6D Object Pose Estimation with Geometric Guidance19 Aug 2025
- 2025Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes4 Aug 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image15 Apr 2025
- 2025GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimation19 Mar 2025
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation9 Mar 2025
- 2024Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion16 Dec 2024
- 2024Street Gaussians without 3D Object Tracker7 Dec 2024
1 more
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 2025GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimationcited by 5
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Imagecited by 5
- 2024Street Gaussians without 3D Object Trackercited by 4
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learningcited by 4
- 2025Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypescited by 3
- 2025Beyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single Viewcited by 2
- 2025You Only Pose Once: A Minimalist's Detection Transformer for Monocular RGB Category-level 9D Multi-Object Pose Estimationcited by 1
- 2024Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusioncited by 0
- 2025RCGNet: RGB-based Category-Level 6D Object Pose Estimation with Geometric Guidancecited by 0
- 2026Object Pose Transformer: Unifying Unseen Object Pose Estimationcited by 0
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videoscited by 0
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videos29 Jun 2026
- 2026Object Pose Transformer: Unifying Unseen Object Pose Estimation24 Mar 2026
- 2025Beyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single View13 Oct 2025
- 2025You Only Pose Once: A Minimalist's Detection Transformer for Monocular RGB Category-level 9D Multi-Object Pose Estimation20 Aug 2025
- 2025RCGNet: RGB-based Category-Level 6D Object Pose Estimation with Geometric Guidance19 Aug 2025
- 2025Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes4 Aug 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image15 Apr 2025
- 2025GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimation19 Mar 2025
- 2024Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion16 Dec 2024
- 2024Street Gaussians without 3D Object Tracker7 Dec 2024
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image25 Nov 2024