mlsanityData to 7 Oct 2026

LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation

arXiv 2409.15727 ↗First posted 24 Sep 2024cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

While RGBD-based methods for category-level object pose estimation hold promise, their reliance on depth data limits their applicability in diverse scenarios. In response, recent efforts have turned to RGB-based methods; however, they face significant challenges stemming from the absence of depth information. On one hand, the lack of depth exacerbates the difficulty in handling intra-class shape variation, resulting in increased uncertainty in shape predictions. On the other hand, RGB-only inputs introduce inherent scale ambiguity, rendering the estimation of object size and translation an ill-posed problem. To tackle these challenges, we propose LaPose, a novel framework that models the object shape as the Laplacian mixture model for Pose estimation. By representing each point as a probabilistic distribution, we explicitly quantify the shape uncertainty. LaPose leverages both a generalized 3D information stream and a specialized feature stream to independently predict the Laplacian distribution for each point, capturing different aspects of object geometry. These two distributions are then integrated as a Laplacian mixture model to establish the 2D-3D correspondences, which are utilized to solve the pose via the PnP module. In order to mitigate scale ambiguity, we introduce a scale-agnostic representation for object size and translation, enhancing training efficiency and overall robustness. Extensive experiments on the NOCS datasets validate the effectiveness of LaPose, yielding state-of-the-art performance in RGB-based category-level object pose estimation. Codes are released at https://github.com/lolrudy/LaPose

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 51 of its 58 references that are in the map. First posted on arXiv 24 Sep 2024.

Builds on

51 of 58 references.

References · 51

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2017Mask R-CNNcited by 7,259
  3. 2022A ConvNet for the 2020scited by 3,545
  4. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  5. 2019Searching for MobileNetV3cited by 1,984
  6. 2021Vision Transformers for Dense Predictioncited by 1,789
  7. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
  8. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
  9. 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
  10. 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
  11. 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
  12. 2019Lookahead Optimizer: k steps forward, 1 step backcited by 333
38 more
  1. 2021Deep ViT Features as Dense Visual Descriptorscited by 327
  2. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
  3. 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
  4. 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
  5. 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
  6. 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
  7. 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
  8. 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 170
  9. 2020Shape Prior Deformation for Categorical 6D Object Pose and Size Estimationcited by 158
  10. 2020MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationshipscited by 153
  11. 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
  12. 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 147
  13. 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
  14. 2020Learning Canonical Shape Space for Category-Level 6D Object Pose and Size Estimationcited by 123
  15. 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
  16. 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
  17. 2020HybridPose: 6D Object Pose Estimation under Hybrid Representationscited by 107
  18. 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
  19. 2019Self-supervised 6D Object Pose Estimation for Robot Manipulationcited by 100
  20. 2020Category Level Object Pose Estimation via Neural Analysis-by-Synthesiscited by 100
  21. 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
  22. 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
  23. 2020Gradient Centralization: A New Optimization Technique for Deep Neural Networkscited by 82
  24. 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimationcited by 79
  25. 2022Category-Level 6D Object Pose and Size Estimation using Self-Supervised Deep Prior Deformation Networkscited by 73
  26. 2015Learning Descriptors for Object Recognition and 3D Pose Estimationcited by 60
  27. 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimationcited by 52
  28. 2022Coupled Iterative Refinement for 6D Multi-Object Pose Estimationcited by 48
  29. 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimationcited by 47
  30. 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
  31. 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimationcited by 41
  32. 2021Category-Level Metric Scale Object Shape and Pose Estimationcited by 40
  33. 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 40
  34. 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representationscited by 40
  35. 2016Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimationcited by 34
  36. 2022Perspective Flow Aggregation for Data-Limited 6D Object Pose Estimationcited by 32
  37. 2022Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Imagecited by 29
  38. 2021ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimationcited by 20

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 8; 2026: 2.

13 papers.

Sort:

By area: