KGpose: Keypoint-Graph Driven End-to-End Multi-Object 6D Pose Estimation via Point-Wise Pose Voting
Not on the map. Why?
Abstract (arXiv)
This letter presents KGpose, a novel end-to-end framework for 6D pose estimation of multiple objects. Our approach combines keypoint-based method with learnable pose regression through `keypoint-graph', which is a graph representation of the keypoints. KGpose first estimates 3D keypoints for each object using an attentional multi-modal feature fusion of RGB and point cloud features. These keypoints are estimated from each point of point cloud and converted into a graph representation. The network directly regresses 6D pose parameters for each point through a sequence of keypoint-graph embedding and local graph embedding which are designed with graph convolutions, followed by rotation and translation heads. The final pose for each object is selected from the candidates of point-wise predictions. The method achieves competitive results on the benchmark dataset, demonstrating the effectiveness of our model. KGpose enables multi-object pose estimation without requiring an extra localization step, offering a unified and efficient solution for understanding geometric contexts in complex scenes for robotic applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 34 references that are in the map. First posted on arXiv 12 Jul 2024.
Builds on
26 of 34 references.
References · 26
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2020Point Transformercited by 1,462
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
14 more
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2020HybridPose: 6D Object Pose Estimation under Hybrid Representationscited by 107
- 2018In Defense of Classical Image Processing: Fast Depth Completion on the CPUcited by 96
- 2019Single-Stage 6D Object Pose Estimationcited by 88
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2019End-to-End Learnable Geometric Vision by Backpropagating PnP Optimizationcited by 65
- 2021Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Votingcited by 25
- 2023Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimationcited by 16
- 2022DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimationcited by 12
- 2021Investigating Attention Mechanism in 3D Point Cloud Object Detectioncited by 10
Built on by
Not cited yet.