SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Detecting objects and estimating their 6D poses is essential for automated systems to interact safely with the environment. Most 6D pose estimators, however, rely on a single camera frame and suffer from occlusions and ambiguities due to object symmetries. We overcome this issue by presenting a novel symmetry-aware multi-view 6D pose estimator called SyMFM6D. Our approach efficiently fuses the RGB-D frames from multiple perspectives in a deep multi-directional fusion network and predicts predefined keypoints for all objects in the scene simultaneously. Based on the keypoints and an instance semantic segmentation, we efficiently compute the 6D poses by least-squares fitting. To address the ambiguity issues for symmetric objects, we propose a novel training procedure for symmetry-aware keypoint detection including a new objective function. Our SyMFM6D network significantly outperforms the state-of-the-art in both single-view and multi-view 6D pose estimation. We furthermore show the effectiveness of our symmetry-aware training procedure and demonstrate that our approach is robust towards inaccurate camera calibration and dynamic camera setups.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 35 of its 68 references that are in the map. First posted on arXiv 1 Jul 2023.
Builds on
35 of 68 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
23 more
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2017BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depthcited by 225
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2017Real-Time Seamless Single Shot 6D Object Pose Predictioncited by 210
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 147
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2016Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challengecited by 70
- 2014Viewpoints and Keypointscited by 59
- 20163D Fully Convolutional Network for Vehicle Detection in Point Cloudcited by 57
- 2018A Unified Framework for Multi-View Multi-Class Object Pose Estimationcited by 49
- 2019On Object Symmetries and 6D Pose Estimation from Imagescited by 33
- 2022ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Frameworkcited by 19
- 2019CullNet: Calibrated and Pose Aware Confidence Scores for Object Pose Estimationcited by 9
- 2022MV6D: Multi-View 6D Pose Estimation on RGB-D Frames Using a Deep Point-wise Voting Networkcited by 9
- 2020Handling Object Symmetries in CNN-based Pose Estimationcited by 8
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learningcited by 4
- 2026MultiCam: On-the-fly Multi-Camera Pose Estimation Using Spatiotemporal Overlaps of Known Objectscited by 1
- 2025SDT-6D: Fully Sparse Depth-Transformer for Staged End-to-End 6D Pose Estimation in Industrial Multi-View Bin Pickingcited by 0
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Modelscited by 0
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models15 Jun 2026
- 2026MultiCam: On-the-fly Multi-Camera Pose Estimation Using Spatiotemporal Overlaps of Known Objects24 Mar 2026
- 2025SDT-6D: Fully Sparse Depth-Transformer for Staged End-to-End 6D Pose Estimation in Industrial Multi-View Bin Picking9 Dec 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025