A Unified Framework for Multi-View Multi-Class Object Pose Estimation
Not on the map. Why?
Abstract (arXiv)
One core challenge in object pose estimation is to ensure accurate and robust performance for large numbers of diverse foreground objects amidst complex background clutter. In this work, we present a scalable framework for accurately inferring six Degree-of-Freedom (6-DoF) pose for a large number of object classes from single or multiple views. To learn discriminative pose features, we integrate three new capabilities into a deep Convolutional Neural Network (CNN): an inference scheme that combines both classification and pose regression based on a uniform tessellation of the Special Euclidean group in three dimensions (SE(3)), the fusion of class priors into the training process via a tiled class map, and an additional regularization using deep supervision with an object mask. Further, an efficient multi-view framework is formulated to address single-view ambiguity. We show that this framework consistently improves the performance of the single-view network. We evaluate our method on three large-scale benchmarks: YCB-Video, JHUScene-50 and ObjectNet-3D. Our approach achieves competitive or superior performance over the current state-of-the-art methods.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 22; 2023: 9; 2024: 2; 2025: 2; 2026: 1.
49 papers.
Sort:
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2022Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulationcited by 49
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2021StereOBJ-1M: Large-scale Stereo Image Dataset for 6D Object Pose Estimationcited by 40
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimationcited by 32
37 more
- 2021ODAM: Object Detection, Association, and Mapping using Posed RGB Videocited by 22
- 2022Neural Correspondence Field for Object Pose Estimationcited by 21
- 20216D-ViT: Category-Level 6D Object Pose Estimation via Transformer-based Instance Representation Learningcited by 20
- 2021PoseContrast: Class-Agnostic Object Viewpoint Estimation in the Wild with Pose-Aware Contrastive Learningcited by 19
- 2022ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Frameworkcited by 19
- 2021PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimationcited by 17
- 2023HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimationcited by 17
- 2023Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimationcited by 16
- 2022PoET: Pose Estimation Transformer for Single-View, Multi-Object 6D Pose Estimationcited by 13
- 2022MV6D: Multi-View 6D Pose Estimation on RGB-D Frames Using a Deep Point-wise Voting Networkcited by 9
- 2022DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimationcited by 9
- 2022Multi-View Object Pose Refinement With Differentiable Renderercited by 8
- 2024OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimationcited by 8
- 2022BCOT: A Markerless High-Precision 3D Object Tracking Benchmarkcited by 7
- 2023TransPose: 6D Object Pose Estimation with Geometry-Aware Transformercited by 7
- 2023Hierarchical Graph Neural Networks for Proprioceptive 6D Pose Estimation of In-hand Objectscited by 6
- 2022Multi-view object pose estimation from correspondence distributions and epipolar geometrycited by 5
- 2022Video based Object 6D Pose Estimation using Transformerscited by 5
- 2022Uni6Dv2: Noise Elimination for 6D Pose Estimationcited by 4
- 2023SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimationcited by 4
- 2022BiCo-Net: Regress Globally, Match Locally for Robust 6D Pose Estimationcited by 3
- 2022CenDerNet: Center and Curvature Representations for Render-and-Compare 6D Pose Estimationcited by 2
- 2023Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Posecited by 2
- 2023For A More Comprehensive Evaluation of 6DoF Object Pose Trackingcited by 2
- 2021VideoPose: Estimating 6D object pose from videoscited by 1
- 20226IMPOSE: Bridging the Reality Gap in 6D Pose Estimation for Robotic Graspingcited by 1
- 2022Category-Level 6D Object Pose Estimation with Flexible Vector-Based Rotation Representationcited by 1
- 2021Multistream ValidNet: Improving 6D Object Pose Estimation by Automatic Multistream Validationcited by 0
- 2021Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimationcited by 0
- 2021MPF6D: Masked Pyramid Fusion 6D Pose Estimationcited by 0
- 2022Weakly Supervised Learning of Keypoints for 6D Object Pose Estimationcited by 0
- 2022OOOE: Only-One-Object-Exists Assumption to Find Very Small Objects in Chest Radiographscited by 0
- 2022Context-aware 6D Pose Estimation of Known Objects using RGB-D datacited by 0
- 2023A Stochastic-Geometrical Framework for Object Pose Estimation based on Mixture Models Avoiding the Correspondence Problemcited by 0
- 2025MVTOP: Multi-View Transformer-based Object Pose-Estimationcited by 0
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignmentcited by 0
- 2026OCH3R: Object-Centric Holistic 3D Reconstructioncited by 0
- 2026OCH3R: Object-Centric Holistic 3D Reconstruction13 May 2026
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment23 Dec 2025
- 2025MVTOP: Multi-View Transformer-based Object Pose-Estimation5 Aug 2025
- 2024OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimation29 Aug 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2023A Stochastic-Geometrical Framework for Object Pose Estimation based on Mixture Models Avoiding the Correspondence Problem29 Nov 2023
- 2023HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation21 Nov 2023
- 2023TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer25 Oct 2023
- 2023For A More Comprehensive Evaluation of 6DoF Object Pose Tracking14 Sep 2023
- 2023Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimation10 Aug 2023
- 2023SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation1 Jul 2023
- 2023Hierarchical Graph Neural Networks for Proprioceptive 6D Pose Estimation of In-hand Objects28 Jun 2023
37 more
- 2023Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Pose18 May 2023
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequences4 May 2023
- 2022Context-aware 6D Pose Estimation of Known Objects using RGB-D data11 Dec 2022
- 2022Category-Level 6D Object Pose Estimation with Flexible Vector-Based Rotation Representation9 Dec 2022
- 2022PoET: Pose Estimation Transformer for Single-View, Multi-Object 6D Pose Estimation25 Nov 2022
- 2022Video based Object 6D Pose Estimation using Transformers24 Oct 2022
- 2022OOOE: Only-One-Object-Exists Assumption to Find Very Small Objects in Chest Radiographs13 Oct 2022
- 2022DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimation11 Oct 2022
- 2022Multi-view object pose estimation from correspondence distributions and epipolar geometry3 Oct 2022
- 20226IMPOSE: Bridging the Reality Gap in 6D Pose Estimation for Robotic Grasping30 Aug 2022
- 2022CenDerNet: Center and Curvature Representations for Render-and-Compare 6D Pose Estimation21 Aug 2022
- 2022Uni6Dv2: Noise Elimination for 6D Pose Estimation15 Aug 2022
- 2022MV6D: Multi-View 6D Pose Estimation on RGB-D Frames Using a Deep Point-wise Voting Network1 Aug 2022
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation30 Jul 2022
- 2022Neural Correspondence Field for Object Pose Estimation30 Jul 2022
- 2022Multi-View Object Pose Refinement With Differentiable Renderer6 Jul 2022
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimation6 Jul 2022
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Dataset30 Jun 2022
- 2022BiCo-Net: Regress Globally, Match Locally for Robust 6D Pose Estimation7 May 2022
- 2022ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Framework3 Apr 2022
- 2022BCOT: A Markerless High-Precision 3D Object Tracking Benchmark25 Mar 2022
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Voting15 Mar 2022
- 2022Weakly Supervised Learning of Keypoints for 6D Object Pose Estimation7 Mar 2022
- 2022Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation19 Jan 2022
- 2021VideoPose: Estimating 6D object pose from videos20 Nov 2021
- 2021MPF6D: Masked Pyramid Fusion 6D Pose Estimation17 Nov 2021
- 20216D-ViT: Category-Level 6D Object Pose Estimation via Transformer-based Instance Representation Learning10 Oct 2021
- 2021Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation25 Sep 2021
- 2021StereOBJ-1M: Large-scale Stereo Image Dataset for 6D Object Pose Estimation21 Sep 2021
- 2021ODAM: Object Detection, Association, and Mapping using Posed RGB Video23 Aug 2021
- 2021PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimation23 Aug 2021
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networks19 Aug 2021
- 2021Multistream ValidNet: Improving 6D Object Pose Estimation by Automatic Multistream Validation12 Jun 2021
- 2021PoseContrast: Class-Agnostic Object Viewpoint Estimation in the Wild with Pose-Aware Contrastive Learning12 May 2021
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanism12 Mar 2021
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistency11 Mar 2021
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation3 Mar 2021
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2022Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulationcited by 49
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2021StereOBJ-1M: Large-scale Stereo Image Dataset for 6D Object Pose Estimationcited by 40
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimationcited by 32
12 most cited of 49 All 49 (JSON)
- 2026OCH3R: Object-Centric Holistic 3D Reconstruction13 May 2026
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment23 Dec 2025
- 2025MVTOP: Multi-View Transformer-based Object Pose-Estimation5 Aug 2025
- 2024OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimation29 Aug 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2023A Stochastic-Geometrical Framework for Object Pose Estimation based on Mixture Models Avoiding the Correspondence Problem29 Nov 2023
- 2023HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation21 Nov 2023
- 2023TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer25 Oct 2023
- 2023For A More Comprehensive Evaluation of 6DoF Object Pose Tracking14 Sep 2023
- 2023Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimation10 Aug 2023
- 2023SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation1 Jul 2023
- 2023Hierarchical Graph Neural Networks for Proprioceptive 6D Pose Estimation of In-hand Objects28 Jun 2023
12 newest of 49 All 49 (JSON)