Viewpoints and Keypoints
Not on the map. Why?
Abstract (arXiv)
We characterize the problem of pose estimation for rigid objects in terms of determining viewpoint to explain coarse pose and keypoint prediction to capture the finer details. We address both these tasks in two different settings - the constrained setting with known bounding boxes and the more challenging detection setting where the aim is to simultaneously detect and correctly estimate pose of objects. We present Convolutional Neural Network based architectures for these and demonstrate that leveraging viewpoint estimates can substantially improve local appearance based keypoint predictions. In addition to achieving significant improvements over state-of-the-art in the above tasks, we analyze the error modes and effect of object characteristics on performance to guide future efforts towards this goal.
Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Nov 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 13; 2023: 19; 2024: 6.
59 papers.
Sort:
By area:
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2021Implicit-PDF: Non-Parametric Representation of Probability Distributions on the Rotation Manifoldcited by 65
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2021Wide-Depth-Range 6D Object Pose Estimation in Spacecited by 45
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2021NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimationcited by 41
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagationcited by 33
- 2021Projective Manifold Gradient Layer for Deep Rotation Regressioncited by 31
- 2021ODAM: Object Detection, Association, and Mapping using Posed RGB Videocited by 22
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimationcited by 22
38 more
- 2021Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Imagecited by 20
- 2021PoseContrast: Class-Agnostic Object Viewpoint Estimation in the Wild with Pose-Aware Contrastive Learningcited by 19
- 2022FvOR: Robust Joint Shape and Pose Optimization for Few-view Object Reconstructioncited by 19
- 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Predictioncited by 18
- 2021PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimationcited by 17
- 2021Neural View Synthesis and Matching for Semi-Supervised Few-Shot Learning of 3D Posecited by 15
- 2023CheckerPose: Progressive Dense Keypoint Localization for Object Pose Estimation with Graph Neural Networkcited by 15
- 2023A step towards understanding why classification helps regressioncited by 15
- 2021DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistencycited by 14
- 2023Delving into Discrete Normalizing Flows on SO(3) Manifold for Probabilistic Rotation Modelingcited by 14
- 2023OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Imagescited by 12
- 2023NOVUM: Neural Object Volumes for Robust Object Classificationcited by 11
- 2023Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgerycited by 11
- 2024iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learningcited by 10
- 2022MV6D: Multi-View 6D Pose Estimation on RGB-D Frames Using a Deep Point-wise Voting Networkcited by 9
- 2023A Laplace-inspired Distribution on SO(3) for Probabilistic Rotation Estimationcited by 9
- 2021Lifting 2D Object Locations to 3D by Discounting LiDAR Outliers across Objects and Viewscited by 7
- 2022Semantic keypoint-based pose estimation from single RGB framescited by 7
- 2023CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videoscited by 7
- 2023Equivariant Single View Pose Prediction Via Induced and Restricted Representationscited by 6
- 2021Semi-supervised Viewpoint Estimation with Geometry-aware Conditional Generationcited by 5
- 2022Video based Object 6D Pose Estimation using Transformerscited by 5
- 2023Towards Robust Probabilistic Modeling on SO(3) via Rotation Laplace Distributioncited by 5
- 2023Neural Textured Deformable Meshes for Robust Analysis-by-Synthesiscited by 4
- 2023SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimationcited by 4
- 20243D Equivariant Pose Regression via Direct Wigner-D Harmonics Predictioncited by 4
- 2022ViewNet: Unsupervised Viewpoint Estimation from Conditional Generationcited by 3
- 2023Ultrasound Plane Pose Regression: Assessing Generalized Pose Coordinates in the Fetal Braincited by 3
- 2023YOLOPose V2: Understanding and Improving Transformer-based 6D Pose Estimationcited by 3
- 2022End-to-end Reinforcement Learning of Robotic Manipulation with Robust Keypoints Representationcited by 2
- 20223D-Augmented Contrastive Knowledge Distillation for Image-based Object Pose Estimationcited by 2
- 2022ViewNeRF: Unsupervised Viewpoint Estimation Using Category-Level Neural Radiance Fieldscited by 2
- 2023Robust Category-Level 3D Pose Estimation from Synthetic Datacited by 2
- 20216D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Graspingcited by 1
- 2021VideoPose: Estimating 6D object pose from videoscited by 1
- 2021End-to-End Learning of Multi-category 3D Pose and Shape Estimationcited by 1
- 2022Real-time Detection of 2D Tool Landmarks with Synthetic Training Datacited by 1
- 2022Accidental Turntables: Learning 3D Pose by Watching Objects Turncited by 1
50 most cited of 59 All 59 (JSON)
- 20243D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction1 Nov 2024
- 2024Component Selection for Craft Assembly Tasks19 Jul 2024
- 2024iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning12 Jul 2024
- 2024FastPoseCNN: Real-Time Monocular Category-Level Pose and Size Estimation Framework16 Jun 2024
- 2024Learning a Category-level Object Pose Estimator without Pose Annotations8 Apr 2024
- 2024VAPO: Visibility-Aware Keypoint Localization for Efficient 6DoF Object Pose Estimation21 Mar 2024
- 2023NormNet: Scale Normalization for 6D Pose Estimation in Stacked Scenarios15 Nov 2023
- 2023A step towards understanding why classification helps regression21 Aug 2023
- 2023Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery5 Aug 2023
- 2023YOLOPose V2: Understanding and Improving Transformer-based 6D Pose Estimation21 Jul 2023
- 2023TransPose: A Transformer-based 6D Object Pose Estimation Network with Depth Refinement9 Jul 2023
- 2023Equivariant Single View Pose Prediction Via Induced and Restricted Representations7 Jul 2023
38 more
- 2023SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation1 Jul 2023
- 2023Neural Textured Deformable Meshes for Robust Analysis-by-Synthesis31 May 2023
- 2023CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videos31 May 2023
- 2023Robust Category-Level 3D Pose Estimation from Synthetic Data25 May 2023
- 2023NOVUM: Neural Object Volumes for Robust Object Classification24 May 2023
- 2023Towards Robust Probabilistic Modeling on SO(3) via Rotation Laplace Distribution17 May 2023
- 2023OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images17 Apr 2023
- 2023Delving into Discrete Normalizing Flows on SO(3) Manifold for Probabilistic Rotation Modeling8 Apr 2023
- 2023CheckerPose: Progressive Dense Keypoint Localization for Object Pose Estimation with Graph Neural Network29 Mar 2023
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagation22 Mar 2023
- 2023A Laplace-inspired Distribution on SO(3) for Probabilistic Rotation Estimation3 Mar 2023
- 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Prediction27 Feb 2023
- 2023Ultrasound Plane Pose Regression: Assessing Generalized Pose Coordinates in the Fetal Brain19 Jan 2023
- 2022Accidental Turntables: Learning 3D Pose by Watching Objects Turn13 Dec 2022
- 2022Review on 6D Object Pose Estimation with the focus on Indoor Scene Understanding4 Dec 2022
- 2022ViewNeRF: Unsupervised Viewpoint Estimation Using Category-Level Neural Radiance Fields1 Dec 2022
- 2022ViewNet: Unsupervised Viewpoint Estimation from Conditional Generation1 Dec 2022
- 2022Piecewise Planar Hulls for Semi-Supervised Learning of 3D Shape and Pose from 2D Images14 Nov 2022
- 2022Video based Object 6D Pose Estimation using Transformers24 Oct 2022
- 2022Real-time Detection of 2D Tool Landmarks with Synthetic Training Data21 Oct 2022
- 2022MV6D: Multi-View 6D Pose Estimation on RGB-D Frames Using a Deep Point-wise Voting Network1 Aug 2022
- 20223D-Augmented Contrastive Knowledge Distillation for Image-based Object Pose Estimation2 Jun 2022
- 2022FvOR: Robust Joint Shape and Pose Optimization for Few-view Object Reconstruction16 May 2022
- 2022Semantic keypoint-based pose estimation from single RGB frames12 Apr 2022
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimation28 Mar 2022
- 2022End-to-end Reinforcement Learning of Robotic Manipulation with Robust Keypoints Representation12 Feb 2022
- 2021End-to-End Learning of Multi-category 3D Pose and Shape Estimation19 Dec 2021
- 2021VideoPose: Estimating 6D object pose from videos20 Nov 2021
- 20216D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping11 Nov 2021
- 2021Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Image4 Nov 2021
- 2021Neural View Synthesis and Matching for Semi-Supervised Few-Shot Learning of 3D Pose27 Oct 2021
- 2021Projective Manifold Gradient Layer for Deep Rotation Regression22 Oct 2021
- 2021Lifting 2D Object Locations to 3D by Discounting LiDAR Outliers across Objects and Views16 Sep 2021
- 2021ODAM: Object Detection, Association, and Mapping using Posed RGB Video23 Aug 2021
- 2021PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimation23 Aug 2021
- 2021Implicit-PDF: Non-Parametric Representation of Probability Distributions on the Rotation Manifold10 Jun 2021
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learning7 Jun 2021
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision13 May 2021
50 newest of 59 All 59 (JSON)
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2021Implicit-PDF: Non-Parametric Representation of Probability Distributions on the Rotation Manifoldcited by 65
- 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2021Wide-Depth-Range 6D Object Pose Estimation in Spacecited by 45
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2021NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimationcited by 41
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2023Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagationcited by 33
- 2021Projective Manifold Gradient Layer for Deep Rotation Regressioncited by 31
- 2021ODAM: Object Detection, Association, and Mapping using Posed RGB Videocited by 22
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimationcited by 22
12 most cited of 57 All 57 (JSON)
- 20243D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction1 Nov 2024
- 2024Component Selection for Craft Assembly Tasks19 Jul 2024
- 2024iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning12 Jul 2024
- 2024FastPoseCNN: Real-Time Monocular Category-Level Pose and Size Estimation Framework16 Jun 2024
- 2024VAPO: Visibility-Aware Keypoint Localization for Efficient 6DoF Object Pose Estimation21 Mar 2024
- 2023NormNet: Scale Normalization for 6D Pose Estimation in Stacked Scenarios15 Nov 2023
- 2023A step towards understanding why classification helps regression21 Aug 2023
- 2023Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery5 Aug 2023
- 2023YOLOPose V2: Understanding and Improving Transformer-based 6D Pose Estimation21 Jul 2023
- 2023TransPose: A Transformer-based 6D Object Pose Estimation Network with Depth Refinement9 Jul 2023
- 2023Equivariant Single View Pose Prediction Via Induced and Restricted Representations7 Jul 2023
- 2023SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation1 Jul 2023
12 newest of 57 All 57 (JSON)